Jul 27 21:34:08.147878 ip-10-0-136-223 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 21:34:08.600073 ip-10-0-136-223 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 21:34:08.600073 ip-10-0-136-223 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 21:34:08.600073 ip-10-0-136-223 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 21:34:08.600073 ip-10-0-136-223 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 21:34:08.600073 ip-10-0-136-223 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 21:34:08.601324 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.601077    2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 21:34:08.605800 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605775    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:34:08.605800 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605798    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:34:08.605800 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605802    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605806    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605809    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605812    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605815    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605818    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605820    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605823    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605825    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605832    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605835    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605839    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605841    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605845    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605847    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605850    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605853    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605856    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605858    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605860    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:34:08.605904 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605863    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605866    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605868    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605870    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605873    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605876    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605879    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605881    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605884    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605886    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605889    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605891    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605894    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605897    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605900    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605903    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605905    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605908    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605911    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605914    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:34:08.606381 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605918    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605922    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605926    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605931    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605933    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605936    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605940    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605942    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605945    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605948    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605951    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605954    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605956    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605959    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605961    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605964    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605967    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605970    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605973    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:34:08.607208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605975    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605978    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605980    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605983    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605986    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605988    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605991    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605995    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.605997    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606000    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606002    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606005    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606007    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606009    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606014    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606017    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606021    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606025    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606027    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:34:08.607821 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606030    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606033    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606036    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606039    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606041    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606044    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606048    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606050    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606053    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606056    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606058    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606061    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606065    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606069    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606071    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606074    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606076    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606080    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:34:08.608286 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.606082    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:34:08.609208 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609188    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:34:08.609240 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609211    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:34:08.609240 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609217    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:34:08.609240 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609222    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:34:08.609240 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609225    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:34:08.609240 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609228    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:34:08.609240 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609231    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:34:08.609240 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609234    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:34:08.609240 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609237    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:34:08.609240 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609240    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:34:08.609240 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609243    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609246    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609249    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609252    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609255    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609258    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609260    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609263    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609265    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609268    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609271    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609273    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609276    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609278    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609281    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609283    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609286    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609290    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609292    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609296    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:34:08.609503 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609301    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609304    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609306    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609309    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609313    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609316    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609318    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609321    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609323    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609326    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609328    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609330    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609333    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609336    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609339    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609342    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609345    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609347    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609350    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:34:08.610020 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609353    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609355    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609358    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609361    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609363    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609366    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609370    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609373    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609375    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609378    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609381    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609384    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609387    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609390    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609393    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609395    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609398    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609401    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609403    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609406    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:34:08.610516 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609409    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609411    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609414    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609416    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609419    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609421    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609425    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609427    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609446    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609449    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609452    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609455    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609458    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609461    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609465    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609468    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609470    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609476    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609478    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609481    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:34:08.611016 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609483    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609486    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609489    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609491    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609494    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609497    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609499    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609502    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609515    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609518    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609934    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609939    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609942    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609946    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609949    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609952    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609954    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609956    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609959    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609962    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:34:08.611529 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609965    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609967    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609970    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609972    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609975    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609978    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609981    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609983    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609986    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609989    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609992    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609995    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.609997    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610000    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610002    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610005    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610007    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610010    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610012    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610020    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:34:08.612019 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610024    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610026    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610029    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610032    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610034    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610037    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610039    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610042    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610044    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610047    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610050    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610052    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610055    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610057    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610060    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610063    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610066    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610068    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610070    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610074    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:34:08.612528 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610076    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610079    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610082    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610084    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610087    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610090    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610094    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610098    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610101    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610104    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610107    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610110    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610113    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610116    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610120    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610123    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610125    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610128    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610130    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:34:08.613088 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610133    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610135    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610138    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610141    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610144    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610146    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610149    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610151    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610154    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610157    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610159    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610161    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610164    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610168    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610171    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610174    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610176    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610180    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610183    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610185    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:34:08.613591 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610187    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610190    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610192    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610194    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610197    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610201    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610204    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610206    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610209    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.610212    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610295    2554 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610306    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610315    2554 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610322    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610328    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610334    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610339    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610344    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610347    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610350    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610354    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 21:34:08.614086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610357    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610360    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610363    2554 flags.go:64] FLAG: --cgroup-root=""
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610366    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610369    2554 flags.go:64] FLAG: --client-ca-file=""
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610373    2554 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610376    2554 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610381    2554 flags.go:64] FLAG: --cluster-domain=""
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610384    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610388    2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610391    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610394    2554 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610398    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610401    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610404    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610408    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610411    2554 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610414    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610417    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610420    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610423    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610427    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610445    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610449    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610452    2554 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 21:34:08.614594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610456    2554 flags.go:64] FLAG: --enable-server="true"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610459    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610464    2554 flags.go:64] FLAG: --event-burst="100"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610467    2554 flags.go:64] FLAG: --event-qps="50"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610470    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610473    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610476    2554 flags.go:64] FLAG: --eviction-hard=""
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610480    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610483    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610486    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610489    2554 flags.go:64] FLAG: --eviction-soft=""
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610491    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610497    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610510    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610513    2554 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610516    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610519    2554 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610522    2554 flags.go:64] FLAG: --feature-gates=""
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610526    2554 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610530    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610533    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610536    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610539    2554 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610542    2554 flags.go:64] FLAG: --help="false"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610545    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-136-223.ec2.internal"
Jul 27 21:34:08.615190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610548    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610551    2554 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610553    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610557    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610560    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610563    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610566    2554 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610569    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610572    2554 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610575    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610579    2554 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610581    2554 flags.go:64] FLAG: --kube-reserved=""
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610584    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610587    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610590    2554 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610593    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610596    2554 flags.go:64] FLAG: --lock-file=""
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610599    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610602    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610606    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610612    2554 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610616    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610618    2554 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 21:34:08.615825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610621    2554 flags.go:64] FLAG: --logging-format="text"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610624    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610628    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610631    2554 flags.go:64] FLAG: --manifest-url=""
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610634    2554 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610638    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610642    2554 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610646    2554 flags.go:64] FLAG: --max-pods="110"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610649    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610652    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610655    2554 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610657    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610660    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610663    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610666    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610674    2554 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610677    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610680    2554 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610684    2554 flags.go:64] FLAG: --pod-cidr=""
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610686    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610692    2554 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610695    2554 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610698    2554 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610701    2554 flags.go:64] FLAG: --port="10250"
Jul 27 21:34:08.616445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610704    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610707    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a7234f591658838e"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610710    2554 flags.go:64] FLAG: --qos-reserved=""
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610713    2554 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610717    2554 flags.go:64] FLAG: --register-node="true"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610720    2554 flags.go:64] FLAG: --register-with-taints=""
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610723    2554 flags.go:64] FLAG: --registry-burst="10"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610727    2554 flags.go:64] FLAG: --registry-qps="5"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610730    2554 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610733    2554 flags.go:64] FLAG: --reserved-memory=""
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610737    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610739    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610742    2554 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610746    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610749    2554 flags.go:64] FLAG: --runonce="false"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610752    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610755    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610758    2554 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610760    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610763    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610766    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610769    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610772    2554 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610775    2554 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610778    2554 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 21:34:08.617033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610782    2554 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610785    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610788    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610791    2554 flags.go:64] FLAG: --system-cgroups=""
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610794    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610800    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610802    2554 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610805    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610810    2554 flags.go:64] FLAG: --tls-min-version=""
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610813    2554 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610816    2554 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610821    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610824    2554 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610827    2554 flags.go:64] FLAG: --v="2"
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610831    2554 flags.go:64] FLAG: --version="false"
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610847    2554 flags.go:64] FLAG: --vmodule=""
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610851    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.610854    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611001    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611005    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611008    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611011    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611014    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:34:08.617685 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611019    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611023    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611027    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611030    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611033    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611036    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611039    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611043    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611045    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611048    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611051    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611054    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611056    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611059    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611061    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611064    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611067    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611069    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611072    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611075    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:34:08.618243 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611079    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611082    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611084    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611086    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611089    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611092    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611095    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611097    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611101    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611104    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611107    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611110    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611113    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611115    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611118    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611120    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611123    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611125    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611129    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:34:08.618752 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611132    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611134    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611137    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611139    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611142    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611145    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611147    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611150    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611152    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611155    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611157    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611160    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611162    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611168    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611171    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611174    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611177    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611179    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611182    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611185    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:34:08.619218 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611188    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611190    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611193    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611195    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611198    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611200    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611203    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611205    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611208    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611210    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611213    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611216    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611219    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611222    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611224    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611227    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611229    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611232    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611235    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:34:08.619724 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611237    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611240    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611242    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611245    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611247    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611250    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611254    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611256    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611259    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611261    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611264    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611266    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611268    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611272    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611275    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:34:08.620196 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.611277    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.611903    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.619406    2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.619427    2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.619459    2554 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.619465    2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619528    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619533    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619537    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619540    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619543    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619547    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619552    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619554    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619557    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:34:08.620587 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619560    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619563    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619566    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619568    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619571    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619573    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619576    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619578    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619580    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619583    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619586    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619588    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619591    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619594    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619596    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619600    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619603    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619606    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619608    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:34:08.620969 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619611    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619615    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619618    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619621    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619623    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619626    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619629    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619632    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619637    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619641    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619644    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619647    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619649    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619652    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619655    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619657    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619661    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619663    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619667    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:34:08.621451 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619670    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619673    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619676    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619678    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619681    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619684    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619687    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619690    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619693    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619695    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619699    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619702    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619704    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619707    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619710    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619713    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619716    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619718    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619721    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619724    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:34:08.621925 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619727    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619730    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619733    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619735    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619738    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619740    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619743    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619746    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619748    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619751    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619753    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619756    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619758    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619761    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619763    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619766    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619768    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619771    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619774    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619777    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:34:08.622590 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619780    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619783    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619785    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619788    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619791    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619794    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619797    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619800    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619802    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619804    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619807    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619810    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.619816    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619942    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619947    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 21:34:08.623077 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619950    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619952    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619955    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619958    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619960    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619963    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619965    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619968    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619970    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619973    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619976    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619978    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619981    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619983    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619985    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619988    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619991    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619994    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619996    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 21:34:08.623468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.619999    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620002    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620005    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620008    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620010    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620013    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620016    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620018    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620021    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620024    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620026    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620028    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620031    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620035    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620038    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620041    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620044    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620047    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620050    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 21:34:08.623908 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620054    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620056    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620059    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620062    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620064    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620067    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620069    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620072    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620074    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620077    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620080    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620082    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620085    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620087    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620090    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620092    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620096    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620098    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620101    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620104    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 21:34:08.624370 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620107    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620109    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620111    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620115    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620118    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620121    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620124    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620127    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620130    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620132    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620135    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620137    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620140    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620142    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620145    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620147    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620149    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620152    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620155    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 21:34:08.624894 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620157    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620160    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620162    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620165    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620167    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620170    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620172    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620175    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620177    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620180    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620182    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620188    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620191    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620193    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620196    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620199    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620202    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620205    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620208    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 21:34:08.625367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:08.620210    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 21:34:08.625898 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.620216    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 21:34:08.625898 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.620350    2554 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 21:34:08.625898 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.622829    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 21:34:08.625898 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.624344    2554 server.go:1019] "Starting client certificate rotation"
Jul 27 21:34:08.625898 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.624468    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 21:34:08.625898 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.624514    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 21:34:08.626968 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.626950    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 21:34:08.629017 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.628994    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 21:34:08.641807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.641785    2554 log.go:25] "Validated CRI v1 runtime API"
Jul 27 21:34:08.644107 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.644085    2554 log.go:25] "Validated CRI v1 image API"
Jul 27 21:34:08.644967 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.644951    2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 21:34:08.647698 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.647674    2554 fs.go:135] Filesystem UUIDs: map[0c00c230-6105-4b62-888b-d96e17a394fa:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c36b000e-f7d4-4445-8546-8d01f97ea0e5:/dev/nvme0n1p3]
Jul 27 21:34:08.647764 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.647697    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 21:34:08.654589 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.654411    2554 manager.go:216] Machine: {Timestamp:2026-07-27 21:34:08.652635958 +0000 UTC m=+0.370042432 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3115340 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bafd10b943f45b7f3f0bfde62607c SystemUUID:ec2bafd1-0b94-3f45-b7f3-f0bfde62607c BootID:93cee79d-6c96-4166-a2f2-4c4e163c44e4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2b:68:12:e3:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2b:68:12:e3:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:c4:d7:f0:f0:6c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 21:34:08.654589 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.654568    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 21:34:08.654725 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.654680    2554 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 21:34:08.656670 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.656653    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 21:34:08.657563 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.657533    2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 21:34:08.657714 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.657567    2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-223.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 21:34:08.658378 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.658366    2554 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 21:34:08.658411 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.658380    2554 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 21:34:08.658411 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.658387    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 21:34:08.658411 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.658402    2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 21:34:08.659311 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.659299    2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 21:34:08.661922 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.661906    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 21:34:08.662062 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.662052    2554 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 21:34:08.662096 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.662085    2554 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 21:34:08.662123 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.662096    2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 21:34:08.662123 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.662116    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 21:34:08.662175 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.662126    2554 kubelet.go:398] "Adding apiserver pod source"
Jul 27 21:34:08.662175 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.662136    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 21:34:08.662569 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.662544    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 21:34:08.662610 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.662576    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 21:34:08.664989 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.664970    2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 21:34:08.666882 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.666866    2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 21:34:08.666942 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.666899    2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 21:34:08.668501 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668486    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 21:34:08.668501 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668503    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 21:34:08.668612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668509    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 21:34:08.668612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668514    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 21:34:08.668612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668523    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 21:34:08.668612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668530    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 21:34:08.668612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668538    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 21:34:08.668612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668543    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 21:34:08.668612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668551    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 21:34:08.668612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668556    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 21:34:08.668612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668574    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 21:34:08.668612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.668580    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 21:34:08.670033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.670019    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 21:34:08.670033 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.670031    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 21:34:08.673335 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.673319    2554 server.go:1268] "Started kubelet"
Jul 27 21:34:08.673618 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.673530    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 21:34:08.677307 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.677133    2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 21:34:08.677413 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.677342    2554 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 21:34:08.677697 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.677667    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-223.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 21:34:08.677769 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.677731    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 21:34:08.677889 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.677867    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dnx8v"
Jul 27 21:34:08.677889 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.677879    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 21:34:08.678158 ip-10-0-136-223 systemd[1]: Started Kubernetes Kubelet.
Jul 27 21:34:08.679457 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.679421    2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 21:34:08.681243 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.681223    2554 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 21:34:08.683405 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.683388    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dnx8v"
Jul 27 21:34:08.684175 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.684157    2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 21:34:08.684293 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.683302    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-223.ec2.internal.18c643126a71ceb3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-223.ec2.internal,UID:ip-10-0-136-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-223.ec2.internal,},FirstTimestamp:2026-07-27 21:34:08.673296051 +0000 UTC m=+0.390702523,LastTimestamp:2026-07-27 21:34:08.673296051 +0000 UTC m=+0.390702523,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-223.ec2.internal,}"
Jul 27 21:34:08.691155 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.691123    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 21:34:08.691155 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.691129    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 21:34:08.691403 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.691387    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:08.691791 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.691772    2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 21:34:08.691791 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.691780    2554 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 21:34:08.691932 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.691803    2554 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 21:34:08.692011 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.691975    2554 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 21:34:08.692011 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.691986    2554 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 21:34:08.692125 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.692108    2554 factory.go:55] Registering systemd factory
Jul 27 21:34:08.692194 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.692130    2554 factory.go:223] Registration of the systemd container factory successfully
Jul 27 21:34:08.692361 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.692343    2554 factory.go:153] Registering CRI-O factory
Jul 27 21:34:08.692361 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.692362    2554 factory.go:223] Registration of the crio container factory successfully
Jul 27 21:34:08.692554 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.692413    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 21:34:08.692554 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.692454    2554 factory.go:103] Registering Raw factory
Jul 27 21:34:08.692554 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.692468    2554 manager.go:1196] Started watching for new ooms in manager
Jul 27 21:34:08.693036 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.693024    2554 manager.go:349] Starting recovery of all containers
Jul 27 21:34:08.693127 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.693108    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 21:34:08.695341 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.695310    2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-223.ec2.internal\" not found" node="ip-10-0-136-223.ec2.internal"
Jul 27 21:34:08.702602 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.702582    2554 manager.go:354] Recovery completed
Jul 27 21:34:08.706890 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.706870    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:34:08.709096 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.709078    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:34:08.709178 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.709109    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:34:08.709178 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.709119    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:34:08.709763 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.709743    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 21:34:08.709763 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.709762    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 21:34:08.709869 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.709768    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:34:08.709869 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.709778    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 21:34:08.710528 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.710513    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:34:08.710609 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.710544    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:34:08.710609 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.710558    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:34:08.711963 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.711949    2554 policy_none.go:49] "None policy: Start"
Jul 27 21:34:08.712016 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.711967    2554 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 21:34:08.712016 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.711977    2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 21:34:08.713159 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.713145    2554 policy_none.go:47] "Start"
Jul 27 21:34:08.752318 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.752108    2554 manager.go:337] "Starting Device Plugin manager"
Jul 27 21:34:08.752470 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.752344    2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 21:34:08.752470 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.752358    2554 server.go:87] "Starting device plugin registration server"
Jul 27 21:34:08.752660 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.752647    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 21:34:08.752698 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.752662    2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 21:34:08.752772 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.752753    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 21:34:08.752856 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.752842    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 21:34:08.752856 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.752854    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 21:34:08.753405 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.753381    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 21:34:08.753535 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.753461    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:08.853771 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.853669    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:34:08.855131 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.854739    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:34:08.855131 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.854772    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:34:08.855131 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.854782    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:34:08.855131 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.854808    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-223.ec2.internal"
Jul 27 21:34:08.860623 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.860608    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-223.ec2.internal"
Jul 27 21:34:08.860667 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.860631    2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-223.ec2.internal\": node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:08.873879 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.873852    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:08.912758 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.912716    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 21:34:08.914172 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.914131    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 21:34:08.914172 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.914174    2554 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 21:34:08.914366 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.914197    2554 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 21:34:08.914366 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.914240    2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 21:34:08.916040 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:08.916021    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 21:34:08.974507 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:08.974469    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:09.014977 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.014949    2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-223.ec2.internal"]
Jul 27 21:34:09.015049 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.015026    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:34:09.016044 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.016020    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:34:09.016184 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.016062    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:34:09.016184 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.016078    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:34:09.018012 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.017999    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:34:09.018125 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.018108    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.018172 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.018143    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:34:09.018742 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.018728    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:34:09.018806 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.018754    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:34:09.018806 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.018763    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:34:09.018806 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.018781    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:34:09.018806 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.018790    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:34:09.018922 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.018765    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:34:09.020797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.020781    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.020857 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.020807    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 21:34:09.021531 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.021514    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 21:34:09.021587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.021548    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 21:34:09.021587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.021563    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeHasSufficientPID"
Jul 27 21:34:09.035076 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.035047    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-223.ec2.internal\" not found" node="ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.039699 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.039679    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-223.ec2.internal\" not found" node="ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.074834 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.074800    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:09.094713 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.094684    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa758d18188c78caf39faf92485f4815-config\") pod \"kube-apiserver-proxy-ip-10-0-136-223.ec2.internal\" (UID: \"aa758d18188c78caf39faf92485f4815\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.094799 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.094715    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ddc907e67befd9458898c9ff1c8e0e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal\" (UID: \"6ddc907e67befd9458898c9ff1c8e0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.094799 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.094733    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ddc907e67befd9458898c9ff1c8e0e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal\" (UID: \"6ddc907e67befd9458898c9ff1c8e0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.175893 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.175806    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:09.195183 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.195148    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ddc907e67befd9458898c9ff1c8e0e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal\" (UID: \"6ddc907e67befd9458898c9ff1c8e0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.195298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.195202    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ddc907e67befd9458898c9ff1c8e0e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal\" (UID: \"6ddc907e67befd9458898c9ff1c8e0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.195298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.195228    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa758d18188c78caf39faf92485f4815-config\") pod \"kube-apiserver-proxy-ip-10-0-136-223.ec2.internal\" (UID: \"aa758d18188c78caf39faf92485f4815\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.195298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.195166    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ddc907e67befd9458898c9ff1c8e0e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal\" (UID: \"6ddc907e67befd9458898c9ff1c8e0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.195298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.195276    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa758d18188c78caf39faf92485f4815-config\") pod \"kube-apiserver-proxy-ip-10-0-136-223.ec2.internal\" (UID: \"aa758d18188c78caf39faf92485f4815\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.195298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.195288    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ddc907e67befd9458898c9ff1c8e0e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal\" (UID: \"6ddc907e67befd9458898c9ff1c8e0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.279248 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.279186    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:09.341377 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.341328    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.344742 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.344719    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:09.379346 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.379309    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:09.482592 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.482486    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:09.584974 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.584934    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:09.624404 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.624380    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 21:34:09.624872 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.624578    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 21:34:09.624872 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.624611    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 21:34:09.654726 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.654690    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 21:34:09.685997 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.685959    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:09.688825 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.688799    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 21:29:09 +0000 UTC" deadline="2028-01-29 01:05:30.249769943 +0000 UTC"
Jul 27 21:34:09.688885 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.688826    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13203h31m20.560946294s"
Jul 27 21:34:09.786764 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.786664    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:09.887049 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.887000    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:09.959173 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:09.959124    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa758d18188c78caf39faf92485f4815.slice/crio-d3d832f2921de83823ccb13f8b29cd2a47414400a41a7460dc9e42330baf1489 WatchSource:0}: Error finding container d3d832f2921de83823ccb13f8b29cd2a47414400a41a7460dc9e42330baf1489: Status 404 returned error can't find the container with id d3d832f2921de83823ccb13f8b29cd2a47414400a41a7460dc9e42330baf1489
Jul 27 21:34:09.964851 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:09.964832    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:34:09.988467 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:09.988428    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:10.094011 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.093920    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:10.194615 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.194577    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-223.ec2.internal\" not found"
Jul 27 21:34:10.243744 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.243715    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 21:34:10.294589 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.294554    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:10.303713 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.303684    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 21:34:10.304911 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.304895    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal"
Jul 27 21:34:10.316921 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.316897    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 21:34:10.328574 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:10.328548    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ddc907e67befd9458898c9ff1c8e0e9.slice/crio-50f1df610f3165bf1b8b6b39ab123118f6ab2bb7b2b6b97aa0f88a91b57b5f41 WatchSource:0}: Error finding container 50f1df610f3165bf1b8b6b39ab123118f6ab2bb7b2b6b97aa0f88a91b57b5f41: Status 404 returned error can't find the container with id 50f1df610f3165bf1b8b6b39ab123118f6ab2bb7b2b6b97aa0f88a91b57b5f41
Jul 27 21:34:10.502682 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.502598    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 21:34:10.663651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.663607    2554 apiserver.go:52] "Watching apiserver"
Jul 27 21:34:10.681274 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.681236    2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 21:34:10.684271 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.684236    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-m4pvd","openshift-dns/node-resolver-p6h5c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal","openshift-multus/multus-additional-cni-plugins-svh5z","openshift-multus/network-metrics-daemon-kqgdb","openshift-network-diagnostics/network-check-target-zrv6d","kube-system/global-pull-secret-syncer-rzszd","kube-system/konnectivity-agent-lmksj","openshift-image-registry/node-ca-hdv2z","openshift-multus/multus-658jk","openshift-network-operator/iptables-alerter-hgspq","openshift-ovn-kubernetes/ovnkube-node-q96gh","kube-system/kube-apiserver-proxy-ip-10-0-136-223.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"]
Jul 27 21:34:10.686524 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.686482    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:10.686653 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.686582    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:10.688133 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.688103    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgspq"
Jul 27 21:34:10.690437 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.690411    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.692414 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.692393    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 21:34:10.693694 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.693674    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.696501 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.696195    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:10.696501 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.696262    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:10.698916 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.698890    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:10.699008 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.698989    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:10.700826 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.700804    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:34:10.701278 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.701187    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 21:34:10.701482 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.701456    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-26t5b\""
Jul 27 21:34:10.702758 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.702707    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-cnibin\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.702853 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.702772    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.702853 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.702783    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hdv2z"
Jul 27 21:34:10.702853 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.702801    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:10.702853 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.702827    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b496aba9-3601-4e2c-9bb8-0c772ffa9555-iptables-alerter-script\") pod \"iptables-alerter-hgspq\" (UID: \"b496aba9-3601-4e2c-9bb8-0c772ffa9555\") " pod="openshift-network-operator/iptables-alerter-hgspq"
Jul 27 21:34:10.703070 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.702887    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-etc-selinux\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.703070 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.702917    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-system-cni-dir\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.703070 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.702942    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-os-release\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.703070 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.702996    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b496aba9-3601-4e2c-9bb8-0c772ffa9555-host-slash\") pod \"iptables-alerter-hgspq\" (UID: \"b496aba9-3601-4e2c-9bb8-0c772ffa9555\") " pod="openshift-network-operator/iptables-alerter-hgspq"
Jul 27 21:34:10.703070 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703037    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbnz2\" (UniqueName: \"kubernetes.io/projected/89c1df03-b3d9-41fc-82aa-378536cd031f-kube-api-access-hbnz2\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.703070 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703070    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75a6e8d7-371c-49b8-89c0-053c92104d83-cni-binary-copy\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.703298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703086    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vwmp\" (UniqueName: \"kubernetes.io/projected/75a6e8d7-371c-49b8-89c0-053c92104d83-kube-api-access-4vwmp\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.703298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703104    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20a71333-87bf-440c-bec0-ad436ffe66f3-dbus\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:10.703298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703120    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5bln\" (UniqueName: \"kubernetes.io/projected/b496aba9-3601-4e2c-9bb8-0c772ffa9555-kube-api-access-w5bln\") pod \"iptables-alerter-hgspq\" (UID: \"b496aba9-3601-4e2c-9bb8-0c772ffa9555\") " pod="openshift-network-operator/iptables-alerter-hgspq"
Jul 27 21:34:10.703298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703135    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.703298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703173    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-socket-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.703298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703201    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-device-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.703298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703228    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75a6e8d7-371c-49b8-89c0-053c92104d83-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.703298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703272    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75a6e8d7-371c-49b8-89c0-053c92104d83-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.703667 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703305    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20a71333-87bf-440c-bec0-ad436ffe66f3-kubelet-config\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:10.703667 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703334    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-registration-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.703667 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.703355    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-sys-fs\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.705099 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.705074    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 21:34:10.706408 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.706386    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:10.707083 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.706890    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 21:34:10.707083 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.706907    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 21:34:10.707083 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.706932    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 21:34:10.707275 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.707229    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 21:34:10.707333 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.707295    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 21:34:10.707387 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.707371    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 21:34:10.707476 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.707460    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 21:34:10.707593 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.707577    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 21:34:10.707664 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.707646    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 21:34:10.707727 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.707656    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fsgcq\""
Jul 27 21:34:10.707930 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.707913    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 21:34:10.708257 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.708236    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 21:34:10.708375 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.708356    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x6q7n\""
Jul 27 21:34:10.708442 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.708422    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m5fqm\""
Jul 27 21:34:10.710038 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.709746    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6h5c"
Jul 27 21:34:10.712712 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.712690    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.716071 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.715548    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.716207 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.716186    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 21:34:10.716984 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.716638    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zv6n8\""
Jul 27 21:34:10.716984 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.716853    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 21:34:10.717348 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.717330    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 21:34:10.717590 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.717573    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bpkp7\""
Jul 27 21:34:10.717677 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.717657    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.717796 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.717780    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 21:34:10.717887 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.717870    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 21:34:10.717997 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.717663    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bzc5h\""
Jul 27 21:34:10.726928 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.726899    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:34:10.727223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.727204    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 21:34:10.727761 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.727365    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 21:34:10.731961 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.731878    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8c4jf\""
Jul 27 21:34:10.732125 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.732067    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 21:34:10.732730 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.732709    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 21:34:10.732859 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.732838    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 21:34:10.733039 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.733016    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 21:34:10.733153 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.733133    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g5hgq\""
Jul 27 21:34:10.733444 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.733424    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 21:34:10.733571 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.733510    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 21:34:10.792997 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.792965    2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 21:34:10.798022 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.797985    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cs4m8"
Jul 27 21:34:10.804071 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804030    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vwmp\" (UniqueName: \"kubernetes.io/projected/75a6e8d7-371c-49b8-89c0-053c92104d83-kube-api-access-4vwmp\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.804071 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.804309 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804131    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-run-systemd\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.804309 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804155    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-cni-bin\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.804309 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804179    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d9mf\" (UniqueName: \"kubernetes.io/projected/3ebb85ba-6b73-4414-b816-97de13ceb9ed-kube-api-access-7d9mf\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.804309 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804205    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc7jg\" (UniqueName: \"kubernetes.io/projected/8a320449-3323-4c81-9d13-07329a8d3586-kube-api-access-tc7jg\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:10.804309 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804227    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-daemon-config\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.804309 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804293    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20a71333-87bf-440c-bec0-ad436ffe66f3-kubelet-config\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:10.804647 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804319    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-registration-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.804647 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804345    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-sys-fs\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.804647 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804371    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-node-log\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.804647 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804398    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.804647 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804425    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0da1b92e-c511-430f-84ba-ebcedfbfb04a-ovnkube-script-lib\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.804647 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804453    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ebb85ba-6b73-4414-b816-97de13ceb9ed-tmp\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.804647 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804479    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-run-k8s-cni-cncf-io\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.804647 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804531    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-cnibin\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.804647 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804574    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-run-openvswitch\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.804647 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804604    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-run-ovn\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.804647 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804629    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0da1b92e-c511-430f-84ba-ebcedfbfb04a-env-overrides\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804668    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx8xz\" (UniqueName: \"kubernetes.io/projected/82beb1c9-1fa4-4623-8bf6-82c83aa68ae7-kube-api-access-sx8xz\") pod \"node-resolver-p6h5c\" (UID: \"82beb1c9-1fa4-4623-8bf6-82c83aa68ae7\") " pod="openshift-dns/node-resolver-p6h5c"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804703    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-host\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804757    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-etc-openvswitch\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804810    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xmvb\" (UniqueName: \"kubernetes.io/projected/0da1b92e-c511-430f-84ba-ebcedfbfb04a-kube-api-access-4xmvb\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804841    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82beb1c9-1fa4-4623-8bf6-82c83aa68ae7-tmp-dir\") pod \"node-resolver-p6h5c\" (UID: \"82beb1c9-1fa4-4623-8bf6-82c83aa68ae7\") " pod="openshift-dns/node-resolver-p6h5c"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804907    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-cnibin\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804937    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20a71333-87bf-440c-bec0-ad436ffe66f3-dbus\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.804963    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-socket-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805003    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-device-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805031    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-kubelet\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805062    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2be4f951-d474-4b2e-9104-73913eefa705-serviceca\") pod \"node-ca-hdv2z\" (UID: \"2be4f951-d474-4b2e-9104-73913eefa705\") " pod="openshift-image-registry/node-ca-hdv2z"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805088    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-kubernetes\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805114    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-os-release\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805138    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vwv4\" (UniqueName: \"kubernetes.io/projected/06b7655b-5dc5-484f-9036-57f62f3f9158-kube-api-access-2vwv4\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805163    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-tuned\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.805185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805190    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-run-netns\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805223    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805250    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-etc-selinux\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805277    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0da1b92e-c511-430f-84ba-ebcedfbfb04a-ovn-node-metrics-cert\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805319    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4xl9\" (UniqueName: \"kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9\") pod \"network-check-target-zrv6d\" (UID: \"8f0ba091-3816-4ddb-a041-ca3a9bb66630\") " pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805366    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfb4m\" (UniqueName: \"kubernetes.io/projected/2be4f951-d474-4b2e-9104-73913eefa705-kube-api-access-wfb4m\") pod \"node-ca-hdv2z\" (UID: \"2be4f951-d474-4b2e-9104-73913eefa705\") " pod="openshift-image-registry/node-ca-hdv2z"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805371    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805393    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-sysctl-conf\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805490    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-cnibin\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805497    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20a71333-87bf-440c-bec0-ad436ffe66f3-kubelet-config\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805544    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-registration-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805681    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-sys-fs\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805708    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-systemd\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805885    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-tuning-conf-dir\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805936    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-etc-selinux\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.805950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805944    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20a71333-87bf-440c-bec0-ad436ffe66f3-dbus\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.805972    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbnz2\" (UniqueName: \"kubernetes.io/projected/89c1df03-b3d9-41fc-82aa-378536cd031f-kube-api-access-hbnz2\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806012    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-var-lib-openvswitch\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806014    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-socket-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806019    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89c1df03-b3d9-41fc-82aa-378536cd031f-device-dir\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806049    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2be4f951-d474-4b2e-9104-73913eefa705-host\") pod \"node-ca-hdv2z\" (UID: \"2be4f951-d474-4b2e-9104-73913eefa705\") " pod="openshift-image-registry/node-ca-hdv2z"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806129    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-lib-modules\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806167    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef06485f-d142-47b9-ae20-82afdd303030-konnectivity-ca\") pod \"konnectivity-agent-lmksj\" (UID: \"ef06485f-d142-47b9-ae20-82afdd303030\") " pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806218    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06b7655b-5dc5-484f-9036-57f62f3f9158-cni-binary-copy\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806252    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-conf-dir\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806307    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-run-multus-certs\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806342    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806386    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-var-lib-cni-multus\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806417    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-hostroot\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806468    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75a6e8d7-371c-49b8-89c0-053c92104d83-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806498    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75a6e8d7-371c-49b8-89c0-053c92104d83-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806715    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0da1b92e-c511-430f-84ba-ebcedfbfb04a-ovnkube-config\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.806797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806742    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-etc-kubernetes\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806763    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b496aba9-3601-4e2c-9bb8-0c772ffa9555-iptables-alerter-script\") pod \"iptables-alerter-hgspq\" (UID: \"b496aba9-3601-4e2c-9bb8-0c772ffa9555\") " pod="openshift-network-operator/iptables-alerter-hgspq"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806799    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-cni-netd\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806815    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-modprobe-d\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806915    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-sysctl-d\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806941    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-sys\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806961    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-socket-dir-parent\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.806982    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-var-lib-cni-bin\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807000    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-slash\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807016    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-sysconfig\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807054    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-var-lib-kubelet\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807107    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-system-cni-dir\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807147    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75a6e8d7-371c-49b8-89c0-053c92104d83-cni-binary-copy\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807148    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75a6e8d7-371c-49b8-89c0-053c92104d83-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807186    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75a6e8d7-371c-49b8-89c0-053c92104d83-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807188    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5bln\" (UniqueName: \"kubernetes.io/projected/b496aba9-3601-4e2c-9bb8-0c772ffa9555-kube-api-access-w5bln\") pod \"iptables-alerter-hgspq\" (UID: \"b496aba9-3601-4e2c-9bb8-0c772ffa9555\") " pod="openshift-network-operator/iptables-alerter-hgspq"
Jul 27 21:34:10.807651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807235    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807409    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b496aba9-3601-4e2c-9bb8-0c772ffa9555-iptables-alerter-script\") pod \"iptables-alerter-hgspq\" (UID: \"b496aba9-3601-4e2c-9bb8-0c772ffa9555\") " pod="openshift-network-operator/iptables-alerter-hgspq"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807495    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef06485f-d142-47b9-ae20-82afdd303030-agent-certs\") pod \"konnectivity-agent-lmksj\" (UID: \"ef06485f-d142-47b9-ae20-82afdd303030\") " pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807532    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-run-netns\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807564    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/82beb1c9-1fa4-4623-8bf6-82c83aa68ae7-hosts-file\") pod \"node-resolver-p6h5c\" (UID: \"82beb1c9-1fa4-4623-8bf6-82c83aa68ae7\") " pod="openshift-dns/node-resolver-p6h5c"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807595    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807621    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-systemd-units\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807647    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-log-socket\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807669    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-var-lib-kubelet\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807680    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75a6e8d7-371c-49b8-89c0-053c92104d83-cni-binary-copy\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807697    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-system-cni-dir\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807725    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-os-release\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807752    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b496aba9-3601-4e2c-9bb8-0c772ffa9555-host-slash\") pod \"iptables-alerter-hgspq\" (UID: \"b496aba9-3601-4e2c-9bb8-0c772ffa9555\") " pod="openshift-network-operator/iptables-alerter-hgspq"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807777    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-run\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807802    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-cni-dir\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807813    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-os-release\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.807842    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:10.808425 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807948    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75a6e8d7-371c-49b8-89c0-053c92104d83-system-cni-dir\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.809285 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.807991    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b496aba9-3601-4e2c-9bb8-0c772ffa9555-host-slash\") pod \"iptables-alerter-hgspq\" (UID: \"b496aba9-3601-4e2c-9bb8-0c772ffa9555\") " pod="openshift-network-operator/iptables-alerter-hgspq"
Jul 27 21:34:10.809285 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.808071    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret podName:20a71333-87bf-440c-bec0-ad436ffe66f3 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:11.308048591 +0000 UTC m=+3.025455060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret") pod "global-pull-secret-syncer-rzszd" (UID: "20a71333-87bf-440c-bec0-ad436ffe66f3") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:10.809285 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.809001    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cs4m8"
Jul 27 21:34:10.818788 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.818421    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 21:34:10.822675 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.822597    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbnz2\" (UniqueName: \"kubernetes.io/projected/89c1df03-b3d9-41fc-82aa-378536cd031f-kube-api-access-hbnz2\") pod \"aws-ebs-csi-driver-node-x96jp\" (UID: \"89c1df03-b3d9-41fc-82aa-378536cd031f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:10.822675 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.822618    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vwmp\" (UniqueName: \"kubernetes.io/projected/75a6e8d7-371c-49b8-89c0-053c92104d83-kube-api-access-4vwmp\") pod \"multus-additional-cni-plugins-svh5z\" (UID: \"75a6e8d7-371c-49b8-89c0-053c92104d83\") " pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:10.824835 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.824808    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5bln\" (UniqueName: \"kubernetes.io/projected/b496aba9-3601-4e2c-9bb8-0c772ffa9555-kube-api-access-w5bln\") pod \"iptables-alerter-hgspq\" (UID: \"b496aba9-3601-4e2c-9bb8-0c772ffa9555\") " pod="openshift-network-operator/iptables-alerter-hgspq"
Jul 27 21:34:10.861864 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.861833    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 21:34:10.908156 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908117    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-run\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.908359 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908167    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-cni-dir\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.908359 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908195    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-run-systemd\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908359 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908220    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-cni-bin\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908359 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908245    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d9mf\" (UniqueName: \"kubernetes.io/projected/3ebb85ba-6b73-4414-b816-97de13ceb9ed-kube-api-access-7d9mf\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.908359 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908272    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7jg\" (UniqueName: \"kubernetes.io/projected/8a320449-3323-4c81-9d13-07329a8d3586-kube-api-access-tc7jg\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:10.908359 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908299    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-daemon-config\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.908359 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908310    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-run-systemd\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908359 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908321    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-node-log\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908359 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908342    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908359 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908360    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0da1b92e-c511-430f-84ba-ebcedfbfb04a-ovnkube-script-lib\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908381    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ebb85ba-6b73-4414-b816-97de13ceb9ed-tmp\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908393    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-cni-dir\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908401    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-run-k8s-cni-cncf-io\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908419    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-run-openvswitch\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908434    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-run-ovn\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908450    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0da1b92e-c511-430f-84ba-ebcedfbfb04a-env-overrides\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908500    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx8xz\" (UniqueName: \"kubernetes.io/projected/82beb1c9-1fa4-4623-8bf6-82c83aa68ae7-kube-api-access-sx8xz\") pod \"node-resolver-p6h5c\" (UID: \"82beb1c9-1fa4-4623-8bf6-82c83aa68ae7\") " pod="openshift-dns/node-resolver-p6h5c"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908521    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-host\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908539    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-etc-openvswitch\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908569    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xmvb\" (UniqueName: \"kubernetes.io/projected/0da1b92e-c511-430f-84ba-ebcedfbfb04a-kube-api-access-4xmvb\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908586    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82beb1c9-1fa4-4623-8bf6-82c83aa68ae7-tmp-dir\") pod \"node-resolver-p6h5c\" (UID: \"82beb1c9-1fa4-4623-8bf6-82c83aa68ae7\") " pod="openshift-dns/node-resolver-p6h5c"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908601    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-cnibin\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908619    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-kubelet\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908637    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2be4f951-d474-4b2e-9104-73913eefa705-serviceca\") pod \"node-ca-hdv2z\" (UID: \"2be4f951-d474-4b2e-9104-73913eefa705\") " pod="openshift-image-registry/node-ca-hdv2z"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908660    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-kubernetes\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908676    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-os-release\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908693    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vwv4\" (UniqueName: \"kubernetes.io/projected/06b7655b-5dc5-484f-9036-57f62f3f9158-kube-api-access-2vwv4\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.908976 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908709    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-tuned\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908726    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-run-netns\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908755    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0da1b92e-c511-430f-84ba-ebcedfbfb04a-ovn-node-metrics-cert\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908777    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4xl9\" (UniqueName: \"kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9\") pod \"network-check-target-zrv6d\" (UID: \"8f0ba091-3816-4ddb-a041-ca3a9bb66630\") " pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908792    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfb4m\" (UniqueName: \"kubernetes.io/projected/2be4f951-d474-4b2e-9104-73913eefa705-kube-api-access-wfb4m\") pod \"node-ca-hdv2z\" (UID: \"2be4f951-d474-4b2e-9104-73913eefa705\") " pod="openshift-image-registry/node-ca-hdv2z"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908814    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-sysctl-conf\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908842    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-systemd\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908866    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-var-lib-openvswitch\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908885    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2be4f951-d474-4b2e-9104-73913eefa705-host\") pod \"node-ca-hdv2z\" (UID: \"2be4f951-d474-4b2e-9104-73913eefa705\") " pod="openshift-image-registry/node-ca-hdv2z"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908911    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-lib-modules\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908931    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef06485f-d142-47b9-ae20-82afdd303030-konnectivity-ca\") pod \"konnectivity-agent-lmksj\" (UID: \"ef06485f-d142-47b9-ae20-82afdd303030\") " pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908948    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06b7655b-5dc5-484f-9036-57f62f3f9158-cni-binary-copy\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908971    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-conf-dir\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909000    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-run-multus-certs\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909026    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-daemon-config\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909029    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909058    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-var-lib-cni-multus\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909086    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-cni-bin\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.909881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909084    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-hostroot\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909132    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0da1b92e-c511-430f-84ba-ebcedfbfb04a-ovnkube-config\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909164    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-etc-kubernetes\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909194    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-cni-netd\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909221    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-modprobe-d\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909247    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-sysctl-d\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909274    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-sys\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909299    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-socket-dir-parent\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909325    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-var-lib-cni-bin\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909353    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-slash\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909380    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-sysconfig\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909407    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-var-lib-kubelet\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909434    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-system-cni-dir\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909467    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909495    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef06485f-d142-47b9-ae20-82afdd303030-agent-certs\") pod \"konnectivity-agent-lmksj\" (UID: \"ef06485f-d142-47b9-ae20-82afdd303030\") " pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909538    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-run-netns\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.908267    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-run\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909565    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/82beb1c9-1fa4-4623-8bf6-82c83aa68ae7-hosts-file\") pod \"node-resolver-p6h5c\" (UID: \"82beb1c9-1fa4-4623-8bf6-82c83aa68ae7\") " pod="openshift-dns/node-resolver-p6h5c"
Jul 27 21:34:10.910790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909610    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-systemd-units\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909631    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-log-socket\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909648    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-var-lib-kubelet\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909722    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-var-lib-kubelet\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909755    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-node-log\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.909785    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.910276    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0da1b92e-c511-430f-84ba-ebcedfbfb04a-ovnkube-script-lib\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.911544    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-lib-modules\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.911818    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-host\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.911906    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-run-k8s-cni-cncf-io\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.911993    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-run-openvswitch\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.912049    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-run-ovn\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.912047    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2be4f951-d474-4b2e-9104-73913eefa705-serviceca\") pod \"node-ca-hdv2z\" (UID: \"2be4f951-d474-4b2e-9104-73913eefa705\") " pod="openshift-image-registry/node-ca-hdv2z"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.912154    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-cnibin\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.912221    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-etc-openvswitch\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.912553    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82beb1c9-1fa4-4623-8bf6-82c83aa68ae7-tmp-dir\") pod \"node-resolver-p6h5c\" (UID: \"82beb1c9-1fa4-4623-8bf6-82c83aa68ae7\") " pod="openshift-dns/node-resolver-p6h5c"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.912719    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-sys\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.912909    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-kubelet\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.917847 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.913411    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0da1b92e-c511-430f-84ba-ebcedfbfb04a-env-overrides\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.913614    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-hostroot\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.913605    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ebb85ba-6b73-4414-b816-97de13ceb9ed-tmp\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.913808    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-system-cni-dir\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.913891    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-socket-dir-parent\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.913949    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-var-lib-cni-bin\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.914002    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-slash\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.914074    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-sysconfig\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.914138    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-var-lib-kubelet\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.914201    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06b7655b-5dc5-484f-9036-57f62f3f9158-cni-binary-copy\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.914332    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-var-lib-openvswitch\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.914357    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-systemd\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.914370    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-run-multus-certs\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.914435    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2be4f951-d474-4b2e-9104-73913eefa705-host\") pod \"node-ca-hdv2z\" (UID: \"2be4f951-d474-4b2e-9104-73913eefa705\") " pod="openshift-image-registry/node-ca-hdv2z"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.914481    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-multus-conf-dir\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.914544    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-run-netns\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.914623    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.914723    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs podName:8a320449-3323-4c81-9d13-07329a8d3586 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:11.414690109 +0000 UTC m=+3.132096574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs") pod "network-metrics-daemon-kqgdb" (UID: "8a320449-3323-4c81-9d13-07329a8d3586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:10.918850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.915743    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-cni-netd\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.915800    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.915847    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-systemd-units\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.915890    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-var-lib-cni-multus\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.916018    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-sysctl-d\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.916085    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/82beb1c9-1fa4-4623-8bf6-82c83aa68ae7-hosts-file\") pod \"node-resolver-p6h5c\" (UID: \"82beb1c9-1fa4-4623-8bf6-82c83aa68ae7\") " pod="openshift-dns/node-resolver-p6h5c"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.916181    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-modprobe-d\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.916214    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-host-run-netns\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.916245    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-sysctl-conf\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.916636    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef06485f-d142-47b9-ae20-82afdd303030-konnectivity-ca\") pod \"konnectivity-agent-lmksj\" (UID: \"ef06485f-d142-47b9-ae20-82afdd303030\") " pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.916919    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-kubernetes\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.916997    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-os-release\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.917130    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06b7655b-5dc5-484f-9036-57f62f3f9158-etc-kubernetes\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.914500    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0da1b92e-c511-430f-84ba-ebcedfbfb04a-log-socket\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.917995    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0da1b92e-c511-430f-84ba-ebcedfbfb04a-ovnkube-config\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.919807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.918185    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef06485f-d142-47b9-ae20-82afdd303030-agent-certs\") pod \"konnectivity-agent-lmksj\" (UID: \"ef06485f-d142-47b9-ae20-82afdd303030\") " pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:10.920398 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.919874    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0da1b92e-c511-430f-84ba-ebcedfbfb04a-ovn-node-metrics-cert\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.920398 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.919952    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ebb85ba-6b73-4414-b816-97de13ceb9ed-etc-tuned\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.921203 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.920959    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d9mf\" (UniqueName: \"kubernetes.io/projected/3ebb85ba-6b73-4414-b816-97de13ceb9ed-kube-api-access-7d9mf\") pod \"tuned-m4pvd\" (UID: \"3ebb85ba-6b73-4414-b816-97de13ceb9ed\") " pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:10.923951 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.923918    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx8xz\" (UniqueName: \"kubernetes.io/projected/82beb1c9-1fa4-4623-8bf6-82c83aa68ae7-kube-api-access-sx8xz\") pod \"node-resolver-p6h5c\" (UID: \"82beb1c9-1fa4-4623-8bf6-82c83aa68ae7\") " pod="openshift-dns/node-resolver-p6h5c"
Jul 27 21:34:10.925362 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.925339    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:34:10.925535 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.925369    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:34:10.925535 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.925383    2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4xl9 for pod openshift-network-diagnostics/network-check-target-zrv6d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:10.925535 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:10.925526    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9 podName:8f0ba091-3816-4ddb-a041-ca3a9bb66630 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:11.425505049 +0000 UTC m=+3.142911526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n4xl9" (UniqueName: "kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9") pod "network-check-target-zrv6d" (UID: "8f0ba091-3816-4ddb-a041-ca3a9bb66630") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:10.925819 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.925777    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc7jg\" (UniqueName: \"kubernetes.io/projected/8a320449-3323-4c81-9d13-07329a8d3586-kube-api-access-tc7jg\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:10.928014 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.927991    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xmvb\" (UniqueName: \"kubernetes.io/projected/0da1b92e-c511-430f-84ba-ebcedfbfb04a-kube-api-access-4xmvb\") pod \"ovnkube-node-q96gh\" (UID: \"0da1b92e-c511-430f-84ba-ebcedfbfb04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:10.928948 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.928902    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal" event={"ID":"6ddc907e67befd9458898c9ff1c8e0e9","Type":"ContainerStarted","Data":"50f1df610f3165bf1b8b6b39ab123118f6ab2bb7b2b6b97aa0f88a91b57b5f41"}
Jul 27 21:34:10.930370 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.929673    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfb4m\" (UniqueName: \"kubernetes.io/projected/2be4f951-d474-4b2e-9104-73913eefa705-kube-api-access-wfb4m\") pod \"node-ca-hdv2z\" (UID: \"2be4f951-d474-4b2e-9104-73913eefa705\") " pod="openshift-image-registry/node-ca-hdv2z"
Jul 27 21:34:10.931199 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.931172    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vwv4\" (UniqueName: \"kubernetes.io/projected/06b7655b-5dc5-484f-9036-57f62f3f9158-kube-api-access-2vwv4\") pod \"multus-658jk\" (UID: \"06b7655b-5dc5-484f-9036-57f62f3f9158\") " pod="openshift-multus/multus-658jk"
Jul 27 21:34:10.931305 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:10.931175    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-223.ec2.internal" event={"ID":"aa758d18188c78caf39faf92485f4815","Type":"ContainerStarted","Data":"d3d832f2921de83823ccb13f8b29cd2a47414400a41a7460dc9e42330baf1489"}
Jul 27 21:34:11.002103 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.002067    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgspq"
Jul 27 21:34:11.010281 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.010202    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp"
Jul 27 21:34:11.021659 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:11.021620    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c1df03_b3d9_41fc_82aa_378536cd031f.slice/crio-b1ec48b62bf4d6e78655c915ddd5deccaf7fd34f5ad6368b38c92062fdef5099 WatchSource:0}: Error finding container b1ec48b62bf4d6e78655c915ddd5deccaf7fd34f5ad6368b38c92062fdef5099: Status 404 returned error can't find the container with id b1ec48b62bf4d6e78655c915ddd5deccaf7fd34f5ad6368b38c92062fdef5099
Jul 27 21:34:11.022687 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.022668    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-svh5z"
Jul 27 21:34:11.034516 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.034488    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hdv2z"
Jul 27 21:34:11.035959 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:11.035926    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a6e8d7_371c_49b8_89c0_053c92104d83.slice/crio-343fb8a86eae887a4b656b7797008e86233a0ed4a888bfc0b467ca2a5c49fcf6 WatchSource:0}: Error finding container 343fb8a86eae887a4b656b7797008e86233a0ed4a888bfc0b467ca2a5c49fcf6: Status 404 returned error can't find the container with id 343fb8a86eae887a4b656b7797008e86233a0ed4a888bfc0b467ca2a5c49fcf6
Jul 27 21:34:11.044304 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.044091    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:11.053576 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.053325    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6h5c"
Jul 27 21:34:11.056268 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:11.056219    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef06485f_d142_47b9_ae20_82afdd303030.slice/crio-2de40680dcf0812e451ba0be73cf1e75f60688427ea4520480ed11c1cb448f53 WatchSource:0}: Error finding container 2de40680dcf0812e451ba0be73cf1e75f60688427ea4520480ed11c1cb448f53: Status 404 returned error can't find the container with id 2de40680dcf0812e451ba0be73cf1e75f60688427ea4520480ed11c1cb448f53
Jul 27 21:34:11.062798 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.062770    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-658jk"
Jul 27 21:34:11.068806 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:11.066779    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82beb1c9_1fa4_4623_8bf6_82c83aa68ae7.slice/crio-6095c0ef4291c53c53ac6c973f4ebd3c014b28ef896793d826e03ba38f3fe3f1 WatchSource:0}: Error finding container 6095c0ef4291c53c53ac6c973f4ebd3c014b28ef896793d826e03ba38f3fe3f1: Status 404 returned error can't find the container with id 6095c0ef4291c53c53ac6c973f4ebd3c014b28ef896793d826e03ba38f3fe3f1
Jul 27 21:34:11.069832 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.069805    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4pvd"
Jul 27 21:34:11.076754 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.076710    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:11.087857 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:11.087821    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebb85ba_6b73_4414_b816_97de13ceb9ed.slice/crio-df0d3783fd6dca24cfd3f1639582ef9eac418915e1327c431f6654eb0ab62b4a WatchSource:0}: Error finding container df0d3783fd6dca24cfd3f1639582ef9eac418915e1327c431f6654eb0ab62b4a: Status 404 returned error can't find the container with id df0d3783fd6dca24cfd3f1639582ef9eac418915e1327c431f6654eb0ab62b4a
Jul 27 21:34:11.094755 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:34:11.094725    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da1b92e_c511_430f_84ba_ebcedfbfb04a.slice/crio-db984b7e2666db5d2d7eb34a9d55bbf6b127b8a0800e557f584fd0d4086c6a28 WatchSource:0}: Error finding container db984b7e2666db5d2d7eb34a9d55bbf6b127b8a0800e557f584fd0d4086c6a28: Status 404 returned error can't find the container with id db984b7e2666db5d2d7eb34a9d55bbf6b127b8a0800e557f584fd0d4086c6a28
Jul 27 21:34:11.313079 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.312974    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:11.313247 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:11.313139    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:11.313247 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:11.313225    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret podName:20a71333-87bf-440c-bec0-ad436ffe66f3 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:12.313202382 +0000 UTC m=+4.030608864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret") pod "global-pull-secret-syncer-rzszd" (UID: "20a71333-87bf-440c-bec0-ad436ffe66f3") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:11.514411 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.514360    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4xl9\" (UniqueName: \"kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9\") pod \"network-check-target-zrv6d\" (UID: \"8f0ba091-3816-4ddb-a041-ca3a9bb66630\") " pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:11.514625 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.514423    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:11.514625 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:11.514560    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:34:11.514625 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:11.514583    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:34:11.514625 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:11.514594    2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4xl9 for pod openshift-network-diagnostics/network-check-target-zrv6d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:11.514625 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:11.514604    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:11.514844 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:11.514655    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9 podName:8f0ba091-3816-4ddb-a041-ca3a9bb66630 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:12.514638799 +0000 UTC m=+4.232045279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4xl9" (UniqueName: "kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9") pod "network-check-target-zrv6d" (UID: "8f0ba091-3816-4ddb-a041-ca3a9bb66630") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:11.514844 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:11.514682    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs podName:8a320449-3323-4c81-9d13-07329a8d3586 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:12.514663104 +0000 UTC m=+4.232069565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs") pod "network-metrics-daemon-kqgdb" (UID: "8a320449-3323-4c81-9d13-07329a8d3586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:11.813364 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.813325    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 21:29:11 +0000 UTC" deadline="2027-12-30 13:45:14.626390843 +0000 UTC"
Jul 27 21:34:11.814198 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.813369    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12496h11m2.81302759s"
Jul 27 21:34:11.936490 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.936395    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6h5c" event={"ID":"82beb1c9-1fa4-4623-8bf6-82c83aa68ae7","Type":"ContainerStarted","Data":"6095c0ef4291c53c53ac6c973f4ebd3c014b28ef896793d826e03ba38f3fe3f1"}
Jul 27 21:34:11.938667 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.938621    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lmksj" event={"ID":"ef06485f-d142-47b9-ae20-82afdd303030","Type":"ContainerStarted","Data":"2de40680dcf0812e451ba0be73cf1e75f60688427ea4520480ed11c1cb448f53"}
Jul 27 21:34:11.940555 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.940476    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hdv2z" event={"ID":"2be4f951-d474-4b2e-9104-73913eefa705","Type":"ContainerStarted","Data":"36958d1686db08e7213b1da654495446cbf5660b858c9ae2ee86800effb63d1e"}
Jul 27 21:34:11.942172 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.942090    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp" event={"ID":"89c1df03-b3d9-41fc-82aa-378536cd031f","Type":"ContainerStarted","Data":"b1ec48b62bf4d6e78655c915ddd5deccaf7fd34f5ad6368b38c92062fdef5099"}
Jul 27 21:34:11.945246 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.945061    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh" event={"ID":"0da1b92e-c511-430f-84ba-ebcedfbfb04a","Type":"ContainerStarted","Data":"db984b7e2666db5d2d7eb34a9d55bbf6b127b8a0800e557f584fd0d4086c6a28"}
Jul 27 21:34:11.947163 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.947078    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4pvd" event={"ID":"3ebb85ba-6b73-4414-b816-97de13ceb9ed","Type":"ContainerStarted","Data":"df0d3783fd6dca24cfd3f1639582ef9eac418915e1327c431f6654eb0ab62b4a"}
Jul 27 21:34:11.948885 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.948810    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-658jk" event={"ID":"06b7655b-5dc5-484f-9036-57f62f3f9158","Type":"ContainerStarted","Data":"764468d857de23336eef2a821cc45d00ef6f4a3867c09d1e7bd0f1f3264885b0"}
Jul 27 21:34:11.951665 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.951580    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svh5z" event={"ID":"75a6e8d7-371c-49b8-89c0-053c92104d83","Type":"ContainerStarted","Data":"343fb8a86eae887a4b656b7797008e86233a0ed4a888bfc0b467ca2a5c49fcf6"}
Jul 27 21:34:11.953274 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:11.953242    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgspq" event={"ID":"b496aba9-3601-4e2c-9bb8-0c772ffa9555","Type":"ContainerStarted","Data":"714116e34c0151ca5cdbd2a7374246d2b8d5ce3d7afc390fdf2fa1b3df2e2dfd"}
Jul 27 21:34:12.321276 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:12.321234    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:12.321496 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:12.321437    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:12.321610 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:12.321528    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret podName:20a71333-87bf-440c-bec0-ad436ffe66f3 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:14.321507275 +0000 UTC m=+6.038913752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret") pod "global-pull-secret-syncer-rzszd" (UID: "20a71333-87bf-440c-bec0-ad436ffe66f3") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:12.523897 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:12.523854    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4xl9\" (UniqueName: \"kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9\") pod \"network-check-target-zrv6d\" (UID: \"8f0ba091-3816-4ddb-a041-ca3a9bb66630\") " pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:12.524137 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:12.523939    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:12.524213 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:12.524149    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:12.524270 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:12.524231    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs podName:8a320449-3323-4c81-9d13-07329a8d3586 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:14.524201191 +0000 UTC m=+6.241607674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs") pod "network-metrics-daemon-kqgdb" (UID: "8a320449-3323-4c81-9d13-07329a8d3586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:12.524773 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:12.524751    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:34:12.524887 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:12.524779    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:34:12.524887 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:12.524795    2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4xl9 for pod openshift-network-diagnostics/network-check-target-zrv6d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:12.524887 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:12.524858    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9 podName:8f0ba091-3816-4ddb-a041-ca3a9bb66630 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:14.524840374 +0000 UTC m=+6.242246844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4xl9" (UniqueName: "kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9") pod "network-check-target-zrv6d" (UID: "8f0ba091-3816-4ddb-a041-ca3a9bb66630") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:12.814577 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:12.814405    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 21:29:11 +0000 UTC" deadline="2028-04-12 12:19:20.317062538 +0000 UTC"
Jul 27 21:34:12.814577 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:12.814461    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14990h45m7.502606776s"
Jul 27 21:34:12.924713 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:12.924654    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:12.924713 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:12.924675    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:12.924967 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:12.924661    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:12.924967 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:12.924837    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:12.925069 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:12.924986    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:12.926332 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:12.925183    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:14.341321 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:14.340752    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:14.341321 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:14.340912    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:14.341321 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:14.340973    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret podName:20a71333-87bf-440c-bec0-ad436ffe66f3 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:18.340953495 +0000 UTC m=+10.058359984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret") pod "global-pull-secret-syncer-rzszd" (UID: "20a71333-87bf-440c-bec0-ad436ffe66f3") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:14.542713 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:14.542668    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:14.542923 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:14.542769    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4xl9\" (UniqueName: \"kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9\") pod \"network-check-target-zrv6d\" (UID: \"8f0ba091-3816-4ddb-a041-ca3a9bb66630\") " pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:14.542996 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:14.542942    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:34:14.542996 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:14.542966    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:34:14.542996 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:14.542979    2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4xl9 for pod openshift-network-diagnostics/network-check-target-zrv6d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:14.543150 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:14.543042    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9 podName:8f0ba091-3816-4ddb-a041-ca3a9bb66630 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:18.543021807 +0000 UTC m=+10.260428276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4xl9" (UniqueName: "kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9") pod "network-check-target-zrv6d" (UID: "8f0ba091-3816-4ddb-a041-ca3a9bb66630") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:14.543531 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:14.543486    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:14.543614 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:14.543563    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs podName:8a320449-3323-4c81-9d13-07329a8d3586 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:18.543545731 +0000 UTC m=+10.260952200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs") pod "network-metrics-daemon-kqgdb" (UID: "8a320449-3323-4c81-9d13-07329a8d3586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:14.917461 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:14.916613    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:14.917461 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:14.916763    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:14.917461 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:14.917168    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:14.917461 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:14.917273    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:14.917461 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:14.917333    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:14.917461 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:14.917421    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:16.916681 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:16.916606    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:16.917102 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:16.916753    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:16.917102 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:16.916819    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:16.917102 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:16.916891    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:16.918150 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:16.916564    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:16.918256 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:16.918237    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:18.380775 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:18.380742    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:18.381235 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:18.380927    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:18.381235 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:18.381082    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret podName:20a71333-87bf-440c-bec0-ad436ffe66f3 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:26.381021797 +0000 UTC m=+18.098428277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret") pod "global-pull-secret-syncer-rzszd" (UID: "20a71333-87bf-440c-bec0-ad436ffe66f3") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:18.582731 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:18.582428    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4xl9\" (UniqueName: \"kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9\") pod \"network-check-target-zrv6d\" (UID: \"8f0ba091-3816-4ddb-a041-ca3a9bb66630\") " pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:18.582731 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:18.582498    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:18.582731 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:18.582620    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:18.582731 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:18.582630    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:34:18.582731 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:18.582647    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:34:18.582731 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:18.582660    2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4xl9 for pod openshift-network-diagnostics/network-check-target-zrv6d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:18.582731 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:18.582679    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs podName:8a320449-3323-4c81-9d13-07329a8d3586 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:26.582662172 +0000 UTC m=+18.300068646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs") pod "network-metrics-daemon-kqgdb" (UID: "8a320449-3323-4c81-9d13-07329a8d3586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:18.582731 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:18.582697    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9 podName:8f0ba091-3816-4ddb-a041-ca3a9bb66630 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:26.582686763 +0000 UTC m=+18.300093223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4xl9" (UniqueName: "kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9") pod "network-check-target-zrv6d" (UID: "8f0ba091-3816-4ddb-a041-ca3a9bb66630") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:18.915361 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:18.915324    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:18.915540 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:18.915415    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:18.915540 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:18.915473    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:18.915540 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:18.915491    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:18.915718 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:18.915551    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:18.915718 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:18.915651    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:20.916000 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:20.915244    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:20.916000 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:20.915391    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:20.916000 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:20.915747    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:20.916000 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:20.915848    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:20.916000 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:20.915894    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:20.916000 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:20.915962    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:22.914597 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:22.914511    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:22.915043 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:22.914511    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:22.915043 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:22.914648    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:22.915043 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:22.914682    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:22.915043 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:22.914777    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:22.915043 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:22.914858    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:24.915200 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:24.915163    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:24.915679 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:24.915162    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:24.915679 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:24.915297    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:24.915679 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:24.915163    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:24.915679 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:24.915387    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:24.915679 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:24.915482    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:26.443402 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:26.443362    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:26.443908 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:26.443505    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:26.443908 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:26.443576    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret podName:20a71333-87bf-440c-bec0-ad436ffe66f3 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:42.443557481 +0000 UTC m=+34.160963941 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret") pod "global-pull-secret-syncer-rzszd" (UID: "20a71333-87bf-440c-bec0-ad436ffe66f3") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:26.644367 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:26.644280    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4xl9\" (UniqueName: \"kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9\") pod \"network-check-target-zrv6d\" (UID: \"8f0ba091-3816-4ddb-a041-ca3a9bb66630\") " pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:26.644367 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:26.644342    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:26.644608 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:26.644476    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:26.644608 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:26.644517    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:34:26.644608 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:26.644537    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs podName:8a320449-3323-4c81-9d13-07329a8d3586 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:42.644520229 +0000 UTC m=+34.361926691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs") pod "network-metrics-daemon-kqgdb" (UID: "8a320449-3323-4c81-9d13-07329a8d3586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:26.644608 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:26.644544    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:34:26.644608 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:26.644557    2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4xl9 for pod openshift-network-diagnostics/network-check-target-zrv6d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:26.644781 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:26.644621    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9 podName:8f0ba091-3816-4ddb-a041-ca3a9bb66630 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:42.644604618 +0000 UTC m=+34.362011083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4xl9" (UniqueName: "kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9") pod "network-check-target-zrv6d" (UID: "8f0ba091-3816-4ddb-a041-ca3a9bb66630") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:26.916810 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:26.916726    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:26.916960 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:26.916863    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:26.916960 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:26.916945    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:26.917073 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:26.917019    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:26.917124 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:26.917072    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:26.917171 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:26.917140    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:28.915518 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:28.915474    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:28.915901 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:28.915580    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:28.915901 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:28.915872    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:28.915970 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:28.915939    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:28.916000 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:28.915973    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:28.916032 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:28.916018    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:30.916454 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:30.915488    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:30.916454 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:30.915863    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:30.916454 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:30.915524    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:30.916454 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:30.915961    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:30.916454 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:30.915497    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:30.916454 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:30.916056    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:30.999021 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:30.998959    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-223.ec2.internal" event={"ID":"aa758d18188c78caf39faf92485f4815","Type":"ContainerStarted","Data":"0c50b5c69f8f7f9a5bca0bb0e425557b5c1b57b4fcdff6382d352ac5dc363deb"}
Jul 27 21:34:31.009791 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:31.009755    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4pvd" event={"ID":"3ebb85ba-6b73-4414-b816-97de13ceb9ed","Type":"ContainerStarted","Data":"3f2b9097151b22d1dd09449531a914f2246ac90f280c916c1418647218c0f3f3"}
Jul 27 21:34:31.011620 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:31.011592    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-658jk" event={"ID":"06b7655b-5dc5-484f-9036-57f62f3f9158","Type":"ContainerStarted","Data":"7c8909c4a9271584edf32f394fea711d31f7cf805b8fb5fb58db3a80eb69d657"}
Jul 27 21:34:31.033720 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:31.033654    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-658jk" podStartSLOduration=2.454170201 podStartE2EDuration="22.03363675s" totalImagesPullingTime="19.579466549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:31.033085166 +0000 UTC m=+22.750491648" watchObservedRunningTime="2026-07-27 21:34:31.03363675 +0000 UTC m=+22.751043223"
Jul 27 21:34:31.033954 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:31.033930    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-223.ec2.internal" podStartSLOduration=21.033925416 podStartE2EDuration="21.033925416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:31.014745398 +0000 UTC m=+22.732151880" watchObservedRunningTime="2026-07-27 21:34:31.033925416 +0000 UTC m=+22.751331899"
Jul 27 21:34:31.049695 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:31.049650    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m4pvd" podStartSLOduration=2.496893619 podStartE2EDuration="22.049634342s" totalImagesPullingTime="19.552740723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:31.048770374 +0000 UTC m=+22.766176868" watchObservedRunningTime="2026-07-27 21:34:31.049634342 +0000 UTC m=+22.767040893"
Jul 27 21:34:32.015823 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.015355    2554 generic.go:356] "Generic (PLEG): container finished" podID="6ddc907e67befd9458898c9ff1c8e0e9" containerID="041c147ab58f8e60ffe3b216ce032967f8d558fde945dbb24e6f61d823b1623d" exitCode=0
Jul 27 21:34:32.016787 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.015452    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal" event={"ID":"6ddc907e67befd9458898c9ff1c8e0e9","Type":"ContainerDied","Data":"041c147ab58f8e60ffe3b216ce032967f8d558fde945dbb24e6f61d823b1623d"}
Jul 27 21:34:32.017539 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.017508    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6h5c" event={"ID":"82beb1c9-1fa4-4623-8bf6-82c83aa68ae7","Type":"ContainerStarted","Data":"51a65cf1284eb20b03ae9cd93aad1c64733a5efc9f6af2375066b563953a4218"}
Jul 27 21:34:32.018900 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.018853    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lmksj" event={"ID":"ef06485f-d142-47b9-ae20-82afdd303030","Type":"ContainerStarted","Data":"b1e4150ee432fac3f4b64d0de7de1b790ae30c24617f6fee35e3d19f2d04a6c7"}
Jul 27 21:34:32.020310 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.020284    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hdv2z" event={"ID":"2be4f951-d474-4b2e-9104-73913eefa705","Type":"ContainerStarted","Data":"51ae37d7eeafe2bdac0fc7d1eb481c02f9810dbebc5fe1f93c2e8cb2689e4a98"}
Jul 27 21:34:32.021742 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.021721    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp" event={"ID":"89c1df03-b3d9-41fc-82aa-378536cd031f","Type":"ContainerStarted","Data":"fc125fdc7b3655c4ff6d7717b3d388ae8d1d949641de68dfdcfb04fafbd26c17"}
Jul 27 21:34:32.024293 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.024276    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:34:32.024595 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.024572    2554 generic.go:356] "Generic (PLEG): container finished" podID="0da1b92e-c511-430f-84ba-ebcedfbfb04a" containerID="b7c51e52a0cb62240eb362f2fd8c9c8787dfecb3a9670c7100f414d2a5f320eb" exitCode=1
Jul 27 21:34:32.024705 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.024607    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh" event={"ID":"0da1b92e-c511-430f-84ba-ebcedfbfb04a","Type":"ContainerStarted","Data":"5f2cbd9924e71966b9b630ce35ab7e295ff507614c97f09fffa723fc808eba7c"}
Jul 27 21:34:32.024772 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.024692    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh" event={"ID":"0da1b92e-c511-430f-84ba-ebcedfbfb04a","Type":"ContainerStarted","Data":"edce529d4bbf5aa5d1ec7dbb42d08a475e16aefce906eacafc36623b8432a73e"}
Jul 27 21:34:32.024772 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.024759    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh" event={"ID":"0da1b92e-c511-430f-84ba-ebcedfbfb04a","Type":"ContainerStarted","Data":"13d7b9135bfd29e7aa025d4c9192ab35591f9e5298db1c567b171582f9ec4545"}
Jul 27 21:34:32.024873 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.024807    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh" event={"ID":"0da1b92e-c511-430f-84ba-ebcedfbfb04a","Type":"ContainerStarted","Data":"35a6da4c778d39281e744eec4821f2d9426a428f7b5a728d4297b26ca1b5bea8"}
Jul 27 21:34:32.024873 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.024855    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh" event={"ID":"0da1b92e-c511-430f-84ba-ebcedfbfb04a","Type":"ContainerDied","Data":"b7c51e52a0cb62240eb362f2fd8c9c8787dfecb3a9670c7100f414d2a5f320eb"}
Jul 27 21:34:32.024966 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.024904    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh" event={"ID":"0da1b92e-c511-430f-84ba-ebcedfbfb04a","Type":"ContainerStarted","Data":"ce2d1f2ec94106c09b3ff03bacb3513f3b3cef2e54a9318c0f784f91ca3a3403"}
Jul 27 21:34:32.026080 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.026060    2554 generic.go:356] "Generic (PLEG): container finished" podID="75a6e8d7-371c-49b8-89c0-053c92104d83" containerID="ae55f0100618a819cb4bb996bae0d6c93e4e56ecd3660a82bd1633ae438194ed" exitCode=0
Jul 27 21:34:32.026170 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.026103    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svh5z" event={"ID":"75a6e8d7-371c-49b8-89c0-053c92104d83","Type":"ContainerDied","Data":"ae55f0100618a819cb4bb996bae0d6c93e4e56ecd3660a82bd1633ae438194ed"}
Jul 27 21:34:32.085527 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.085428    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p6h5c" podStartSLOduration=3.53019026 podStartE2EDuration="23.085413537s" totalImagesPullingTime="19.555223277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:32.084797781 +0000 UTC m=+23.802204263" watchObservedRunningTime="2026-07-27 21:34:32.085413537 +0000 UTC m=+23.802820018"
Jul 27 21:34:32.104594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.104551    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hdv2z" podStartSLOduration=3.528419044 podStartE2EDuration="23.104535477s" totalImagesPullingTime="19.576116433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:32.104244603 +0000 UTC m=+23.821651084" watchObservedRunningTime="2026-07-27 21:34:32.104535477 +0000 UTC m=+23.821941958"
Jul 27 21:34:32.914758 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.914718    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:32.915055 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.914718    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:32.915055 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:32.914853    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:32.915055 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:32.914974    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:32.915055 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:32.914715    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:32.915257 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:32.915081    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:33.030260 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:33.030224    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgspq" event={"ID":"b496aba9-3601-4e2c-9bb8-0c772ffa9555","Type":"ContainerStarted","Data":"902d01ad70d2fb4303c4b01e84eb638172fabe3693a7561ddda655e03766c031"}
Jul 27 21:34:33.033850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:33.033817    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal" event={"ID":"6ddc907e67befd9458898c9ff1c8e0e9","Type":"ContainerStarted","Data":"1acf9cf965d644743a23d023132f5965757265eee01adfe81e128ae4fd83101b"}
Jul 27 21:34:33.048674 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:33.048619    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lmksj" podStartSLOduration=4.485864207 podStartE2EDuration="24.048603381s" totalImagesPullingTime="19.562739174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:32.120930365 +0000 UTC m=+23.838336839" watchObservedRunningTime="2026-07-27 21:34:33.048603381 +0000 UTC m=+24.766009864"
Jul 27 21:34:33.067195 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:33.067152    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hgspq" podStartSLOduration=4.439364035 podStartE2EDuration="24.067134146s" totalImagesPullingTime="19.627770111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:33.049222346 +0000 UTC m=+24.766628828" watchObservedRunningTime="2026-07-27 21:34:33.067134146 +0000 UTC m=+24.784540630"
Jul 27 21:34:33.067581 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:33.067546    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-223.ec2.internal" podStartSLOduration=23.067537529 podStartE2EDuration="23.067537529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:33.067023156 +0000 UTC m=+24.784429641" watchObservedRunningTime="2026-07-27 21:34:33.067537529 +0000 UTC m=+24.784944012"
Jul 27 21:34:33.136811 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:33.136782    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 21:34:33.448969 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:33.448932    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:33.449507 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:33.449490    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:33.767890 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:33.767790    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T21:34:33.13680578Z","UUID":"5fdfbfd0-6171-4fa6-a3a5-065d23b30be1","Handler":null,"Name":"","Endpoint":""}
Jul 27 21:34:33.769615 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:33.769587    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 21:34:33.769771 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:33.769639    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 21:34:34.041360 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:34.041210    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:34:34.041902 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:34.041637    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh" event={"ID":"0da1b92e-c511-430f-84ba-ebcedfbfb04a","Type":"ContainerStarted","Data":"a4b03681a15a724f7cbb9a2d37bcd3b06b2a440bb03ccca63531380a766513dd"}
Jul 27 21:34:34.044143 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:34.044086    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp" event={"ID":"89c1df03-b3d9-41fc-82aa-378536cd031f","Type":"ContainerStarted","Data":"2d0d6a1d2a94a0033e3728d35df837134b52e3e6d0c0ec944822e9f4e2f9fc7e"}
Jul 27 21:34:34.044965 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:34.044902    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:34.045559 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:34.045539    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lmksj"
Jul 27 21:34:34.915148 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:34.915039    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:34.915314 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:34.915181    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:34.915314 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:34.915054    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:34.915314 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:34.915289    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:34.915314 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:34.915039    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:34.915563 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:34.915362    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:35.049810 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:35.049771    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp" event={"ID":"89c1df03-b3d9-41fc-82aa-378536cd031f","Type":"ContainerStarted","Data":"1a5e3219fa9aefeb2a61b444e408e5068d2f20e2b266e1f6bb767fea983eedec"}
Jul 27 21:34:35.070151 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:35.070092    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x96jp" podStartSLOduration=3.393955598 podStartE2EDuration="26.070071304s" totalImagesPullingTime="22.676115706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:35.069485119 +0000 UTC m=+26.786891602" watchObservedRunningTime="2026-07-27 21:34:35.070071304 +0000 UTC m=+26.787477787"
Jul 27 21:34:36.915337 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:36.915145    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:36.916304 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:36.915154    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:36.916304 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:36.915408    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:36.916304 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:36.915513    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:36.916304 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:36.915199    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:36.916304 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:36.915582    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:37.058002 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:37.057930    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:34:37.058351 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:37.058325    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh" event={"ID":"0da1b92e-c511-430f-84ba-ebcedfbfb04a","Type":"ContainerStarted","Data":"41d3fce2d8c7d12b5a04a2f45f3f8cbc8552f87227f04ca42fbaf7cf47823e43"}
Jul 27 21:34:37.058641 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:37.058606    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:37.058791 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:37.058679    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:37.058858 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:37.058804    2554 scope.go:117] "RemoveContainer" containerID="b7c51e52a0cb62240eb362f2fd8c9c8787dfecb3a9670c7100f414d2a5f320eb"
Jul 27 21:34:37.060234 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:37.060207    2554 generic.go:356] "Generic (PLEG): container finished" podID="75a6e8d7-371c-49b8-89c0-053c92104d83" containerID="aee8947ddb5c78ac62612b65b3abccde7656427c96e696cce0dd1789ffa3c3a5" exitCode=0
Jul 27 21:34:37.060324 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:37.060242    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svh5z" event={"ID":"75a6e8d7-371c-49b8-89c0-053c92104d83","Type":"ContainerDied","Data":"aee8947ddb5c78ac62612b65b3abccde7656427c96e696cce0dd1789ffa3c3a5"}
Jul 27 21:34:37.077200 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:37.077178    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:37.309693 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:37.309463    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6h5c_82beb1c9-1fa4-4623-8bf6-82c83aa68ae7/dns-node-resolver/0.log"
Jul 27 21:34:38.067087 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.067065    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:34:38.067417 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.067398    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh" event={"ID":"0da1b92e-c511-430f-84ba-ebcedfbfb04a","Type":"ContainerStarted","Data":"50327b3c9941467f0f3cad29e68d8476e269bb1b7cd9c5e1e1178616fd5ba6b2"}
Jul 27 21:34:38.067941 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.067705    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:38.087465 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.087426    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:34:38.103237 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.103190    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh" podStartSLOduration=9.201506852 podStartE2EDuration="29.103173588s" totalImagesPullingTime="19.901666736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:38.102668416 +0000 UTC m=+29.820074900" watchObservedRunningTime="2026-07-27 21:34:38.103173588 +0000 UTC m=+29.820580069"
Jul 27 21:34:38.481606 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.481577    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hdv2z_2be4f951-d474-4b2e-9104-73913eefa705/node-ca/0.log"
Jul 27 21:34:38.787958 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.787882    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rzszd"]
Jul 27 21:34:38.788113 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.788038    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:38.788202 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:38.788176    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:38.794992 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.794968    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zrv6d"]
Jul 27 21:34:38.795145 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.795065    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:38.795184 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:38.795147    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:38.808240 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.808211    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kqgdb"]
Jul 27 21:34:38.808409 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:38.808393    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:38.808553 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:38.808534    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:39.071655 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:39.071567    2554 generic.go:356] "Generic (PLEG): container finished" podID="75a6e8d7-371c-49b8-89c0-053c92104d83" containerID="ae98d9d38240c821c477258ab24f79e100337de8c80c847659c19ecafa364846" exitCode=0
Jul 27 21:34:39.072028 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:39.071662    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svh5z" event={"ID":"75a6e8d7-371c-49b8-89c0-053c92104d83","Type":"ContainerDied","Data":"ae98d9d38240c821c477258ab24f79e100337de8c80c847659c19ecafa364846"}
Jul 27 21:34:40.915090 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:40.915057    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:40.915531 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:40.915067    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:40.915531 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:40.915201    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:40.915531 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:40.915243    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:40.915531 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:40.915348    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:40.915531 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:40.915450    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:41.078251 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:41.078215    2554 generic.go:356] "Generic (PLEG): container finished" podID="75a6e8d7-371c-49b8-89c0-053c92104d83" containerID="802fd3dbd3cfd7212839565a546ee35f203de4ab151c20b0fb95221d03437815" exitCode=0
Jul 27 21:34:41.078482 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:41.078299    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svh5z" event={"ID":"75a6e8d7-371c-49b8-89c0-053c92104d83","Type":"ContainerDied","Data":"802fd3dbd3cfd7212839565a546ee35f203de4ab151c20b0fb95221d03437815"}
Jul 27 21:34:42.462041 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:42.462000    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:42.462540 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:42.462194    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:42.462540 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:42.462280    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret podName:20a71333-87bf-440c-bec0-ad436ffe66f3 nodeName:}" failed. No retries permitted until 2026-07-27 21:35:14.462258531 +0000 UTC m=+66.179665005 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret") pod "global-pull-secret-syncer-rzszd" (UID: "20a71333-87bf-440c-bec0-ad436ffe66f3") : object "kube-system"/"original-pull-secret" not registered
Jul 27 21:34:42.663162 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:42.663128    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4xl9\" (UniqueName: \"kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9\") pod \"network-check-target-zrv6d\" (UID: \"8f0ba091-3816-4ddb-a041-ca3a9bb66630\") " pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:42.663342 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:42.663192    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:42.663342 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:42.663271    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 21:34:42.663342 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:42.663292    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 21:34:42.663342 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:42.663305    2554 projected.go:196] Error preparing data for projected volume kube-api-access-n4xl9 for pod openshift-network-diagnostics/network-check-target-zrv6d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:42.663342 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:42.663309    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:42.663613 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:42.663369    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs podName:8a320449-3323-4c81-9d13-07329a8d3586 nodeName:}" failed. No retries permitted until 2026-07-27 21:35:14.66335032 +0000 UTC m=+66.380756794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs") pod "network-metrics-daemon-kqgdb" (UID: "8a320449-3323-4c81-9d13-07329a8d3586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 21:34:42.663613 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:42.663386    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9 podName:8f0ba091-3816-4ddb-a041-ca3a9bb66630 nodeName:}" failed. No retries permitted until 2026-07-27 21:35:14.663376926 +0000 UTC m=+66.380783389 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n4xl9" (UniqueName: "kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9") pod "network-check-target-zrv6d" (UID: "8f0ba091-3816-4ddb-a041-ca3a9bb66630") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 21:34:42.915168 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:42.915077    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:42.915168 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:42.915113    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:42.915381 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:42.915078    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:42.915381 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:42.915224    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:42.915381 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:42.915295    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:42.915381 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:42.915367    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:44.915074 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:44.914862    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:44.915563 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:44.914862    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:44.915563 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:44.915156    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:44.915563 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:44.914945    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:44.915563 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:44.915260    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:44.915563 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:44.915371    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:46.091571 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:46.091537    2554 generic.go:356] "Generic (PLEG): container finished" podID="75a6e8d7-371c-49b8-89c0-053c92104d83" containerID="0478a233d0fc1ee09687faf5f1bd26f9b639f9922cdd73d19bfdc1285b18526c" exitCode=0
Jul 27 21:34:46.091571 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:46.091574    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svh5z" event={"ID":"75a6e8d7-371c-49b8-89c0-053c92104d83","Type":"ContainerDied","Data":"0478a233d0fc1ee09687faf5f1bd26f9b639f9922cdd73d19bfdc1285b18526c"}
Jul 27 21:34:46.915112 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:46.915065    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:46.915312 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:46.915122    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:46.915312 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:46.915178    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:46.915312 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:46.915200    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:46.915312 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:46.915279    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:46.915528 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:46.915355    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:47.097770 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:47.097735    2554 generic.go:356] "Generic (PLEG): container finished" podID="75a6e8d7-371c-49b8-89c0-053c92104d83" containerID="df0f76b3d79349feacd420c1e5b0a8ab0f58edd27eb7decc81d88f601c7dc365" exitCode=0
Jul 27 21:34:47.098377 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:47.097790    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svh5z" event={"ID":"75a6e8d7-371c-49b8-89c0-053c92104d83","Type":"ContainerDied","Data":"df0f76b3d79349feacd420c1e5b0a8ab0f58edd27eb7decc81d88f601c7dc365"}
Jul 27 21:34:48.104042 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:48.104010    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-svh5z" event={"ID":"75a6e8d7-371c-49b8-89c0-053c92104d83","Type":"ContainerStarted","Data":"d546e5da24f165a6cf3d0192ba4410a2ff5a9b0744b80ea06a97ee7f60925fee"}
Jul 27 21:34:48.128220 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:48.128172    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-svh5z" podStartSLOduration=9.153055667 podStartE2EDuration="39.128156665s" totalImagesPullingTime="29.975100998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:48.12802398 +0000 UTC m=+39.845430461" watchObservedRunningTime="2026-07-27 21:34:48.128156665 +0000 UTC m=+39.845563146"
Jul 27 21:34:48.915397 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:48.915366    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:48.915582 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:48.915463    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:48.915582 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:48.915484    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:48.915686 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:48.915598    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:48.915686 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:48.915625    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:48.915686 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:48.915674    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:50.914708 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:50.914666    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:50.914708 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:50.914706    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:50.915281 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:50.914670    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:50.915281 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:50.914810    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:50.915281 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:50.914890    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:50.915281 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:50.915041    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:52.914668 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:52.914628    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:52.915090 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:52.914628    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:52.915090 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:52.914739    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:52.915090 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:52.914756    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:52.915090 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:52.914832    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:52.915090 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:52.914915    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:54.915455 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:54.915404    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:54.915901 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:54.915418    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:54.915901 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:54.915530    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:54.915901 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:54.915544    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:54.915901 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:54.915627    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:54.915901 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:54.915700    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:56.914470 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:56.914414    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:56.914470 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:56.914428    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:56.914993 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:56.914414    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:56.914993 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:56.914567    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:34:56.914993 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:56.914646    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:56.914993 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:56.914748    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:58.915664 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:58.915631    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:34:58.916071 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:58.915714    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:34:58.916071 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:58.915803    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:34:58.916071 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:58.915929    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:34:58.916071 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:34:58.915986    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:34:58.916071 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:34:58.916039    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:35:00.914800 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:00.914763    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:35:00.915248 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:00.914763    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:35:00.915248 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:00.914881    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:35:00.915248 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:00.914982    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:35:00.915248 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:00.914766    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:35:00.915248 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:00.915098    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:35:02.914643 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:02.914602    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:35:02.914643 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:02.914638    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:35:02.915070 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:02.914602    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:35:02.915070 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:02.914726    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzszd" podUID="20a71333-87bf-440c-bec0-ad436ffe66f3"
Jul 27 21:35:02.915070 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:02.914787    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqgdb" podUID="8a320449-3323-4c81-9d13-07329a8d3586"
Jul 27 21:35:02.915070 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:02.914892    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zrv6d" podUID="8f0ba091-3816-4ddb-a041-ca3a9bb66630"
Jul 27 21:35:03.570968 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.570943    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-223.ec2.internal" event="NodeReady"
Jul 27 21:35:03.571120 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.571067    2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 21:35:03.654333 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.654253    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z2cg5"]
Jul 27 21:35:03.656540 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.656521    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mlfv6"]
Jul 27 21:35:03.656648 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.656632    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.658370 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.658351    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mlfv6"
Jul 27 21:35:03.660000 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.659950    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 21:35:03.660123 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.660018    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 21:35:03.660180 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.660146    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kb678\""
Jul 27 21:35:03.661806 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.661792    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 21:35:03.662148 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.662128    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 21:35:03.662576 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.662558    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 21:35:03.666634 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.666617    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7fmv4\""
Jul 27 21:35:03.669362 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.669343    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mlfv6"]
Jul 27 21:35:03.675852 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.675832    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z2cg5"]
Jul 27 21:35:03.718250 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.718218    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-config-volume\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.718250 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.718255    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-metrics-tls\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.718478 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.718273    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-tmp-dir\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.718478 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.718375    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plmxj\" (UniqueName: \"kubernetes.io/projected/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-kube-api-access-plmxj\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.718478 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.718412    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z6vr\" (UniqueName: \"kubernetes.io/projected/33f83da1-b1ed-4e8e-9f43-439ea20b1f0a-kube-api-access-4z6vr\") pod \"ingress-canary-mlfv6\" (UID: \"33f83da1-b1ed-4e8e-9f43-439ea20b1f0a\") " pod="openshift-ingress-canary/ingress-canary-mlfv6"
Jul 27 21:35:03.718478 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.718471    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33f83da1-b1ed-4e8e-9f43-439ea20b1f0a-cert\") pod \"ingress-canary-mlfv6\" (UID: \"33f83da1-b1ed-4e8e-9f43-439ea20b1f0a\") " pod="openshift-ingress-canary/ingress-canary-mlfv6"
Jul 27 21:35:03.748982 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.748951    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ld9dt"]
Jul 27 21:35:03.750988 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.750971    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.754280 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.754247    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 21:35:03.754421 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.754333    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d6xkx\""
Jul 27 21:35:03.754421 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.754363    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 21:35:03.754421 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.754380    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 21:35:03.754698 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.754684    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 21:35:03.763851 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.763819    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ld9dt"]
Jul 27 21:35:03.818852 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.818815    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plmxj\" (UniqueName: \"kubernetes.io/projected/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-kube-api-access-plmxj\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.818852 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.818852    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e0d62aa-a98e-4322-b329-e6beddf1c37f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.819133 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.818888    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z6vr\" (UniqueName: \"kubernetes.io/projected/33f83da1-b1ed-4e8e-9f43-439ea20b1f0a-kube-api-access-4z6vr\") pod \"ingress-canary-mlfv6\" (UID: \"33f83da1-b1ed-4e8e-9f43-439ea20b1f0a\") " pod="openshift-ingress-canary/ingress-canary-mlfv6"
Jul 27 21:35:03.819133 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.818959    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33f83da1-b1ed-4e8e-9f43-439ea20b1f0a-cert\") pod \"ingress-canary-mlfv6\" (UID: \"33f83da1-b1ed-4e8e-9f43-439ea20b1f0a\") " pod="openshift-ingress-canary/ingress-canary-mlfv6"
Jul 27 21:35:03.819133 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.818996    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e0d62aa-a98e-4322-b329-e6beddf1c37f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.819133 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.819020    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-config-volume\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.819133 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.819035    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e0d62aa-a98e-4322-b329-e6beddf1c37f-crio-socket\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.819133 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.819057    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-metrics-tls\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.819133 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.819089    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-tmp-dir\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.819133 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.819138    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jskx4\" (UniqueName: \"kubernetes.io/projected/4e0d62aa-a98e-4322-b329-e6beddf1c37f-kube-api-access-jskx4\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.819507 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.819159    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e0d62aa-a98e-4322-b329-e6beddf1c37f-data-volume\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.819507 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.819463    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-tmp-dir\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.819709 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.819683    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-config-volume\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.823194 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.823172    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-metrics-tls\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.823296 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.823218    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33f83da1-b1ed-4e8e-9f43-439ea20b1f0a-cert\") pod \"ingress-canary-mlfv6\" (UID: \"33f83da1-b1ed-4e8e-9f43-439ea20b1f0a\") " pod="openshift-ingress-canary/ingress-canary-mlfv6"
Jul 27 21:35:03.829462 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.829423    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plmxj\" (UniqueName: \"kubernetes.io/projected/fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3-kube-api-access-plmxj\") pod \"dns-default-z2cg5\" (UID: \"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3\") " pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.830807 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.830791    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z6vr\" (UniqueName: \"kubernetes.io/projected/33f83da1-b1ed-4e8e-9f43-439ea20b1f0a-kube-api-access-4z6vr\") pod \"ingress-canary-mlfv6\" (UID: \"33f83da1-b1ed-4e8e-9f43-439ea20b1f0a\") " pod="openshift-ingress-canary/ingress-canary-mlfv6"
Jul 27 21:35:03.920152 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.920063    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jskx4\" (UniqueName: \"kubernetes.io/projected/4e0d62aa-a98e-4322-b329-e6beddf1c37f-kube-api-access-jskx4\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.920152 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.920104    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e0d62aa-a98e-4322-b329-e6beddf1c37f-data-volume\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.920152 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.920128    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e0d62aa-a98e-4322-b329-e6beddf1c37f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.920751 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.920193    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e0d62aa-a98e-4322-b329-e6beddf1c37f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.920751 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.920219    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e0d62aa-a98e-4322-b329-e6beddf1c37f-crio-socket\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.920751 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.920300    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e0d62aa-a98e-4322-b329-e6beddf1c37f-crio-socket\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.920751 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.920475    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e0d62aa-a98e-4322-b329-e6beddf1c37f-data-volume\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.920930 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.920845    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e0d62aa-a98e-4322-b329-e6beddf1c37f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.922637 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.922614    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e0d62aa-a98e-4322-b329-e6beddf1c37f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.926113 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.926091    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8d6f7f955-s7frl"]
Jul 27 21:35:03.929841 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.929823    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:03.934876 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.934857    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 21:35:03.935004 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.934911    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4dc5n\""
Jul 27 21:35:03.935004 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.934996    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 21:35:03.935223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.935209    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 21:35:03.935395 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.935380    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 21:35:03.935458 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.935425    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 21:35:03.935717 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.935596    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 21:35:03.935717 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.935646    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 21:35:03.946849 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.946825    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jskx4\" (UniqueName: \"kubernetes.io/projected/4e0d62aa-a98e-4322-b329-e6beddf1c37f-kube-api-access-jskx4\") pod \"insights-runtime-extractor-ld9dt\" (UID: \"4e0d62aa-a98e-4322-b329-e6beddf1c37f\") " pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:03.955311 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.955289    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d6f7f955-s7frl"]
Jul 27 21:35:03.967078 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.967061    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:03.972159 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:03.972137    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mlfv6"
Jul 27 21:35:04.020687 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.020642    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-oauth-serving-cert\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.020687 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.020685    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-serving-cert\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.020909 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.020713    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-service-ca\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.020909 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.020781    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8l57\" (UniqueName: \"kubernetes.io/projected/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-kube-api-access-f8l57\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.020909 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.020805    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-oauth-config\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.020909 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.020822    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-config\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.060036 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.060001    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ld9dt"
Jul 27 21:35:04.116632 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.116603    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mlfv6"]
Jul 27 21:35:04.123017 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.121174    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8l57\" (UniqueName: \"kubernetes.io/projected/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-kube-api-access-f8l57\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.123017 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.121224    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-oauth-config\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.123017 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.121251    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-config\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.123017 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:04.121251    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f83da1_b1ed_4e8e_9f43_439ea20b1f0a.slice/crio-f345c2eba6f64c9feaaf38897f1feaf2fd06154b3d9f502e4e06ea70dbc8b684 WatchSource:0}: Error finding container f345c2eba6f64c9feaaf38897f1feaf2fd06154b3d9f502e4e06ea70dbc8b684: Status 404 returned error can't find the container with id f345c2eba6f64c9feaaf38897f1feaf2fd06154b3d9f502e4e06ea70dbc8b684
Jul 27 21:35:04.123017 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.121349    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-oauth-serving-cert\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.123017 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.121461    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-serving-cert\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.123017 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.121491    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-service-ca\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.123017 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.122217    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-oauth-serving-cert\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.123017 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.122797    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-config\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.132047 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.126115    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-oauth-config\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.132047 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.126371    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-service-ca\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.132047 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.126746    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-serving-cert\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.136287 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.136264    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z2cg5"]
Jul 27 21:35:04.141785 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.140827    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8l57\" (UniqueName: \"kubernetes.io/projected/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-kube-api-access-f8l57\") pod \"console-8d6f7f955-s7frl\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") " pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.143719 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:04.143691    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7dfbb2_3025_4d40_9b4b_6ae6d6b568f3.slice/crio-f663e0ccd07fbce9e5b95d4e984a8fa32228e99af3cdc9c52f8155415240a29a WatchSource:0}: Error finding container f663e0ccd07fbce9e5b95d4e984a8fa32228e99af3cdc9c52f8155415240a29a: Status 404 returned error can't find the container with id f663e0ccd07fbce9e5b95d4e984a8fa32228e99af3cdc9c52f8155415240a29a
Jul 27 21:35:04.145151 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.145120    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mlfv6" event={"ID":"33f83da1-b1ed-4e8e-9f43-439ea20b1f0a","Type":"ContainerStarted","Data":"f345c2eba6f64c9feaaf38897f1feaf2fd06154b3d9f502e4e06ea70dbc8b684"}
Jul 27 21:35:04.210621 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.210540    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ld9dt"]
Jul 27 21:35:04.214386 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:04.214362    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0d62aa_a98e_4322_b329_e6beddf1c37f.slice/crio-78570f036ecda4a250cd6691535730c7df41a548a8f4d5de9615305f0c867161 WatchSource:0}: Error finding container 78570f036ecda4a250cd6691535730c7df41a548a8f4d5de9615305f0c867161: Status 404 returned error can't find the container with id 78570f036ecda4a250cd6691535730c7df41a548a8f4d5de9615305f0c867161
Jul 27 21:35:04.238156 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.238130    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:04.367188 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.367157    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d6f7f955-s7frl"]
Jul 27 21:35:04.370327 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:04.370288    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7020a7d3_bc57_4e9b_91d6_79155a60ab7f.slice/crio-ebc6ee1edc73a97b777d884766ee9f4c04f1ca29d3a87e02c42cd6f290aa1c5b WatchSource:0}: Error finding container ebc6ee1edc73a97b777d884766ee9f4c04f1ca29d3a87e02c42cd6f290aa1c5b: Status 404 returned error can't find the container with id ebc6ee1edc73a97b777d884766ee9f4c04f1ca29d3a87e02c42cd6f290aa1c5b
Jul 27 21:35:04.918209 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.918173    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:35:04.918632 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.918614    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:35:04.919121 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.919101    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:35:04.921906 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.921640    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 21:35:04.923813 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.923151    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 21:35:04.923813 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.923388    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kcmmw\""
Jul 27 21:35:04.923813 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.923608    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 21:35:04.924018 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.923930    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9xnkh\""
Jul 27 21:35:04.924337 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:04.924163    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 21:35:05.154745 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:05.154621    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z2cg5" event={"ID":"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3","Type":"ContainerStarted","Data":"f663e0ccd07fbce9e5b95d4e984a8fa32228e99af3cdc9c52f8155415240a29a"}
Jul 27 21:35:05.158510 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:05.158413    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d6f7f955-s7frl" event={"ID":"7020a7d3-bc57-4e9b-91d6-79155a60ab7f","Type":"ContainerStarted","Data":"ebc6ee1edc73a97b777d884766ee9f4c04f1ca29d3a87e02c42cd6f290aa1c5b"}
Jul 27 21:35:05.162274 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:05.162185    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ld9dt" event={"ID":"4e0d62aa-a98e-4322-b329-e6beddf1c37f","Type":"ContainerStarted","Data":"78570f036ecda4a250cd6691535730c7df41a548a8f4d5de9615305f0c867161"}
Jul 27 21:35:06.708295 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:06.708241    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb"]
Jul 27 21:35:06.711063 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:06.711039    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb"
Jul 27 21:35:06.713755 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:06.713725    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 21:35:06.713881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:06.713792    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6bf5j\""
Jul 27 21:35:06.721815 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:06.721789    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb"]
Jul 27 21:35:06.747860 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:06.747823    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/024d6f40-46c7-42fb-a254-52acc6fe989d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bvbmb\" (UID: \"024d6f40-46c7-42fb-a254-52acc6fe989d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb"
Jul 27 21:35:06.848638 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:06.848584    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/024d6f40-46c7-42fb-a254-52acc6fe989d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bvbmb\" (UID: \"024d6f40-46c7-42fb-a254-52acc6fe989d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb"
Jul 27 21:35:06.848829 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:06.848736    2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 21:35:06.848829 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:06.848816    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/024d6f40-46c7-42fb-a254-52acc6fe989d-tls-certificates podName:024d6f40-46c7-42fb-a254-52acc6fe989d nodeName:}" failed. No retries permitted until 2026-07-27 21:35:07.348796668 +0000 UTC m=+59.066203145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/024d6f40-46c7-42fb-a254-52acc6fe989d-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-bvbmb" (UID: "024d6f40-46c7-42fb-a254-52acc6fe989d") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 21:35:07.353202 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:07.353121    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/024d6f40-46c7-42fb-a254-52acc6fe989d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bvbmb\" (UID: \"024d6f40-46c7-42fb-a254-52acc6fe989d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb"
Jul 27 21:35:07.356070 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:07.356045    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/024d6f40-46c7-42fb-a254-52acc6fe989d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bvbmb\" (UID: \"024d6f40-46c7-42fb-a254-52acc6fe989d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb"
Jul 27 21:35:07.625397 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:07.625310    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb"
Jul 27 21:35:10.095269 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:10.095237    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q96gh"
Jul 27 21:35:12.111960 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:12.108901    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb"]
Jul 27 21:35:12.114970 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:12.114909    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024d6f40_46c7_42fb_a254_52acc6fe989d.slice/crio-41e174f5a21efc180e41f39586fbcc6154170a694e4b757cc21edd8ceb28ce15 WatchSource:0}: Error finding container 41e174f5a21efc180e41f39586fbcc6154170a694e4b757cc21edd8ceb28ce15: Status 404 returned error can't find the container with id 41e174f5a21efc180e41f39586fbcc6154170a694e4b757cc21edd8ceb28ce15
Jul 27 21:35:12.185635 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:12.185135    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d6f7f955-s7frl" event={"ID":"7020a7d3-bc57-4e9b-91d6-79155a60ab7f","Type":"ContainerStarted","Data":"860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f"}
Jul 27 21:35:12.186902 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:12.186813    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ld9dt" event={"ID":"4e0d62aa-a98e-4322-b329-e6beddf1c37f","Type":"ContainerStarted","Data":"645025ba274dcb68798ce49be3fc6328c11bcc8862743b0d0e8a53d1159c9b0e"}
Jul 27 21:35:12.188016 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:12.187953    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb" event={"ID":"024d6f40-46c7-42fb-a254-52acc6fe989d","Type":"ContainerStarted","Data":"41e174f5a21efc180e41f39586fbcc6154170a694e4b757cc21edd8ceb28ce15"}
Jul 27 21:35:12.190094 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:12.190029    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mlfv6" event={"ID":"33f83da1-b1ed-4e8e-9f43-439ea20b1f0a","Type":"ContainerStarted","Data":"8f776633cf5fd2d06db60efdcbb11537af2560c8ee7d6e490917c38355048fb1"}
Jul 27 21:35:12.191759 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:12.191714    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z2cg5" event={"ID":"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3","Type":"ContainerStarted","Data":"c0ab8944d6823db85402c9ddcc099770e90d00cf64f1d6ebd92d6b721919beba"}
Jul 27 21:35:12.204108 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:12.204037    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8d6f7f955-s7frl" podStartSLOduration=1.622314624 podStartE2EDuration="9.204016413s" totalImagesPullingTime="7.581701789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:12.203032552 +0000 UTC m=+63.920439037" watchObservedRunningTime="2026-07-27 21:35:12.204016413 +0000 UTC m=+63.921422897"
Jul 27 21:35:13.090086 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.089565    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mlfv6" podStartSLOduration=2.260195002 podStartE2EDuration="10.089540954s" totalImagesPullingTime="7.829345952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:12.218628808 +0000 UTC m=+63.936035291" watchObservedRunningTime="2026-07-27 21:35:13.089540954 +0000 UTC m=+64.806947439"
Jul 27 21:35:13.090289 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.090151    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b4995896-v72j5"]
Jul 27 21:35:13.092808 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.092781    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.104576 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.103814    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 21:35:13.104576 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.104336    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b4995896-v72j5"]
Jul 27 21:35:13.200131 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.199988    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z2cg5" event={"ID":"fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3","Type":"ContainerStarted","Data":"a08a808a27de21620edcfbe3d663c0234e500c3bbf52eede35b9ba6fa82475d0"}
Jul 27 21:35:13.207488 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.207458    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-serving-cert\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.207488 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.207491    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-service-ca\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.207736 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.207508    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-trusted-ca-bundle\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.207736 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.207540    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-oauth-config\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.207736 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.207577    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-oauth-serving-cert\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.207736 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.207604    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-console-config\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.207736 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.207620    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mt62\" (UniqueName: \"kubernetes.io/projected/47fd7ed9-a023-4b38-b133-6c0949f66713-kube-api-access-6mt62\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.218512 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.218451    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z2cg5" podStartSLOduration=2.744334811 podStartE2EDuration="10.218413409s" totalImagesPullingTime="7.474078598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:13.217591602 +0000 UTC m=+64.934998084" watchObservedRunningTime="2026-07-27 21:35:13.218413409 +0000 UTC m=+64.935819891"
Jul 27 21:35:13.308540 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.308493    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-serving-cert\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.308540 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.308542    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-service-ca\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.308787 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.308567    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-trusted-ca-bundle\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.308787 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.308605    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-oauth-config\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.308787 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.308667    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-oauth-serving-cert\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.308931 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.308797    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-console-config\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.308931 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.308832    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mt62\" (UniqueName: \"kubernetes.io/projected/47fd7ed9-a023-4b38-b133-6c0949f66713-kube-api-access-6mt62\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.310296 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.310261    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-console-config\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.310989 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.310962    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-oauth-serving-cert\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.311107 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.310973    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-trusted-ca-bundle\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.311511 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.311488    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-service-ca\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.313104 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.313081    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-oauth-config\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.313257 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.313236    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-serving-cert\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.321546 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.321502    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mt62\" (UniqueName: \"kubernetes.io/projected/47fd7ed9-a023-4b38-b133-6c0949f66713-kube-api-access-6mt62\") pod \"console-7b4995896-v72j5\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") " pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.409308 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.408689    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:13.580727 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:13.580704    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b4995896-v72j5"]
Jul 27 21:35:13.583241 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:13.583200    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47fd7ed9_a023_4b38_b133_6c0949f66713.slice/crio-9dc5ca02f6952beb9e29b8061e367cdcdee01281a8a4b50c70650959d61cdf01 WatchSource:0}: Error finding container 9dc5ca02f6952beb9e29b8061e367cdcdee01281a8a4b50c70650959d61cdf01: Status 404 returned error can't find the container with id 9dc5ca02f6952beb9e29b8061e367cdcdee01281a8a4b50c70650959d61cdf01
Jul 27 21:35:14.204418 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.204380    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb" event={"ID":"024d6f40-46c7-42fb-a254-52acc6fe989d","Type":"ContainerStarted","Data":"e57d3bb1a659ddfa0e8138f5bbef2ca96d5ae7fd9a02df6ce05f25ff6baca1e5"}
Jul 27 21:35:14.204911 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.204563    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb"
Jul 27 21:35:14.206357 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.206328    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4995896-v72j5" event={"ID":"47fd7ed9-a023-4b38-b133-6c0949f66713","Type":"ContainerStarted","Data":"1e0b27e20d9f54f189727a430f3706dd51991af52c3b8e1f3d2f32c8a6b90e12"}
Jul 27 21:35:14.206973 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.206474    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:14.206973 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.206509    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4995896-v72j5" event={"ID":"47fd7ed9-a023-4b38-b133-6c0949f66713","Type":"ContainerStarted","Data":"9dc5ca02f6952beb9e29b8061e367cdcdee01281a8a4b50c70650959d61cdf01"}
Jul 27 21:35:14.210012 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.209987    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb"
Jul 27 21:35:14.221382 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.221323    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bvbmb" podStartSLOduration=6.997551979 podStartE2EDuration="8.221303133s" totalImagesPullingTime="1.223751154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:14.220922072 +0000 UTC m=+65.938328554" watchObservedRunningTime="2026-07-27 21:35:14.221303133 +0000 UTC m=+65.938709618"
Jul 27 21:35:14.238361 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.238328    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:14.238548 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.238393    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:14.239748 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.239716    2554 patch_prober.go:28] interesting pod/console-8d6f7f955-s7frl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 27 21:35:14.239884 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.239794    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8d6f7f955-s7frl" podUID="7020a7d3-bc57-4e9b-91d6-79155a60ab7f" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 27 21:35:14.257181 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.257127    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b4995896-v72j5" podStartSLOduration=1.257111305 podStartE2EDuration="1.257111305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:14.256535165 +0000 UTC m=+65.973941649" watchObservedRunningTime="2026-07-27 21:35:14.257111305 +0000 UTC m=+65.974517843"
Jul 27 21:35:14.518621 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.518577    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:35:14.521932 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.521908    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 21:35:14.531968 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.531944    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a71333-87bf-440c-bec0-ad436ffe66f3-original-pull-secret\") pod \"global-pull-secret-syncer-rzszd\" (UID: \"20a71333-87bf-440c-bec0-ad436ffe66f3\") " pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:35:14.549109 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.549068    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzszd"
Jul 27 21:35:14.720072 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.720026    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:35:14.720261 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.720145    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4xl9\" (UniqueName: \"kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9\") pod \"network-check-target-zrv6d\" (UID: \"8f0ba091-3816-4ddb-a041-ca3a9bb66630\") " pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:35:14.722780 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.722755    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 21:35:14.722899 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.722757    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 21:35:14.734008 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.733775    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 21:35:14.734317 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.734288    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a320449-3323-4c81-9d13-07329a8d3586-metrics-certs\") pod \"network-metrics-daemon-kqgdb\" (UID: \"8a320449-3323-4c81-9d13-07329a8d3586\") " pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:35:14.744164 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.744138    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4xl9\" (UniqueName: \"kubernetes.io/projected/8f0ba091-3816-4ddb-a041-ca3a9bb66630-kube-api-access-n4xl9\") pod \"network-check-target-zrv6d\" (UID: \"8f0ba091-3816-4ddb-a041-ca3a9bb66630\") " pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:35:14.782176 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.782095    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"]
Jul 27 21:35:14.790375 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.790337    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.793875 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.793848    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 21:35:14.794031 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.793898    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vlcnh\""
Jul 27 21:35:14.794031 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.793911    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 27 21:35:14.794031 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.793860    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 21:35:14.794615 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.794598    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 21:35:14.794943 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.794910    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 27 21:35:14.809811 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.809778    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"]
Jul 27 21:35:14.821208 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.821173    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f02500e-6edc-4a0a-857e-7b56c85c9492-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.821387 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.821234    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhbt5\" (UniqueName: \"kubernetes.io/projected/8f02500e-6edc-4a0a-857e-7b56c85c9492-kube-api-access-rhbt5\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.821387 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.821286    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f02500e-6edc-4a0a-857e-7b56c85c9492-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.821387 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.821335    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f02500e-6edc-4a0a-857e-7b56c85c9492-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.842168 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.842138    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kcmmw\""
Jul 27 21:35:14.849795 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.849763    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:35:14.859612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.859584    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9xnkh\""
Jul 27 21:35:14.866564 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.866524    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqgdb"
Jul 27 21:35:14.923414 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.922567    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f02500e-6edc-4a0a-857e-7b56c85c9492-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.923414 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.922633    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhbt5\" (UniqueName: \"kubernetes.io/projected/8f02500e-6edc-4a0a-857e-7b56c85c9492-kube-api-access-rhbt5\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.923414 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.922681    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f02500e-6edc-4a0a-857e-7b56c85c9492-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.923414 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.922722    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f02500e-6edc-4a0a-857e-7b56c85c9492-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.923414 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.923341    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f02500e-6edc-4a0a-857e-7b56c85c9492-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.925753 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.925725    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f02500e-6edc-4a0a-857e-7b56c85c9492-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.925905 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.925728    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f02500e-6edc-4a0a-857e-7b56c85c9492-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:14.933353 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:14.933322    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhbt5\" (UniqueName: \"kubernetes.io/projected/8f02500e-6edc-4a0a-857e-7b56c85c9492-kube-api-access-rhbt5\") pod \"prometheus-operator-84d69f794d-gzvn5\" (UID: \"8f02500e-6edc-4a0a-857e-7b56c85c9492\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:15.101543 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:15.101455    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"
Jul 27 21:35:16.158424 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:16.158392    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zrv6d"]
Jul 27 21:35:16.170803 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:16.170769    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rzszd"]
Jul 27 21:35:16.197707 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:16.197677    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0ba091_3816_4ddb_a041_ca3a9bb66630.slice/crio-d07369d86a57cf512f9871f2e0abbb708b1c16624324d4efa21a548718b48415 WatchSource:0}: Error finding container d07369d86a57cf512f9871f2e0abbb708b1c16624324d4efa21a548718b48415: Status 404 returned error can't find the container with id d07369d86a57cf512f9871f2e0abbb708b1c16624324d4efa21a548718b48415
Jul 27 21:35:16.198367 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:16.198330    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a71333_87bf_440c_bec0_ad436ffe66f3.slice/crio-37cdaa0d39dbd91eded8f80aa03fccdd5510dfcf6dbe984eb81cc9bb6f84c31c WatchSource:0}: Error finding container 37cdaa0d39dbd91eded8f80aa03fccdd5510dfcf6dbe984eb81cc9bb6f84c31c: Status 404 returned error can't find the container with id 37cdaa0d39dbd91eded8f80aa03fccdd5510dfcf6dbe984eb81cc9bb6f84c31c
Jul 27 21:35:16.218409 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:16.218371    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zrv6d" event={"ID":"8f0ba091-3816-4ddb-a041-ca3a9bb66630","Type":"ContainerStarted","Data":"d07369d86a57cf512f9871f2e0abbb708b1c16624324d4efa21a548718b48415"}
Jul 27 21:35:16.219700 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:16.219672    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rzszd" event={"ID":"20a71333-87bf-440c-bec0-ad436ffe66f3","Type":"ContainerStarted","Data":"37cdaa0d39dbd91eded8f80aa03fccdd5510dfcf6dbe984eb81cc9bb6f84c31c"}
Jul 27 21:35:16.401296 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:16.401261    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kqgdb"]
Jul 27 21:35:16.407389 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:16.407360    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gzvn5"]
Jul 27 21:35:16.410288 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:16.410247    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f02500e_6edc_4a0a_857e_7b56c85c9492.slice/crio-e7ead20edafce2c4a6e98eeacaa0d4fe81392336a8e3b9168252b9881ceaf020 WatchSource:0}: Error finding container e7ead20edafce2c4a6e98eeacaa0d4fe81392336a8e3b9168252b9881ceaf020: Status 404 returned error can't find the container with id e7ead20edafce2c4a6e98eeacaa0d4fe81392336a8e3b9168252b9881ceaf020
Jul 27 21:35:17.226790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:17.226752    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqgdb" event={"ID":"8a320449-3323-4c81-9d13-07329a8d3586","Type":"ContainerStarted","Data":"a5fe30e5e726aa3829ca84ae05c62e4ccc4b0848aa9dec235045c5b88bb929c9"}
Jul 27 21:35:17.229990 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:17.229950    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5" event={"ID":"8f02500e-6edc-4a0a-857e-7b56c85c9492","Type":"ContainerStarted","Data":"e7ead20edafce2c4a6e98eeacaa0d4fe81392336a8e3b9168252b9881ceaf020"}
Jul 27 21:35:17.234371 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:17.234339    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ld9dt" event={"ID":"4e0d62aa-a98e-4322-b329-e6beddf1c37f","Type":"ContainerStarted","Data":"1f809b1750e6ab94f4d8b5105b92b9b4bb8d07ef6487acb8ce903bc6a5163975"}
Jul 27 21:35:18.247940 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:18.247297    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqgdb" event={"ID":"8a320449-3323-4c81-9d13-07329a8d3586","Type":"ContainerStarted","Data":"c4f363e468460915211900fe97490b2460960e87aa5f5d8ec8d43cdba560ab18"}
Jul 27 21:35:18.247940 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:18.247364    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqgdb" event={"ID":"8a320449-3323-4c81-9d13-07329a8d3586","Type":"ContainerStarted","Data":"706f2a4512c7e0b18cfec31e4e2ddb4ecd83df9132d58164b35b086111da47ac"}
Jul 27 21:35:19.253591 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:19.253550    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5" event={"ID":"8f02500e-6edc-4a0a-857e-7b56c85c9492","Type":"ContainerStarted","Data":"d15587dddacec40fdde1c75ab9e794a5d045860515abd89f312a2feb60f43e6f"}
Jul 27 21:35:19.254069 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:19.253649    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5" event={"ID":"8f02500e-6edc-4a0a-857e-7b56c85c9492","Type":"ContainerStarted","Data":"30f2e9dc4a70810bd8b8158db4c3dc4d5c4d2b0219a6998584e960fcc8107554"}
Jul 27 21:35:19.272782 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:19.272676    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kqgdb" podStartSLOduration=68.795170017 podStartE2EDuration="1m10.272650791s" totalImagesPullingTime="1.477480774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:18.265676884 +0000 UTC m=+69.983083368" watchObservedRunningTime="2026-07-27 21:35:19.272650791 +0000 UTC m=+70.990057273"
Jul 27 21:35:19.274206 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:19.274162    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-gzvn5" podStartSLOduration=2.977189964 podStartE2EDuration="5.274146991s" totalImagesPullingTime="2.296957027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:19.27071492 +0000 UTC m=+70.988121402" watchObservedRunningTime="2026-07-27 21:35:19.274146991 +0000 UTC m=+70.991553455"
Jul 27 21:35:21.352845 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.352807    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"]
Jul 27 21:35:21.356380 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.356354    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.361944 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.361918    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tqrrq\""
Jul 27 21:35:21.361944 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.361932    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 27 21:35:21.361944 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.361941    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 27 21:35:21.376962 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.376933    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"]
Jul 27 21:35:21.398299 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.398232    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"]
Jul 27 21:35:21.400810 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.400788    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.403927 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.403901    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 21:35:21.403927 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.403916    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 21:35:21.404711 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.404677    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 21:35:21.404822 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.404742    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9pt9d\""
Jul 27 21:35:21.412272 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.411736    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rn5vd"]
Jul 27 21:35:21.414099 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.414082    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.417073 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.417050    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 21:35:21.417180 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.417072    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ghxlq\""
Jul 27 21:35:21.417180 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.417050    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 21:35:21.417286 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.417244    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 21:35:21.424341 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.424319    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"]
Jul 27 21:35:21.469068 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469036    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5kbh\" (UniqueName: \"kubernetes.io/projected/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-api-access-t5kbh\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.469068 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469074    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28a84019-3d4c-443b-a262-769a0fb14504-sys\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.469327 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469103    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.469327 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469163    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-textfile\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.469327 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469201    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-accelerators-collector-config\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.469327 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469231    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.469327 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469254    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.469594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469314    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28a84019-3d4c-443b-a262-769a0fb14504-root\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.469594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469387    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81c9b1e0-9132-4a93-954f-849cc8834c83-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.469594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469406    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.469594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469462    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.469594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469485    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81c9b1e0-9132-4a93-954f-849cc8834c83-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.469594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469502    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.469594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469545    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-wtmp\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.469594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469584    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l94s\" (UniqueName: \"kubernetes.io/projected/28a84019-3d4c-443b-a262-769a0fb14504-kube-api-access-8l94s\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.470004 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469617    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-tls\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.470004 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469648    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.470004 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469667    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjpm7\" (UniqueName: \"kubernetes.io/projected/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-kube-api-access-rjpm7\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.470004 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.469691    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a84019-3d4c-443b-a262-769a0fb14504-metrics-client-ca\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.570080 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570040    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.570080 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570091    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjpm7\" (UniqueName: \"kubernetes.io/projected/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-kube-api-access-rjpm7\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.570337 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570123    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a84019-3d4c-443b-a262-769a0fb14504-metrics-client-ca\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.570337 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570151    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5kbh\" (UniqueName: \"kubernetes.io/projected/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-api-access-t5kbh\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.570337 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570166    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28a84019-3d4c-443b-a262-769a0fb14504-sys\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.570337 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570190    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.570337 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:21.570203    2554 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 27 21:35:21.570337 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:21.570280    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-tls podName:81c9b1e0-9132-4a93-954f-849cc8834c83 nodeName:}" failed. No retries permitted until 2026-07-27 21:35:22.070258128 +0000 UTC m=+73.787664599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-f8xwb" (UID: "81c9b1e0-9132-4a93-954f-849cc8834c83") : secret "kube-state-metrics-tls" not found
Jul 27 21:35:21.570673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570211    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-textfile\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.570673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570421    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-accelerators-collector-config\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.570673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570476    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.570673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570504    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.570673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570529    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28a84019-3d4c-443b-a262-769a0fb14504-root\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.570673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570550    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-textfile\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.570673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570556    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81c9b1e0-9132-4a93-954f-849cc8834c83-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.570673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570599    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.570673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570621    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.570673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570654    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81c9b1e0-9132-4a93-954f-849cc8834c83-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.571166 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570680    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.571166 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570708    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-wtmp\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.571166 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570760    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l94s\" (UniqueName: \"kubernetes.io/projected/28a84019-3d4c-443b-a262-769a0fb14504-kube-api-access-8l94s\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.571166 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.570794    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-tls\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.571166 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.571019    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-accelerators-collector-config\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.571166 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.571132    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81c9b1e0-9132-4a93-954f-849cc8834c83-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.571484 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.571189    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28a84019-3d4c-443b-a262-769a0fb14504-root\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.571891 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.571650    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.571995 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.571928    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81c9b1e0-9132-4a93-954f-849cc8834c83-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.578587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.573291    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28a84019-3d4c-443b-a262-769a0fb14504-sys\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.578587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.573931    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-wtmp\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.578587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.573998    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28a84019-3d4c-443b-a262-769a0fb14504-metrics-client-ca\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.578587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.574535    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.578587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.574602    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.578587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.574730    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-tls\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.578587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.574909    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.578587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.576007    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28a84019-3d4c-443b-a262-769a0fb14504-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.578587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.576014    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.586504 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.586478    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjpm7\" (UniqueName: \"kubernetes.io/projected/79c9ce85-03ea-4c4d-97e5-507f77bd9b2f-kube-api-access-rjpm7\") pod \"openshift-state-metrics-b8f49f5c6-dncpg\" (UID: \"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.586641 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.586535    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5kbh\" (UniqueName: \"kubernetes.io/projected/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-api-access-t5kbh\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:21.587501 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.587478    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l94s\" (UniqueName: \"kubernetes.io/projected/28a84019-3d4c-443b-a262-769a0fb14504-kube-api-access-8l94s\") pod \"node-exporter-rn5vd\" (UID: \"28a84019-3d4c-443b-a262-769a0fb14504\") " pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:21.667681 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.667595    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"
Jul 27 21:35:21.724936 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:21.724888    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rn5vd"
Jul 27 21:35:22.074166 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.074128    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:22.077056 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.077034    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81c9b1e0-9132-4a93-954f-849cc8834c83-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-f8xwb\" (UID: \"81c9b1e0-9132-4a93-954f-849cc8834c83\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:22.303183 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.303146    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:35:22.308949 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.308917    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.311727 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.311689    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 21:35:22.311727 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.311747    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 21:35:22.311992 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.311694    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-txhxz\""
Jul 27 21:35:22.312304 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.312205    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 21:35:22.312304 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.312251    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 21:35:22.312304 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.312294    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 21:35:22.312535 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.312211    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 21:35:22.312583 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.312553    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 21:35:22.312631 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.312612    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 21:35:22.312687 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.312612    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 21:35:22.313669 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.313400    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"
Jul 27 21:35:22.326533 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.326420    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:35:22.376241 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.376213    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-config-out\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.376795 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.376766    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.376916 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.376810    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.376916 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.376873    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.377029 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.376925    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.377029 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.376949    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.377029 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.376974    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-web-config\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.377029 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.376998    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.377196 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.377060    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.377196 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.377084    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7z9t\" (UniqueName: \"kubernetes.io/projected/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-kube-api-access-q7z9t\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.377272 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.377181    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.377272 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.377223    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.377272 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.377252    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.478196 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.478159    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.478196 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.478198    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.478467 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.478234    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.478467 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.478262    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-config-out\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.478467 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:22.478350    2554 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 27 21:35:22.478626 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:22.478476    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-main-tls podName:0ba6b240-7d7a-4954-881d-a65ca2cda8e2 nodeName:}" failed. No retries permitted until 2026-07-27 21:35:22.978423 +0000 UTC m=+74.695829462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0ba6b240-7d7a-4954-881d-a65ca2cda8e2") : secret "alertmanager-main-tls" not found
Jul 27 21:35:22.478828 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.478804    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.478924 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.478849    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.478924 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.478910    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.479043 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.478942    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.479043 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.478981    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.479043 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.479020    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-web-config\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.479190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.479044    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.479190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.479081    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.479190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.479106    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7z9t\" (UniqueName: \"kubernetes.io/projected/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-kube-api-access-q7z9t\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.479600 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.479348    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.479600 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:22.479466    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-alertmanager-trusted-ca-bundle podName:0ba6b240-7d7a-4954-881d-a65ca2cda8e2 nodeName:}" failed. No retries permitted until 2026-07-27 21:35:22.979425923 +0000 UTC m=+74.696832397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "0ba6b240-7d7a-4954-881d-a65ca2cda8e2") : configmap references non-existent config key: ca-bundle.crt
Jul 27 21:35:22.479827 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.479796    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.481346 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.481322    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-config-out\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.481600 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.481577    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.481781 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.481761    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.482911 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.482881    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-web-config\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.483104 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.483041    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.483673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.483633    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.483772 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.483747    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.483891 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.483869    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.489255 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.489222    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7z9t\" (UniqueName: \"kubernetes.io/projected/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-kube-api-access-q7z9t\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.984359 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.984324    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.984575 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.984416    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.985289 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.985260    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:22.987314 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:22.987287    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ba6b240-7d7a-4954-881d-a65ca2cda8e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ba6b240-7d7a-4954-881d-a65ca2cda8e2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:23.221513 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.221472    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 21:35:23.270855 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.270828    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rn5vd" event={"ID":"28a84019-3d4c-443b-a262-769a0fb14504","Type":"ContainerStarted","Data":"d3e26186edb0f5b298ccfac2f8bb38abcabf913d1de4a97bc60ac35e9af58acc"}
Jul 27 21:35:23.299555 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.299475    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"]
Jul 27 21:35:23.312625 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.310194    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.328223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.322903    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"]
Jul 27 21:35:23.328223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.323085    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 21:35:23.328223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.324172    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 21:35:23.328223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.324707    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-777lx\""
Jul 27 21:35:23.328223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.324994    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 21:35:23.328223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.326491    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 21:35:23.328223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.326739    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 21:35:23.328223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.326957    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5fg11urtjhajs\""
Jul 27 21:35:23.389735 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.389243    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch6qr\" (UniqueName: \"kubernetes.io/projected/2fa2aa24-829e-4f80-bfdf-ace703d93a02-kube-api-access-ch6qr\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.389735 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.389305    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.389735 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.389335    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.389735 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.389367    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-tls\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.389735 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.389401    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.389735 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.389476    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-grpc-tls\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.389735 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.389505    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.389735 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.389556    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa2aa24-829e-4f80-bfdf-ace703d93a02-metrics-client-ca\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.409775 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.409546    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:23.410282 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.409935    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:23.416642 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.416615    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:23.436486 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.436023    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg"]
Jul 27 21:35:23.438212 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:23.438168    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c9ce85_03ea_4c4d_97e5_507f77bd9b2f.slice/crio-47519bcb368646b797d9a2f5457eab728db59551ecd3cc861a5dcac45261977d WatchSource:0}: Error finding container 47519bcb368646b797d9a2f5457eab728db59551ecd3cc861a5dcac45261977d: Status 404 returned error can't find the container with id 47519bcb368646b797d9a2f5457eab728db59551ecd3cc861a5dcac45261977d
Jul 27 21:35:23.453338 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.453255    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb"]
Jul 27 21:35:23.459202 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:23.459154    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c9b1e0_9132_4a93_954f_849cc8834c83.slice/crio-f148dc1d13e4d427a309343d22cbc5e93793a6cd71ade69a53fff96484151302 WatchSource:0}: Error finding container f148dc1d13e4d427a309343d22cbc5e93793a6cd71ade69a53fff96484151302: Status 404 returned error can't find the container with id f148dc1d13e4d427a309343d22cbc5e93793a6cd71ade69a53fff96484151302
Jul 27 21:35:23.484801 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.484765    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 21:35:23.494944 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.494885    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa2aa24-829e-4f80-bfdf-ace703d93a02-metrics-client-ca\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.495035 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.494989    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6qr\" (UniqueName: \"kubernetes.io/projected/2fa2aa24-829e-4f80-bfdf-ace703d93a02-kube-api-access-ch6qr\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.495091 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.495040    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.495091 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.495070    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.495189 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.495101    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-tls\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.495189 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.495148    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.495497 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.495474    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-grpc-tls\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.495621 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.495607    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.497257 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.497211    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa2aa24-829e-4f80-bfdf-ace703d93a02-metrics-client-ca\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.499385 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.499342    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.499510 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.499427    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.499727 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.499679    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-tls\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.499899 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.499814    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.500099 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.500079    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-grpc-tls\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.500165 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.500078    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa2aa24-829e-4f80-bfdf-ace703d93a02-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.500798 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:23.500647    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba6b240_7d7a_4954_881d_a65ca2cda8e2.slice/crio-07bda8a71413b0dced021f3f5b8c45b9cc68b901745f3e89a2482800a0e9b7a2 WatchSource:0}: Error finding container 07bda8a71413b0dced021f3f5b8c45b9cc68b901745f3e89a2482800a0e9b7a2: Status 404 returned error can't find the container with id 07bda8a71413b0dced021f3f5b8c45b9cc68b901745f3e89a2482800a0e9b7a2
Jul 27 21:35:23.506026 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.505538    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch6qr\" (UniqueName: \"kubernetes.io/projected/2fa2aa24-829e-4f80-bfdf-ace703d93a02-kube-api-access-ch6qr\") pod \"thanos-querier-8fb987ffb-wv8wj\" (UID: \"2fa2aa24-829e-4f80-bfdf-ace703d93a02\") " pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.659470 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.659344    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:23.815928 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:23.815896    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"]
Jul 27 21:35:23.819468 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:23.819420    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa2aa24_829e_4f80_bfdf_ace703d93a02.slice/crio-14bb2522612c02a21b9d037bcb8f902d6dd2d9611cd5e1a8de3cb8b99fcf3580 WatchSource:0}: Error finding container 14bb2522612c02a21b9d037bcb8f902d6dd2d9611cd5e1a8de3cb8b99fcf3580: Status 404 returned error can't find the container with id 14bb2522612c02a21b9d037bcb8f902d6dd2d9611cd5e1a8de3cb8b99fcf3580
Jul 27 21:35:24.212035 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.212006    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z2cg5"
Jul 27 21:35:24.245483 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.244906    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:24.251346 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.251229    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:24.279946 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.279900    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ba6b240-7d7a-4954-881d-a65ca2cda8e2","Type":"ContainerStarted","Data":"07bda8a71413b0dced021f3f5b8c45b9cc68b901745f3e89a2482800a0e9b7a2"}
Jul 27 21:35:24.281625 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.281594    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb" event={"ID":"81c9b1e0-9132-4a93-954f-849cc8834c83","Type":"ContainerStarted","Data":"f148dc1d13e4d427a309343d22cbc5e93793a6cd71ade69a53fff96484151302"}
Jul 27 21:35:24.285022 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.284983    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rzszd" event={"ID":"20a71333-87bf-440c-bec0-ad436ffe66f3","Type":"ContainerStarted","Data":"8f6859cc26a08314a9904053e8310ce0282eb6285b58ce33d26cbcbe13545e80"}
Jul 27 21:35:24.287386 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.287358    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj" event={"ID":"2fa2aa24-829e-4f80-bfdf-ace703d93a02","Type":"ContainerStarted","Data":"14bb2522612c02a21b9d037bcb8f902d6dd2d9611cd5e1a8de3cb8b99fcf3580"}
Jul 27 21:35:24.290786 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.290749    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg" event={"ID":"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f","Type":"ContainerStarted","Data":"5a5bc6fa88757928c1e18fcd205992e80b508245d6119ce13e08e7e2c7b0eead"}
Jul 27 21:35:24.290903 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.290813    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg" event={"ID":"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f","Type":"ContainerStarted","Data":"bb3ee8c3b54f3f90a5a092d893c8d6a00edab7368add3dccc5e4c7b74f2a9d73"}
Jul 27 21:35:24.290903 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.290840    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg" event={"ID":"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f","Type":"ContainerStarted","Data":"47519bcb368646b797d9a2f5457eab728db59551ecd3cc861a5dcac45261977d"}
Jul 27 21:35:24.301633 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.301596    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ld9dt" event={"ID":"4e0d62aa-a98e-4322-b329-e6beddf1c37f","Type":"ContainerStarted","Data":"e3984e2a92a3bbd83465327cb9643b06615d7635b2e9497585cf6762625b6ce2"}
Jul 27 21:35:24.307089 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.306412    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zrv6d" event={"ID":"8f0ba091-3816-4ddb-a041-ca3a9bb66630","Type":"ContainerStarted","Data":"40a00bbf5ed1bab5340d1b7d10da67d3acb34156086629a190e434a0b0afe4ce"}
Jul 27 21:35:24.307089 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.306913    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:35:24.312209 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.312180    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rn5vd" event={"ID":"28a84019-3d4c-443b-a262-769a0fb14504","Type":"ContainerStarted","Data":"fe9dbca8582b343f908c603b6619e8ad56e5cdb5431dee55eebe4e9312f3203f"}
Jul 27 21:35:24.316639 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.316584    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rzszd" podStartSLOduration=68.268525862 podStartE2EDuration="1m15.316563996s" totalImagesPullingTime="7.048038134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:24.314256792 +0000 UTC m=+76.031663275" watchObservedRunningTime="2026-07-27 21:35:24.316563996 +0000 UTC m=+76.033970480"
Jul 27 21:35:24.320655 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.319627    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:35:24.364554 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.362471    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zrv6d" podStartSLOduration=68.31899914 podStartE2EDuration="1m15.362447666s" totalImagesPullingTime="7.043448526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:24.361648544 +0000 UTC m=+76.079055027" watchObservedRunningTime="2026-07-27 21:35:24.362447666 +0000 UTC m=+76.079854140"
Jul 27 21:35:24.364554 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.362877    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ld9dt" podStartSLOduration=2.489893599 podStartE2EDuration="21.362866301s" totalImagesPullingTime="18.872972702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:35:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:24.339794839 +0000 UTC m=+76.057201321" watchObservedRunningTime="2026-07-27 21:35:24.362866301 +0000 UTC m=+76.080272785"
Jul 27 21:35:24.445260 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:24.445168    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8d6f7f955-s7frl"]
Jul 27 21:35:25.318297 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.318250    2554 generic.go:356] "Generic (PLEG): container finished" podID="28a84019-3d4c-443b-a262-769a0fb14504" containerID="fe9dbca8582b343f908c603b6619e8ad56e5cdb5431dee55eebe4e9312f3203f" exitCode=0
Jul 27 21:35:25.319124 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.319089    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rn5vd" event={"ID":"28a84019-3d4c-443b-a262-769a0fb14504","Type":"ContainerDied","Data":"fe9dbca8582b343f908c603b6619e8ad56e5cdb5431dee55eebe4e9312f3203f"}
Jul 27 21:35:25.785049 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.785013    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-758695c6d5-lp7s4"]
Jul 27 21:35:25.788069 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.788042    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:25.793693 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.793671    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 21:35:25.793981 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.793953    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9vfq8jb90a974\""
Jul 27 21:35:25.794783 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.794764    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 21:35:25.794952 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.794933    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 21:35:25.795029 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.794957    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 21:35:25.795029 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.795020    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-r7vsg\""
Jul 27 21:35:25.808824 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.808795    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-758695c6d5-lp7s4"]
Jul 27 21:35:25.921797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.921766    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3bcb0b56-642f-4e6f-8da5-ed60182a7911-secret-metrics-server-tls\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:25.921797 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.921810    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3bcb0b56-642f-4e6f-8da5-ed60182a7911-secret-metrics-server-client-certs\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:25.922035 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.921846    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3bcb0b56-642f-4e6f-8da5-ed60182a7911-audit-log\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:25.922035 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.921873    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3bcb0b56-642f-4e6f-8da5-ed60182a7911-metrics-server-audit-profiles\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:25.922035 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.921914    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bcb0b56-642f-4e6f-8da5-ed60182a7911-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:25.922035 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.921947    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bcb0b56-642f-4e6f-8da5-ed60182a7911-client-ca-bundle\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:25.922035 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.921991    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq6fx\" (UniqueName: \"kubernetes.io/projected/3bcb0b56-642f-4e6f-8da5-ed60182a7911-kube-api-access-wq6fx\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:25.941069 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.941027    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"]
Jul 27 21:35:25.943888 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.943862    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"
Jul 27 21:35:25.947077 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.947054    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 21:35:25.947397 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.947055    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pkfjp\""
Jul 27 21:35:25.955353 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:25.955330    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"]
Jul 27 21:35:26.022816 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.022762    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bcb0b56-642f-4e6f-8da5-ed60182a7911-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.023010 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.022826    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bcb0b56-642f-4e6f-8da5-ed60182a7911-client-ca-bundle\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.023010 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.022873    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7t4c\" (UniqueName: \"kubernetes.io/projected/28231086-8f03-457e-8b9f-b5a311ef79a1-kube-api-access-n7t4c\") pod \"monitoring-plugin-68b7fc9574-4bhl5\" (UID: \"28231086-8f03-457e-8b9f-b5a311ef79a1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"
Jul 27 21:35:26.023010 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.022910    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq6fx\" (UniqueName: \"kubernetes.io/projected/3bcb0b56-642f-4e6f-8da5-ed60182a7911-kube-api-access-wq6fx\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.023010 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.022969    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3bcb0b56-642f-4e6f-8da5-ed60182a7911-secret-metrics-server-tls\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.023010 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.023002    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3bcb0b56-642f-4e6f-8da5-ed60182a7911-secret-metrics-server-client-certs\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.025591 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.023037    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3bcb0b56-642f-4e6f-8da5-ed60182a7911-audit-log\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.025591 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.023068    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28231086-8f03-457e-8b9f-b5a311ef79a1-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4bhl5\" (UID: \"28231086-8f03-457e-8b9f-b5a311ef79a1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"
Jul 27 21:35:26.025591 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.023097    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3bcb0b56-642f-4e6f-8da5-ed60182a7911-metrics-server-audit-profiles\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.025591 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.023587    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bcb0b56-642f-4e6f-8da5-ed60182a7911-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.025591 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.023765    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3bcb0b56-642f-4e6f-8da5-ed60182a7911-audit-log\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.025591 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.024528    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3bcb0b56-642f-4e6f-8da5-ed60182a7911-metrics-server-audit-profiles\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.026483 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.026427    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3bcb0b56-642f-4e6f-8da5-ed60182a7911-secret-metrics-server-tls\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.026483 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.026475    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3bcb0b56-642f-4e6f-8da5-ed60182a7911-secret-metrics-server-client-certs\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.032675 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.032646    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq6fx\" (UniqueName: \"kubernetes.io/projected/3bcb0b56-642f-4e6f-8da5-ed60182a7911-kube-api-access-wq6fx\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.032922 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.032897    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3bcb0b56-642f-4e6f-8da5-ed60182a7911-client-ca-bundle\") pod \"metrics-server-758695c6d5-lp7s4\" (UID: \"3bcb0b56-642f-4e6f-8da5-ed60182a7911\") " pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.098880 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.098794    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:26.124162 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.124127    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28231086-8f03-457e-8b9f-b5a311ef79a1-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4bhl5\" (UID: \"28231086-8f03-457e-8b9f-b5a311ef79a1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"
Jul 27 21:35:26.124362 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.124199    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7t4c\" (UniqueName: \"kubernetes.io/projected/28231086-8f03-457e-8b9f-b5a311ef79a1-kube-api-access-n7t4c\") pod \"monitoring-plugin-68b7fc9574-4bhl5\" (UID: \"28231086-8f03-457e-8b9f-b5a311ef79a1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"
Jul 27 21:35:26.127420 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.127389    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/28231086-8f03-457e-8b9f-b5a311ef79a1-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4bhl5\" (UID: \"28231086-8f03-457e-8b9f-b5a311ef79a1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"
Jul 27 21:35:26.138290 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.138259    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7t4c\" (UniqueName: \"kubernetes.io/projected/28231086-8f03-457e-8b9f-b5a311ef79a1-kube-api-access-n7t4c\") pod \"monitoring-plugin-68b7fc9574-4bhl5\" (UID: \"28231086-8f03-457e-8b9f-b5a311ef79a1\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"
Jul 27 21:35:26.256514 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.256492    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"
Jul 27 21:35:26.333018 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.332965    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rn5vd" event={"ID":"28a84019-3d4c-443b-a262-769a0fb14504","Type":"ContainerStarted","Data":"812c831585b76afc0ce3d94d9d5e1c66146901a292b2db900b4f11759a8fcfdd"}
Jul 27 21:35:26.333198 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.333071    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rn5vd" event={"ID":"28a84019-3d4c-443b-a262-769a0fb14504","Type":"ContainerStarted","Data":"c65720d308e926c2bb426562de4d88567ad66956bc04e45ddabea8488d9c6b10"}
Jul 27 21:35:26.335583 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.335556    2554 generic.go:356] "Generic (PLEG): container finished" podID="0ba6b240-7d7a-4954-881d-a65ca2cda8e2" containerID="4092de2bcc6d995fa0a568a20ca2a531d8711c007e052979d34328a112417242" exitCode=0
Jul 27 21:35:26.335792 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.335770    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ba6b240-7d7a-4954-881d-a65ca2cda8e2","Type":"ContainerDied","Data":"4092de2bcc6d995fa0a568a20ca2a531d8711c007e052979d34328a112417242"}
Jul 27 21:35:26.345322 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.345274    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb" event={"ID":"81c9b1e0-9132-4a93-954f-849cc8834c83","Type":"ContainerStarted","Data":"0093cea68c601b916dc935279ebec23b3d0a9798e5d99e25150d63b04c8dd929"}
Jul 27 21:35:26.345427 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.345351    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb" event={"ID":"81c9b1e0-9132-4a93-954f-849cc8834c83","Type":"ContainerStarted","Data":"8b27e31a23fbe5721682538e9bc4c31b4279a3814d6bdcce6f78de6cc261eb03"}
Jul 27 21:35:26.351641 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.351377    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg" event={"ID":"79c9ce85-03ea-4c4d-97e5-507f77bd9b2f","Type":"ContainerStarted","Data":"11ff341c711dc6aee5a90e21ce76a90276c8444532b299aaf3635b59e384fe73"}
Jul 27 21:35:26.363611 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.363270    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rn5vd" podStartSLOduration=4.374003931 podStartE2EDuration="5.363249306s" totalImagesPullingTime="875.558868ms" totalInitContainerRuntime="113.686507ms" isStatefulPod=true podCreationTimestamp="2026-07-27 21:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:26.360257726 +0000 UTC m=+78.077664209" watchObservedRunningTime="2026-07-27 21:35:26.363249306 +0000 UTC m=+78.080655791"
Jul 27 21:35:26.367013 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.366933    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-758695c6d5-lp7s4"]
Jul 27 21:35:26.417231 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.417120    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-dncpg" podStartSLOduration=3.583267535 podStartE2EDuration="5.417098338s" totalImagesPullingTime="1.833830803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:26.416230116 +0000 UTC m=+78.133636599" watchObservedRunningTime="2026-07-27 21:35:26.417098338 +0000 UTC m=+78.134504822"
Jul 27 21:35:26.445014 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.444981    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"]
Jul 27 21:35:26.449616 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:26.449578    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28231086_8f03_457e_8b9f_b5a311ef79a1.slice/crio-bbedb5ba6db96782efccf783ad64ab7d1783cc4d32223f50f9f6971bbd6598cb WatchSource:0}: Error finding container bbedb5ba6db96782efccf783ad64ab7d1783cc4d32223f50f9f6971bbd6598cb: Status 404 returned error can't find the container with id bbedb5ba6db96782efccf783ad64ab7d1783cc4d32223f50f9f6971bbd6598cb
Jul 27 21:35:26.595265 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.595230    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"]
Jul 27 21:35:26.597960 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.597942    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.600817 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.600764    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 27 21:35:26.601132 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.601113    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 27 21:35:26.601375 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.601360    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 27 21:35:26.601645 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.601629    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 27 21:35:26.601755 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.601681    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 27 21:35:26.601830 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.601814    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ghnvj\""
Jul 27 21:35:26.607295 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.607258    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 27 21:35:26.613503 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.613479    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"]
Jul 27 21:35:26.710846 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.710806    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74f764cb5-hggl2"]
Jul 27 21:35:26.713186 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.713168    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.726276 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.726250    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f764cb5-hggl2"]
Jul 27 21:35:26.730137 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.730110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b59944ea-bbee-49e7-b010-7d9c0dc83b23-serving-certs-ca-bundle\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.730247 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.730141    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-telemeter-client-tls\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.730247 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.730158    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-federate-client-tls\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.730247 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.730175    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.730247 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.730230    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b59944ea-bbee-49e7-b010-7d9c0dc83b23-metrics-client-ca\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.730500 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.730287    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf477\" (UniqueName: \"kubernetes.io/projected/b59944ea-bbee-49e7-b010-7d9c0dc83b23-kube-api-access-vf477\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.730500 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.730325    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-secret-telemeter-client\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.730500 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.730385    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b59944ea-bbee-49e7-b010-7d9c0dc83b23-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.831642 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.831604    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzf75\" (UniqueName: \"kubernetes.io/projected/d42eb892-d480-4d47-9249-541406867308-kube-api-access-dzf75\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.832148 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.831671    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b59944ea-bbee-49e7-b010-7d9c0dc83b23-serving-certs-ca-bundle\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.832148 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.831691    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-trusted-ca-bundle\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.832148 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.831708    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-oauth-serving-cert\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.832148 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.831727    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-telemeter-client-tls\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.832148 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.831743    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-federate-client-tls\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.832148 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.831761    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.832148 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.831911    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b59944ea-bbee-49e7-b010-7d9c0dc83b23-metrics-client-ca\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.832148 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.832072    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf477\" (UniqueName: \"kubernetes.io/projected/b59944ea-bbee-49e7-b010-7d9c0dc83b23-kube-api-access-vf477\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.832718 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.832469    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-oauth-config\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.832718 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.832534    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b59944ea-bbee-49e7-b010-7d9c0dc83b23-serving-certs-ca-bundle\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.832718 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.832516    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-console-config\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.832718 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.832588    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b59944ea-bbee-49e7-b010-7d9c0dc83b23-metrics-client-ca\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.832718 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.832601    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-service-ca\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.832718 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.832685    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-serving-cert\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.833029 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.832797    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-secret-telemeter-client\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.833029 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.832853    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b59944ea-bbee-49e7-b010-7d9c0dc83b23-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.834084 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.834057    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b59944ea-bbee-49e7-b010-7d9c0dc83b23-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.834763 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.834737    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-federate-client-tls\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.834931 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.834914    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-telemeter-client-tls\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.835075 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.835058    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.835543 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.835528    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b59944ea-bbee-49e7-b010-7d9c0dc83b23-secret-telemeter-client\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.841365 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.841342    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf477\" (UniqueName: \"kubernetes.io/projected/b59944ea-bbee-49e7-b010-7d9c0dc83b23-kube-api-access-vf477\") pod \"telemeter-client-66ffb64fb9-lx48v\" (UID: \"b59944ea-bbee-49e7-b010-7d9c0dc83b23\") " pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.910288 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.910208    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"
Jul 27 21:35:26.934069 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.934033    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzf75\" (UniqueName: \"kubernetes.io/projected/d42eb892-d480-4d47-9249-541406867308-kube-api-access-dzf75\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.934218 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.934120    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-trusted-ca-bundle\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.934218 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.934144    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-oauth-serving-cert\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.934218 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.934191    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-oauth-config\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.934218 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.934215    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-console-config\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.934421 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.934245    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-service-ca\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.934421 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.934273    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-serving-cert\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.937175 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.935207    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-oauth-serving-cert\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.937175 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.936280    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-trusted-ca-bundle\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.937175 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.936834    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-console-config\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.937759 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.937718    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-service-ca\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.940104 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.940083    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-oauth-config\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.940995 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.940954    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-serving-cert\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:26.945270 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:26.945242    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzf75\" (UniqueName: \"kubernetes.io/projected/d42eb892-d480-4d47-9249-541406867308-kube-api-access-dzf75\") pod \"console-74f764cb5-hggl2\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") " pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:27.021832 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.021800    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:27.107948 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.107852    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66ffb64fb9-lx48v"]
Jul 27 21:35:27.120247 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:35:27.117134    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59944ea_bbee_49e7_b010_7d9c0dc83b23.slice/crio-50e681146ec113b4948e2c27540a64a2bf3185649f6aa98217f0d8dffc438cdd WatchSource:0}: Error finding container 50e681146ec113b4948e2c27540a64a2bf3185649f6aa98217f0d8dffc438cdd: Status 404 returned error can't find the container with id 50e681146ec113b4948e2c27540a64a2bf3185649f6aa98217f0d8dffc438cdd
Jul 27 21:35:27.240445 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.240046    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f764cb5-hggl2"]
Jul 27 21:35:27.360494 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.360418    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4" event={"ID":"3bcb0b56-642f-4e6f-8da5-ed60182a7911","Type":"ContainerStarted","Data":"4d41f37e4b4deb478c230c4c6e2840156270af1822f44f5ed460b3aff1b213ba"}
Jul 27 21:35:27.363620 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.363588    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb" event={"ID":"81c9b1e0-9132-4a93-954f-849cc8834c83","Type":"ContainerStarted","Data":"55881f834b749a31904c872eceb0e2b6f4f3f33e314250b9a1532a84272b3a3b"}
Jul 27 21:35:27.368368 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.368336    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj" event={"ID":"2fa2aa24-829e-4f80-bfdf-ace703d93a02","Type":"ContainerStarted","Data":"1d1a801ab1c0481cbe6ae0105ba03b1dce0f35485fe6d24b6caeb36324dd978f"}
Jul 27 21:35:27.368529 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.368416    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj" event={"ID":"2fa2aa24-829e-4f80-bfdf-ace703d93a02","Type":"ContainerStarted","Data":"c47bf2dde6c8758ca10197bbdeddcbdbf195a0aada1660266a580d221cabcc76"}
Jul 27 21:35:27.368529 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.368491    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj" event={"ID":"2fa2aa24-829e-4f80-bfdf-ace703d93a02","Type":"ContainerStarted","Data":"09c0bca8306e9b458b16d7ce41fb953ccb1df7d4cae9615e909209387642ef14"}
Jul 27 21:35:27.370778 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.370723    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5" event={"ID":"28231086-8f03-457e-8b9f-b5a311ef79a1","Type":"ContainerStarted","Data":"bbedb5ba6db96782efccf783ad64ab7d1783cc4d32223f50f9f6971bbd6598cb"}
Jul 27 21:35:27.373529 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.373502    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v" event={"ID":"b59944ea-bbee-49e7-b010-7d9c0dc83b23","Type":"ContainerStarted","Data":"50e681146ec113b4948e2c27540a64a2bf3185649f6aa98217f0d8dffc438cdd"}
Jul 27 21:35:27.388011 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.386978    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8xwb" podStartSLOduration=4.422752675 podStartE2EDuration="6.386956101s" totalImagesPullingTime="1.964203426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:27.385849281 +0000 UTC m=+79.103255764" watchObservedRunningTime="2026-07-27 21:35:27.386956101 +0000 UTC m=+79.104362584"
Jul 27 21:35:27.636181 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.636148    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:35:27.643235 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.641971    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.650838 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.647141    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 21:35:27.650838 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.648415    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 21:35:27.650838 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.648721    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 21:35:27.650838 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.648977    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vmg4n\""
Jul 27 21:35:27.650838 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.649180    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 21:35:27.650838 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.649202    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 21:35:27.650838 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.649397    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 21:35:27.650838 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.649467    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 21:35:27.650838 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.650023    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 21:35:27.651466 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.651417    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 21:35:27.651834 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.651813    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c1adu9vi3iec1\""
Jul 27 21:35:27.651990 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.651962    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 21:35:27.653180 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.652106    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 21:35:27.653180 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.652248    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 21:35:27.653180 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.653049    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 21:35:27.657472 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.657303    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 21:35:27.664150 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.664117    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:35:27.748362 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748323    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748569 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748370    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748569 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748414    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748569 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748467    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748569 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748501    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce606690-6dc8-4de7-b869-520c34bc1069-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748569 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748525    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-web-config\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748569 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748552    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce606690-6dc8-4de7-b869-520c34bc1069-config-out\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748875 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748576    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748875 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748603    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748875 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748626    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748875 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748669    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748875 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748697    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748875 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748755    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-config\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748875 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748778    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748875 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748801    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748875 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748825    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.748875 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748864    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.749401 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748893    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.749401 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748917    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgnxs\" (UniqueName: \"kubernetes.io/projected/ce606690-6dc8-4de7-b869-520c34bc1069-kube-api-access-kgnxs\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.749401 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.748948    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849493 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849453    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849512    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce606690-6dc8-4de7-b869-520c34bc1069-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849539    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-web-config\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849562    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce606690-6dc8-4de7-b869-520c34bc1069-config-out\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849584    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849611    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849637    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849681    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849707    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849765    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-config\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849791    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849817    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849838    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849872    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849911    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849934    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgnxs\" (UniqueName: \"kubernetes.io/projected/ce606690-6dc8-4de7-b869-520c34bc1069-kube-api-access-kgnxs\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.849974 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.849960    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.850596 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.850017    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.850596 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.850042    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.850596 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.850085    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.850596 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.850397    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.850808 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.850787    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.851035 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.851013    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.852382 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.852050    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.852382 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.852050    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.852576 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.852555    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.856131 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.856101    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.856634 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.856509    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-config\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.857064 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.857042    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.857282 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.857234    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce606690-6dc8-4de7-b869-520c34bc1069-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.858063 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.858036    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.858328 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.858308    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ce606690-6dc8-4de7-b869-520c34bc1069-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.859163 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.859094    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.859917 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.859653    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgnxs\" (UniqueName: \"kubernetes.io/projected/ce606690-6dc8-4de7-b869-520c34bc1069-kube-api-access-kgnxs\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.859917 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.859874    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.860204 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.860181    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce606690-6dc8-4de7-b869-520c34bc1069-config-out\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.860537 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.860515    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.860618 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.860534    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.860815 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.860789    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-web-config\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.861314 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.861292    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce606690-6dc8-4de7-b869-520c34bc1069-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ce606690-6dc8-4de7-b869-520c34bc1069\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:27.968394 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:27.968028    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:28.381129 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:28.380912    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f764cb5-hggl2" event={"ID":"d42eb892-d480-4d47-9249-541406867308","Type":"ContainerStarted","Data":"a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1"}
Jul 27 21:35:28.381129 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:28.381009    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f764cb5-hggl2" event={"ID":"d42eb892-d480-4d47-9249-541406867308","Type":"ContainerStarted","Data":"c820aeea07b390d26356cc281dcb837c0f12327e4536250a6b214f7bd3c095c0"}
Jul 27 21:35:28.385742 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:28.385710    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj" event={"ID":"2fa2aa24-829e-4f80-bfdf-ace703d93a02","Type":"ContainerStarted","Data":"cec9bcf0237b1381ab5dd563f2ccae03fb294b70d8822bd8778e1c443ade62f0"}
Jul 27 21:35:28.385843 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:28.385786    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj" event={"ID":"2fa2aa24-829e-4f80-bfdf-ace703d93a02","Type":"ContainerStarted","Data":"2c17ce2578f4efd74e54fca32e243615100e6e8f602d4a69209b85c9078ae8aa"}
Jul 27 21:35:28.385843 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:28.385823    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj" event={"ID":"2fa2aa24-829e-4f80-bfdf-ace703d93a02","Type":"ContainerStarted","Data":"bb22bd0f8ecee150502a3af3d25fffd471639ce8d63b2e70ce2caab8dbd9893c"}
Jul 27 21:35:28.386709 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:28.385980    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:28.402052 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:28.401990    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74f764cb5-hggl2" podStartSLOduration=2.401974183 podStartE2EDuration="2.401974183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:28.401110592 +0000 UTC m=+80.118517075" watchObservedRunningTime="2026-07-27 21:35:28.401974183 +0000 UTC m=+80.119380664"
Jul 27 21:35:28.428564 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:28.428504    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj" podStartSLOduration=2.02409562 podStartE2EDuration="5.42848152s" totalImagesPullingTime="3.4043859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:28.425740821 +0000 UTC m=+80.143147304" watchObservedRunningTime="2026-07-27 21:35:28.42848152 +0000 UTC m=+80.145888003"
Jul 27 21:35:29.391131 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:29.390500    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 21:35:29.397079 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:29.396393    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ba6b240-7d7a-4954-881d-a65ca2cda8e2","Type":"ContainerStarted","Data":"c8931e4d6a07d596839a11b739f0a68a3b293e071881d36b7864d46c84568d5a"}
Jul 27 21:35:29.401068 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:29.398736    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5" event={"ID":"28231086-8f03-457e-8b9f-b5a311ef79a1","Type":"ContainerStarted","Data":"e59e34db01f1212682cfc1d749f423f212a28389db4a86aee26caef2aa986d78"}
Jul 27 21:35:29.401068 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:29.400255    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"
Jul 27 21:35:29.409955 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:29.409135    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5"
Jul 27 21:35:29.412148 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:29.411992    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4" event={"ID":"3bcb0b56-642f-4e6f-8da5-ed60182a7911","Type":"ContainerStarted","Data":"f31756d667f3a5d8962963e4d27089ce81e4018ba8d0a2f20cff9b2c623a16b1"}
Jul 27 21:35:29.461520 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:29.461466    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4" podStartSLOduration=1.626052859 podStartE2EDuration="4.461409741s" totalImagesPullingTime="2.835356882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:29.459162915 +0000 UTC m=+81.176569399" watchObservedRunningTime="2026-07-27 21:35:29.461409741 +0000 UTC m=+81.178816224"
Jul 27 21:35:29.461632 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:29.461592    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4bhl5" podStartSLOduration=1.699493492 podStartE2EDuration="4.46158451s" totalImagesPullingTime="2.762091018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:29.428759465 +0000 UTC m=+81.146165947" watchObservedRunningTime="2026-07-27 21:35:29.46158451 +0000 UTC m=+81.178990999"
Jul 27 21:35:30.417910 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.417813    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v" event={"ID":"b59944ea-bbee-49e7-b010-7d9c0dc83b23","Type":"ContainerStarted","Data":"ce63cd8143fdbd552e7c6a70d8f85dfad3037f790e508de07e4450f0df2fc5f7"}
Jul 27 21:35:30.417910 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.417889    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v" event={"ID":"b59944ea-bbee-49e7-b010-7d9c0dc83b23","Type":"ContainerStarted","Data":"72ab17cab0f057aff6015ff3e90e2a423049c91ab473501cef1cf6faaca4c08a"}
Jul 27 21:35:30.418354 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.417925    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v" event={"ID":"b59944ea-bbee-49e7-b010-7d9c0dc83b23","Type":"ContainerStarted","Data":"8d3b0b74ff3055b43d0ba21e14abafd3af3217524d38d704402f81c3c014d0de"}
Jul 27 21:35:30.419488 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.419460    2554 generic.go:356] "Generic (PLEG): container finished" podID="ce606690-6dc8-4de7-b869-520c34bc1069" containerID="067be09fac1b4c1a6f9c04dc4c8bfe0ce828a85ce4ed7402ea789c007abbe89b" exitCode=0
Jul 27 21:35:30.419607 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.419547    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce606690-6dc8-4de7-b869-520c34bc1069","Type":"ContainerDied","Data":"067be09fac1b4c1a6f9c04dc4c8bfe0ce828a85ce4ed7402ea789c007abbe89b"}
Jul 27 21:35:30.419607 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.419591    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce606690-6dc8-4de7-b869-520c34bc1069","Type":"ContainerStarted","Data":"b432f9d85b899a0493b0b0635bae8ecf77bf59f577c475e1a37beaf88f93c8fb"}
Jul 27 21:35:30.423305 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.423278    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ba6b240-7d7a-4954-881d-a65ca2cda8e2","Type":"ContainerStarted","Data":"73d86b356e351ef469e4931abe680f762d699d7cb4a190de8a24494650ac5212"}
Jul 27 21:35:30.423407 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.423340    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ba6b240-7d7a-4954-881d-a65ca2cda8e2","Type":"ContainerStarted","Data":"fded39768a23fee56ab1bdeb9f43583780feb1fc1fa0c2abb7c6b21854156634"}
Jul 27 21:35:30.423407 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.423376    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ba6b240-7d7a-4954-881d-a65ca2cda8e2","Type":"ContainerStarted","Data":"0c49e699e5187b59c06323965a78697155a789f61954ec5cd439e7e5ed06bfc3"}
Jul 27 21:35:30.423407 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.423402    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ba6b240-7d7a-4954-881d-a65ca2cda8e2","Type":"ContainerStarted","Data":"280dc4b1be116582a1b4c746103b7d78aafcde03a54946f8f2dd0c59bcf7f2b3"}
Jul 27 21:35:30.423584 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.423459    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ba6b240-7d7a-4954-881d-a65ca2cda8e2","Type":"ContainerStarted","Data":"af9ff9e8fa9901fdcf5c6f59a3290d4f3cf1d9d472e75c4e88b2f5e7be890db2"}
Jul 27 21:35:30.445852 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.445710    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66ffb64fb9-lx48v" podStartSLOduration=1.513511788 podStartE2EDuration="4.445690078s" totalImagesPullingTime="2.93217829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:30.444268281 +0000 UTC m=+82.161674762" watchObservedRunningTime="2026-07-27 21:35:30.445690078 +0000 UTC m=+82.163096560"
Jul 27 21:35:30.478720 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:30.478661    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.661901006 podStartE2EDuration="8.478640157s" totalImagesPullingTime="4.795048604s" totalInitContainerRuntime="21.690547ms" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:30.477812996 +0000 UTC m=+82.195219478" watchObservedRunningTime="2026-07-27 21:35:30.478640157 +0000 UTC m=+82.196046636"
Jul 27 21:35:31.250449 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:31.250390    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f764cb5-hggl2"]
Jul 27 21:35:34.419544 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:34.419515    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8fb987ffb-wv8wj"
Jul 27 21:35:34.448776 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:34.448734    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce606690-6dc8-4de7-b869-520c34bc1069","Type":"ContainerStarted","Data":"934b6302c1a224ee1c32c1b83306178895f042708b07622ce80b8be0040a2cdb"}
Jul 27 21:35:34.448959 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:34.448817    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce606690-6dc8-4de7-b869-520c34bc1069","Type":"ContainerStarted","Data":"a46c3695ba04d74227ec0c73c4033e8dfc84fd059b95f3cf35982321ee77c3a9"}
Jul 27 21:35:34.448959 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:34.448914    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce606690-6dc8-4de7-b869-520c34bc1069","Type":"ContainerStarted","Data":"c03c6624a7968a9a5ab76e37d7068f051c748fc6783665c108474cb84d246180"}
Jul 27 21:35:34.448959 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:34.448945    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce606690-6dc8-4de7-b869-520c34bc1069","Type":"ContainerStarted","Data":"1a5eadc916c1e14585029d1d3fc84ab28f75d52322299004ff4c04999cd688cb"}
Jul 27 21:35:34.449186 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:34.448992    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce606690-6dc8-4de7-b869-520c34bc1069","Type":"ContainerStarted","Data":"b3ebc59d480b41c80bdc0b77203413bc6198b8bd9dd04f076c358ac0256ecd05"}
Jul 27 21:35:35.457814 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:35.457775    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce606690-6dc8-4de7-b869-520c34bc1069","Type":"ContainerStarted","Data":"7cc66b147328f801557ef95c0512cccc819fabaf922ed636bcbd7267e54aebe5"}
Jul 27 21:35:35.496881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:35.496821    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.8829181219999995 podStartE2EDuration="8.496799211s" totalImagesPullingTime="3.590468457s" totalInitContainerRuntime="23.412632ms" isStatefulPod=false podCreationTimestamp="2026-07-27 21:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:35:35.494291174 +0000 UTC m=+87.211697659" watchObservedRunningTime="2026-07-27 21:35:35.496799211 +0000 UTC m=+87.214205699"
Jul 27 21:35:37.023007 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:37.022967    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:37.969181 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:37.969152    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:35:42.348026 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:42.347988    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b4995896-v72j5"]
Jul 27 21:35:46.099172 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:46.099131    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:46.099589 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:46.099197    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:35:50.340542 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:50.340456    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8d6f7f955-s7frl" podUID="7020a7d3-bc57-4e9b-91d6-79155a60ab7f" containerName="console" containerID="cri-o://860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f" gracePeriod=15
Jul 27 21:35:51.143125 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.143083    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:51.187999 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.187966    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-service-ca\") pod \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") "
Jul 27 21:35:51.187999 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.188000    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-config\") pod \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") "
Jul 27 21:35:51.188206 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.188032    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8l57\" (UniqueName: \"kubernetes.io/projected/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-kube-api-access-f8l57\") pod \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") "
Jul 27 21:35:51.188206 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.188111    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-serving-cert\") pod \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") "
Jul 27 21:35:51.188206 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.188145    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-oauth-serving-cert\") pod \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") "
Jul 27 21:35:51.188206 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.188174    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-oauth-config\") pod \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\" (UID: \"7020a7d3-bc57-4e9b-91d6-79155a60ab7f\") "
Jul 27 21:35:51.188417 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.188390    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-config" (OuterVolumeSpecName: "console-config") pod "7020a7d3-bc57-4e9b-91d6-79155a60ab7f" (UID: "7020a7d3-bc57-4e9b-91d6-79155a60ab7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:35:51.188513 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.188489    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-config\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:51.188513 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.188495    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "7020a7d3-bc57-4e9b-91d6-79155a60ab7f" (UID: "7020a7d3-bc57-4e9b-91d6-79155a60ab7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:35:51.188672 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.188648    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7020a7d3-bc57-4e9b-91d6-79155a60ab7f" (UID: "7020a7d3-bc57-4e9b-91d6-79155a60ab7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:35:51.190811 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.190778    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7020a7d3-bc57-4e9b-91d6-79155a60ab7f" (UID: "7020a7d3-bc57-4e9b-91d6-79155a60ab7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:35:51.190929 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.190866    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-kube-api-access-f8l57" (OuterVolumeSpecName: "kube-api-access-f8l57") pod "7020a7d3-bc57-4e9b-91d6-79155a60ab7f" (UID: "7020a7d3-bc57-4e9b-91d6-79155a60ab7f"). InnerVolumeSpecName "kube-api-access-f8l57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:35:51.191004 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.190975    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7020a7d3-bc57-4e9b-91d6-79155a60ab7f" (UID: "7020a7d3-bc57-4e9b-91d6-79155a60ab7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:35:51.289960 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.289876    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:51.289960 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.289904    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8l57\" (UniqueName: \"kubernetes.io/projected/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-kube-api-access-f8l57\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:51.289960 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.289914    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-serving-cert\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:51.289960 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.289923    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-oauth-serving-cert\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:51.289960 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.289932    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7020a7d3-bc57-4e9b-91d6-79155a60ab7f-console-oauth-config\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:51.530182 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.530146    2554 generic.go:356] "Generic (PLEG): container finished" podID="7020a7d3-bc57-4e9b-91d6-79155a60ab7f" containerID="860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f" exitCode=0
Jul 27 21:35:51.530609 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.530191    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d6f7f955-s7frl"
Jul 27 21:35:51.530609 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.530226    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d6f7f955-s7frl" event={"ID":"7020a7d3-bc57-4e9b-91d6-79155a60ab7f","Type":"ContainerDied","Data":"860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f"}
Jul 27 21:35:51.530609 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.530274    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d6f7f955-s7frl" event={"ID":"7020a7d3-bc57-4e9b-91d6-79155a60ab7f","Type":"ContainerDied","Data":"ebc6ee1edc73a97b777d884766ee9f4c04f1ca29d3a87e02c42cd6f290aa1c5b"}
Jul 27 21:35:51.530609 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.530295    2554 scope.go:117] "RemoveContainer" containerID="860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f"
Jul 27 21:35:51.544533 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.544515    2554 scope.go:117] "RemoveContainer" containerID="860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f"
Jul 27 21:35:51.544854 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:51.544835    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f\": container with ID starting with 860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f not found: ID does not exist" containerID="860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f"
Jul 27 21:35:51.544904 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.544863    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f"} err="failed to get container status \"860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f\": rpc error: code = NotFound desc = could not find container \"860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f\": container with ID starting with 860df550c929861bdd5282fd1d5bbebb35caac5e85c173fce0d2db02d03bfd6f not found: ID does not exist"
Jul 27 21:35:51.559681 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.559650    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8d6f7f955-s7frl"]
Jul 27 21:35:51.563605 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:51.563581    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8d6f7f955-s7frl"]
Jul 27 21:35:52.919961 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:52.919928    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7020a7d3-bc57-4e9b-91d6-79155a60ab7f" path="/var/lib/kubelet/pods/7020a7d3-bc57-4e9b-91d6-79155a60ab7f/volumes"
Jul 27 21:35:56.273225 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.273181    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74f764cb5-hggl2" podUID="d42eb892-d480-4d47-9249-541406867308" containerName="console" containerID="cri-o://a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1" gracePeriod=15
Jul 27 21:35:56.355885 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.355855    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zrv6d"
Jul 27 21:35:56.551896 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.551855    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:56.553880 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.553843    2554 generic.go:356] "Generic (PLEG): container finished" podID="d42eb892-d480-4d47-9249-541406867308" containerID="a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1" exitCode=0
Jul 27 21:35:56.554008 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.553886    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f764cb5-hggl2"
Jul 27 21:35:56.554008 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.553930    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f764cb5-hggl2" event={"ID":"d42eb892-d480-4d47-9249-541406867308","Type":"ContainerDied","Data":"a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1"}
Jul 27 21:35:56.554008 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.553984    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f764cb5-hggl2" event={"ID":"d42eb892-d480-4d47-9249-541406867308","Type":"ContainerDied","Data":"c820aeea07b390d26356cc281dcb837c0f12327e4536250a6b214f7bd3c095c0"}
Jul 27 21:35:56.554008 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.554006    2554 scope.go:117] "RemoveContainer" containerID="a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1"
Jul 27 21:35:56.571854 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.571834    2554 scope.go:117] "RemoveContainer" containerID="a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1"
Jul 27 21:35:56.572189 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:35:56.572159    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1\": container with ID starting with a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1 not found: ID does not exist" containerID="a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1"
Jul 27 21:35:56.572253 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.572191    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1"} err="failed to get container status \"a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1\": rpc error: code = NotFound desc = could not find container \"a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1\": container with ID starting with a87de5cdb0b366193a5190d4a310ee64273578b565e955361f9c8977befbbff1 not found: ID does not exist"
Jul 27 21:35:56.638424 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.638387    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-service-ca\") pod \"d42eb892-d480-4d47-9249-541406867308\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") "
Jul 27 21:35:56.638424 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.638429    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzf75\" (UniqueName: \"kubernetes.io/projected/d42eb892-d480-4d47-9249-541406867308-kube-api-access-dzf75\") pod \"d42eb892-d480-4d47-9249-541406867308\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") "
Jul 27 21:35:56.638691 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.638476    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-trusted-ca-bundle\") pod \"d42eb892-d480-4d47-9249-541406867308\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") "
Jul 27 21:35:56.638691 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.638511    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-oauth-config\") pod \"d42eb892-d480-4d47-9249-541406867308\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") "
Jul 27 21:35:56.638691 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.638544    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-serving-cert\") pod \"d42eb892-d480-4d47-9249-541406867308\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") "
Jul 27 21:35:56.638691 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.638609    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-console-config\") pod \"d42eb892-d480-4d47-9249-541406867308\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") "
Jul 27 21:35:56.638691 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.638634    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-oauth-serving-cert\") pod \"d42eb892-d480-4d47-9249-541406867308\" (UID: \"d42eb892-d480-4d47-9249-541406867308\") "
Jul 27 21:35:56.638953 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.638926    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d42eb892-d480-4d47-9249-541406867308" (UID: "d42eb892-d480-4d47-9249-541406867308"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:35:56.639012 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.638960    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-service-ca" (OuterVolumeSpecName: "service-ca") pod "d42eb892-d480-4d47-9249-541406867308" (UID: "d42eb892-d480-4d47-9249-541406867308"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:35:56.639089 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.639051    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-console-config" (OuterVolumeSpecName: "console-config") pod "d42eb892-d480-4d47-9249-541406867308" (UID: "d42eb892-d480-4d47-9249-541406867308"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:35:56.639136 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.639121    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d42eb892-d480-4d47-9249-541406867308" (UID: "d42eb892-d480-4d47-9249-541406867308"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:35:56.640933 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.640902    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d42eb892-d480-4d47-9249-541406867308" (UID: "d42eb892-d480-4d47-9249-541406867308"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:35:56.641246 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.641231    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d42eb892-d480-4d47-9249-541406867308" (UID: "d42eb892-d480-4d47-9249-541406867308"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:35:56.641388 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.641365    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42eb892-d480-4d47-9249-541406867308-kube-api-access-dzf75" (OuterVolumeSpecName: "kube-api-access-dzf75") pod "d42eb892-d480-4d47-9249-541406867308" (UID: "d42eb892-d480-4d47-9249-541406867308"). InnerVolumeSpecName "kube-api-access-dzf75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:35:56.740140 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.740103    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-console-config\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.740140 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.740131    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-oauth-serving-cert\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.740140 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.740141    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.740140 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.740150    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzf75\" (UniqueName: \"kubernetes.io/projected/d42eb892-d480-4d47-9249-541406867308-kube-api-access-dzf75\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.740399 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.740159    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d42eb892-d480-4d47-9249-541406867308-trusted-ca-bundle\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.740399 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.740168    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-oauth-config\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.740399 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.740176    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d42eb892-d480-4d47-9249-541406867308-console-serving-cert\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:35:56.877593 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.877559    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f764cb5-hggl2"]
Jul 27 21:35:56.880594 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.880557    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74f764cb5-hggl2"]
Jul 27 21:35:56.920613 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:35:56.920580    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42eb892-d480-4d47-9249-541406867308" path="/var/lib/kubelet/pods/d42eb892-d480-4d47-9249-541406867308/volumes"
Jul 27 21:36:06.104849 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:06.104818    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:36:06.109713 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:06.109686    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-758695c6d5-lp7s4"
Jul 27 21:36:07.370849 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.370808    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b4995896-v72j5" podUID="47fd7ed9-a023-4b38-b133-6c0949f66713" containerName="console" containerID="cri-o://1e0b27e20d9f54f189727a430f3706dd51991af52c3b8e1f3d2f32c8a6b90e12" gracePeriod=15
Jul 27 21:36:07.606063 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.606037    2554 generic.go:356] "Generic (PLEG): container finished" podID="47fd7ed9-a023-4b38-b133-6c0949f66713" containerID="1e0b27e20d9f54f189727a430f3706dd51991af52c3b8e1f3d2f32c8a6b90e12" exitCode=0
Jul 27 21:36:07.606173 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.606111    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4995896-v72j5" event={"ID":"47fd7ed9-a023-4b38-b133-6c0949f66713","Type":"ContainerDied","Data":"1e0b27e20d9f54f189727a430f3706dd51991af52c3b8e1f3d2f32c8a6b90e12"}
Jul 27 21:36:07.606173 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.606161    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b4995896-v72j5" event={"ID":"47fd7ed9-a023-4b38-b133-6c0949f66713","Type":"ContainerDied","Data":"9dc5ca02f6952beb9e29b8061e367cdcdee01281a8a4b50c70650959d61cdf01"}
Jul 27 21:36:07.606243 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.606176    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9dc5ca02f6952beb9e29b8061e367cdcdee01281a8a4b50c70650959d61cdf01"
Jul 27 21:36:07.617845 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.617823    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:36:07.745198 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.745168    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-serving-cert\") pod \"47fd7ed9-a023-4b38-b133-6c0949f66713\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") "
Jul 27 21:36:07.745392 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.745206    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-trusted-ca-bundle\") pod \"47fd7ed9-a023-4b38-b133-6c0949f66713\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") "
Jul 27 21:36:07.745392 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.745230    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-oauth-config\") pod \"47fd7ed9-a023-4b38-b133-6c0949f66713\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") "
Jul 27 21:36:07.745392 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.745251    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-console-config\") pod \"47fd7ed9-a023-4b38-b133-6c0949f66713\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") "
Jul 27 21:36:07.745392 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.745286    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mt62\" (UniqueName: \"kubernetes.io/projected/47fd7ed9-a023-4b38-b133-6c0949f66713-kube-api-access-6mt62\") pod \"47fd7ed9-a023-4b38-b133-6c0949f66713\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") "
Jul 27 21:36:07.745392 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.745324    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-service-ca\") pod \"47fd7ed9-a023-4b38-b133-6c0949f66713\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") "
Jul 27 21:36:07.745392 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.745344    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-oauth-serving-cert\") pod \"47fd7ed9-a023-4b38-b133-6c0949f66713\" (UID: \"47fd7ed9-a023-4b38-b133-6c0949f66713\") "
Jul 27 21:36:07.745855 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.745821    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-service-ca" (OuterVolumeSpecName: "service-ca") pod "47fd7ed9-a023-4b38-b133-6c0949f66713" (UID: "47fd7ed9-a023-4b38-b133-6c0949f66713"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:36:07.745855 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.745831    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-console-config" (OuterVolumeSpecName: "console-config") pod "47fd7ed9-a023-4b38-b133-6c0949f66713" (UID: "47fd7ed9-a023-4b38-b133-6c0949f66713"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:36:07.746009 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.745850    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "47fd7ed9-a023-4b38-b133-6c0949f66713" (UID: "47fd7ed9-a023-4b38-b133-6c0949f66713"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:36:07.746009 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.745881    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "47fd7ed9-a023-4b38-b133-6c0949f66713" (UID: "47fd7ed9-a023-4b38-b133-6c0949f66713"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:36:07.747753 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.747731    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47fd7ed9-a023-4b38-b133-6c0949f66713-kube-api-access-6mt62" (OuterVolumeSpecName: "kube-api-access-6mt62") pod "47fd7ed9-a023-4b38-b133-6c0949f66713" (UID: "47fd7ed9-a023-4b38-b133-6c0949f66713"). InnerVolumeSpecName "kube-api-access-6mt62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:36:07.747753 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.747739    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "47fd7ed9-a023-4b38-b133-6c0949f66713" (UID: "47fd7ed9-a023-4b38-b133-6c0949f66713"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:36:07.747907 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.747799    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "47fd7ed9-a023-4b38-b133-6c0949f66713" (UID: "47fd7ed9-a023-4b38-b133-6c0949f66713"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:36:07.846158 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.846116    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mt62\" (UniqueName: \"kubernetes.io/projected/47fd7ed9-a023-4b38-b133-6c0949f66713-kube-api-access-6mt62\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:36:07.846158 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.846147    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:36:07.846158 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.846155    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-oauth-serving-cert\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:36:07.846158 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.846164    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-serving-cert\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:36:07.846158 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.846173    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-trusted-ca-bundle\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:36:07.846504 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.846182    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47fd7ed9-a023-4b38-b133-6c0949f66713-console-oauth-config\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:36:07.846504 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:07.846191    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47fd7ed9-a023-4b38-b133-6c0949f66713-console-config\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:36:08.609993 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:08.609950    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b4995896-v72j5"
Jul 27 21:36:08.632342 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:08.632309    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b4995896-v72j5"]
Jul 27 21:36:08.637523 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:08.637498    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b4995896-v72j5"]
Jul 27 21:36:08.921629 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:08.921553    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47fd7ed9-a023-4b38-b133-6c0949f66713" path="/var/lib/kubelet/pods/47fd7ed9-a023-4b38-b133-6c0949f66713/volumes"
Jul 27 21:36:27.968808 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:27.968761    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:36:27.991447 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:27.991399    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:36:28.716545 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:36:28.716517    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 21:38:21.276167 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.276131    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tbgdt"]
Jul 27 21:38:21.276710 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.276487    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7020a7d3-bc57-4e9b-91d6-79155a60ab7f" containerName="console"
Jul 27 21:38:21.276710 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.276498    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7020a7d3-bc57-4e9b-91d6-79155a60ab7f" containerName="console"
Jul 27 21:38:21.276710 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.276505    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42eb892-d480-4d47-9249-541406867308" containerName="console"
Jul 27 21:38:21.276710 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.276510    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42eb892-d480-4d47-9249-541406867308" containerName="console"
Jul 27 21:38:21.276710 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.276525    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47fd7ed9-a023-4b38-b133-6c0949f66713" containerName="console"
Jul 27 21:38:21.276710 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.276530    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="47fd7ed9-a023-4b38-b133-6c0949f66713" containerName="console"
Jul 27 21:38:21.276710 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.276581    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="47fd7ed9-a023-4b38-b133-6c0949f66713" containerName="console"
Jul 27 21:38:21.276710 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.276587    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7020a7d3-bc57-4e9b-91d6-79155a60ab7f" containerName="console"
Jul 27 21:38:21.276710 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.276598    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42eb892-d480-4d47-9249-541406867308" containerName="console"
Jul 27 21:38:21.280757 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.280739    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt"
Jul 27 21:38:21.283567 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.283532    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 21:38:21.283567 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.283565    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 21:38:21.283748 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.283677    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ls7zc\""
Jul 27 21:38:21.290649 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.290627    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tbgdt"]
Jul 27 21:38:21.333846 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.333808    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d652c340-2e24-4c7d-b04e-505a3b378a11-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tbgdt\" (UID: \"d652c340-2e24-4c7d-b04e-505a3b378a11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt"
Jul 27 21:38:21.334036 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.333870    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqb4s\" (UniqueName: \"kubernetes.io/projected/d652c340-2e24-4c7d-b04e-505a3b378a11-kube-api-access-mqb4s\") pod \"cert-manager-webhook-6486ffd997-tbgdt\" (UID: \"d652c340-2e24-4c7d-b04e-505a3b378a11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt"
Jul 27 21:38:21.434498 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.434458    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqb4s\" (UniqueName: \"kubernetes.io/projected/d652c340-2e24-4c7d-b04e-505a3b378a11-kube-api-access-mqb4s\") pod \"cert-manager-webhook-6486ffd997-tbgdt\" (UID: \"d652c340-2e24-4c7d-b04e-505a3b378a11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt"
Jul 27 21:38:21.434673 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.434540    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d652c340-2e24-4c7d-b04e-505a3b378a11-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tbgdt\" (UID: \"d652c340-2e24-4c7d-b04e-505a3b378a11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt"
Jul 27 21:38:21.443645 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.443610    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d652c340-2e24-4c7d-b04e-505a3b378a11-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tbgdt\" (UID: \"d652c340-2e24-4c7d-b04e-505a3b378a11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt"
Jul 27 21:38:21.443763 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.443732    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqb4s\" (UniqueName: \"kubernetes.io/projected/d652c340-2e24-4c7d-b04e-505a3b378a11-kube-api-access-mqb4s\") pod \"cert-manager-webhook-6486ffd997-tbgdt\" (UID: \"d652c340-2e24-4c7d-b04e-505a3b378a11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt"
Jul 27 21:38:21.600291 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.600190    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt"
Jul 27 21:38:21.750284 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:21.750216    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tbgdt"]
Jul 27 21:38:21.754330 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:38:21.754302    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd652c340_2e24_4c7d_b04e_505a3b378a11.slice/crio-c8e995d68de9ee248c51fb7bb65d2ccc0c1e72e1023e26846fbc020fa43a912c WatchSource:0}: Error finding container c8e995d68de9ee248c51fb7bb65d2ccc0c1e72e1023e26846fbc020fa43a912c: Status 404 returned error can't find the container with id c8e995d68de9ee248c51fb7bb65d2ccc0c1e72e1023e26846fbc020fa43a912c
Jul 27 21:38:22.171146 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:22.171114    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt" event={"ID":"d652c340-2e24-4c7d-b04e-505a3b378a11","Type":"ContainerStarted","Data":"c8e995d68de9ee248c51fb7bb65d2ccc0c1e72e1023e26846fbc020fa43a912c"}
Jul 27 21:38:24.517469 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:24.517414    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-h276x"]
Jul 27 21:38:24.522127 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:24.522094    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h276x"
Jul 27 21:38:24.525035 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:24.525013    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gs7k2\""
Jul 27 21:38:24.530374 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:24.530349    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-h276x"]
Jul 27 21:38:24.665630 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:24.665586    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dwsw\" (UniqueName: \"kubernetes.io/projected/6d94f5cb-5699-456e-b92b-2530ca952955-kube-api-access-2dwsw\") pod \"cert-manager-cainjector-559cdd8c87-h276x\" (UID: \"6d94f5cb-5699-456e-b92b-2530ca952955\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h276x"
Jul 27 21:38:24.665822 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:24.665695    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d94f5cb-5699-456e-b92b-2530ca952955-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-h276x\" (UID: \"6d94f5cb-5699-456e-b92b-2530ca952955\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h276x"
Jul 27 21:38:24.766160 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:24.766117    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dwsw\" (UniqueName: \"kubernetes.io/projected/6d94f5cb-5699-456e-b92b-2530ca952955-kube-api-access-2dwsw\") pod \"cert-manager-cainjector-559cdd8c87-h276x\" (UID: \"6d94f5cb-5699-456e-b92b-2530ca952955\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h276x"
Jul 27 21:38:24.766341 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:24.766201    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d94f5cb-5699-456e-b92b-2530ca952955-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-h276x\" (UID: \"6d94f5cb-5699-456e-b92b-2530ca952955\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h276x"
Jul 27 21:38:24.774893 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:24.774823    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d94f5cb-5699-456e-b92b-2530ca952955-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-h276x\" (UID: \"6d94f5cb-5699-456e-b92b-2530ca952955\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h276x"
Jul 27 21:38:24.775038 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:24.774963    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dwsw\" (UniqueName: \"kubernetes.io/projected/6d94f5cb-5699-456e-b92b-2530ca952955-kube-api-access-2dwsw\") pod \"cert-manager-cainjector-559cdd8c87-h276x\" (UID: \"6d94f5cb-5699-456e-b92b-2530ca952955\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-h276x"
Jul 27 21:38:24.835631 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:24.835594    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h276x"
Jul 27 21:38:25.196748 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:25.196715    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-h276x"]
Jul 27 21:38:25.201071 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:38:25.201035    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d94f5cb_5699_456e_b92b_2530ca952955.slice/crio-7e1a3b1094d639ed2c84da42c04069c5499d19d0577bd362360475ecba9c7b27 WatchSource:0}: Error finding container 7e1a3b1094d639ed2c84da42c04069c5499d19d0577bd362360475ecba9c7b27: Status 404 returned error can't find the container with id 7e1a3b1094d639ed2c84da42c04069c5499d19d0577bd362360475ecba9c7b27
Jul 27 21:38:26.190836 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:26.190792    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt" event={"ID":"d652c340-2e24-4c7d-b04e-505a3b378a11","Type":"ContainerStarted","Data":"9a127d35616a6f7363253840c7333435104f80c78f9e82d43a7cfe3370569ccb"}
Jul 27 21:38:26.191289 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:26.190850    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt"
Jul 27 21:38:26.192297 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:26.192277    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h276x" event={"ID":"6d94f5cb-5699-456e-b92b-2530ca952955","Type":"ContainerStarted","Data":"4c84b90a82daed0f3f9fcd90c94d52e3727c5b65fb421da334b2b6e37024d5c4"}
Jul 27 21:38:26.192397 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:26.192306    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h276x" event={"ID":"6d94f5cb-5699-456e-b92b-2530ca952955","Type":"ContainerStarted","Data":"7e1a3b1094d639ed2c84da42c04069c5499d19d0577bd362360475ecba9c7b27"}
Jul 27 21:38:26.208615 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:26.208564    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt" podStartSLOduration=1.8227969370000001 podStartE2EDuration="5.20854902s" totalImagesPullingTime="3.385752083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:38:26.207002676 +0000 UTC m=+257.924409158" watchObservedRunningTime="2026-07-27 21:38:26.20854902 +0000 UTC m=+257.925955502"
Jul 27 21:38:26.222368 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:26.222319    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-h276x" podStartSLOduration=2.222303402 podStartE2EDuration="2.222303402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:38:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:38:26.22137432 +0000 UTC m=+257.938780803" watchObservedRunningTime="2026-07-27 21:38:26.222303402 +0000 UTC m=+257.939709885"
Jul 27 21:38:32.199290 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:38:32.199211    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tbgdt"
Jul 27 21:39:04.317542 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.317507    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"]
Jul 27 21:39:04.319962 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.319945    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.326217 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.326194    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-txdpd\""
Jul 27 21:39:04.326587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.326572    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 21:39:04.328368 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.328347    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 21:39:04.328480 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.328424    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 21:39:04.329220 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.329201    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:39:04.334548 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.334524    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 21:39:04.352698 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.352659    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"]
Jul 27 21:39:04.412345 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.412313    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzll\" (UniqueName: \"kubernetes.io/projected/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-kube-api-access-ptzll\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.412573 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.412385    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-manager-config\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.412573 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.412481    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-metrics-cert\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.412573 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.412514    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-cert\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.513637 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.513598    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-metrics-cert\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.513637 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.513642    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-cert\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.513881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.513673    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzll\" (UniqueName: \"kubernetes.io/projected/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-kube-api-access-ptzll\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.513881 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.513715    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-manager-config\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.514275 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.514257    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-manager-config\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.516965 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.516943    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-cert\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.517179 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.517152    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-metrics-cert\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.540366 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.540339    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzll\" (UniqueName: \"kubernetes.io/projected/09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56-kube-api-access-ptzll\") pod \"lws-controller-manager-7c57b59594-gcr27\" (UID: \"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56\") " pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.629670 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.629577    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:04.789786 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:04.789762    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"]
Jul 27 21:39:04.790069 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:39:04.790051    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a86c8e_76a7_48f6_ac50_2ffb1bf3ae56.slice/crio-a0e3b1a7a22ed1e09c3a7ba96103953f9249293da05efe8c6dbb7ab88004a327 WatchSource:0}: Error finding container a0e3b1a7a22ed1e09c3a7ba96103953f9249293da05efe8c6dbb7ab88004a327: Status 404 returned error can't find the container with id a0e3b1a7a22ed1e09c3a7ba96103953f9249293da05efe8c6dbb7ab88004a327
Jul 27 21:39:05.360308 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:05.360278    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27" event={"ID":"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56","Type":"ContainerStarted","Data":"a0e3b1a7a22ed1e09c3a7ba96103953f9249293da05efe8c6dbb7ab88004a327"}
Jul 27 21:39:06.144018 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.143984    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"]
Jul 27 21:39:06.147399 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.147375    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.150190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.150170    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xl2cn\""
Jul 27 21:39:06.150939 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.150907    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 21:39:06.151049 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.150956    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 21:39:06.151251 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.151226    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 21:39:06.151324 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.151260    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 21:39:06.178152 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.178108    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"]
Jul 27 21:39:06.230157 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.230118    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c86c811-ce7b-4d16-9ebd-9d777dca1884-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.230348 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.230198    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c86c811-ce7b-4d16-9ebd-9d777dca1884-tmp\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.230348 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.230251    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2hkf\" (UniqueName: \"kubernetes.io/projected/9c86c811-ce7b-4d16-9ebd-9d777dca1884-kube-api-access-r2hkf\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.230348 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.230286    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c86c811-ce7b-4d16-9ebd-9d777dca1884-manifests\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.230546 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.230337    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c86c811-ce7b-4d16-9ebd-9d777dca1884-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.331745 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.331707    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c86c811-ce7b-4d16-9ebd-9d777dca1884-tmp\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.331745 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.331744    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2hkf\" (UniqueName: \"kubernetes.io/projected/9c86c811-ce7b-4d16-9ebd-9d777dca1884-kube-api-access-r2hkf\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.331990 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.331788    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c86c811-ce7b-4d16-9ebd-9d777dca1884-manifests\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.331990 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.331815    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c86c811-ce7b-4d16-9ebd-9d777dca1884-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.331990 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.331938    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c86c811-ce7b-4d16-9ebd-9d777dca1884-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.332229 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.332203    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c86c811-ce7b-4d16-9ebd-9d777dca1884-manifests\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.334179 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.334146    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c86c811-ce7b-4d16-9ebd-9d777dca1884-tmp\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.334676 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.334656    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c86c811-ce7b-4d16-9ebd-9d777dca1884-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.334762 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.334656    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c86c811-ce7b-4d16-9ebd-9d777dca1884-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.342883 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.342854    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2hkf\" (UniqueName: \"kubernetes.io/projected/9c86c811-ce7b-4d16-9ebd-9d777dca1884-kube-api-access-r2hkf\") pod \"opendatahub-operator-controller-manager-5d57c545b5-svjgb\" (UID: \"9c86c811-ce7b-4d16-9ebd-9d777dca1884\") " pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:06.461345 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:06.461316    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:07.397099 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:07.397073    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"]
Jul 27 21:39:07.398758 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:39:07.398724    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c86c811_ce7b_4d16_9ebd_9d777dca1884.slice/crio-1664240e1dfb2d269e60087ac3167403087dfbd755c85a0fe38081b9b8c30b5c WatchSource:0}: Error finding container 1664240e1dfb2d269e60087ac3167403087dfbd755c85a0fe38081b9b8c30b5c: Status 404 returned error can't find the container with id 1664240e1dfb2d269e60087ac3167403087dfbd755c85a0fe38081b9b8c30b5c
Jul 27 21:39:08.379063 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:08.379023    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27" event={"ID":"09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56","Type":"ContainerStarted","Data":"08535c3bc0f04c226d350724d53f9ac8506724f512609ca4da3465721eaa7a84"}
Jul 27 21:39:08.379636 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:08.379141    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:08.380874 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:08.380820    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb" event={"ID":"9c86c811-ce7b-4d16-9ebd-9d777dca1884","Type":"ContainerStarted","Data":"1664240e1dfb2d269e60087ac3167403087dfbd755c85a0fe38081b9b8c30b5c"}
Jul 27 21:39:08.400363 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:08.400241    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27" podStartSLOduration=1.876639999 podStartE2EDuration="4.400212499s" totalImagesPullingTime="2.5235725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:39:08.397394672 +0000 UTC m=+300.114801156" watchObservedRunningTime="2026-07-27 21:39:08.400212499 +0000 UTC m=+300.117618982"
Jul 27 21:39:10.181237 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:10.181208    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:39:10.182850 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:10.181587    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:39:10.188524 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:10.188503    2554 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 21:39:10.392066 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:10.392023    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb" event={"ID":"9c86c811-ce7b-4d16-9ebd-9d777dca1884","Type":"ContainerStarted","Data":"ed6dd19b7ca935e324685013f94e4127ec140ee42866ec2567d3d39436618cc2"}
Jul 27 21:39:11.398672 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:11.398638    2554 generic.go:356] "Generic (PLEG): container finished" podID="9c86c811-ce7b-4d16-9ebd-9d777dca1884" containerID="ed6dd19b7ca935e324685013f94e4127ec140ee42866ec2567d3d39436618cc2" exitCode=0
Jul 27 21:39:11.399043 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:11.398687    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb" event={"ID":"9c86c811-ce7b-4d16-9ebd-9d777dca1884","Type":"ContainerDied","Data":"ed6dd19b7ca935e324685013f94e4127ec140ee42866ec2567d3d39436618cc2"}
Jul 27 21:39:11.399247 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:11.399232    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:39:12.405618 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:12.405586    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb" event={"ID":"9c86c811-ce7b-4d16-9ebd-9d777dca1884","Type":"ContainerStarted","Data":"48d6412f9f26869bcceae02c3a60c58a737c96b2f5874ca7fdca169def2eb84f"}
Jul 27 21:39:12.405992 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:12.405721    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:12.429642 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:12.429575    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb" podStartSLOduration=2.304063791 podStartE2EDuration="6.42955792s" totalImagesPullingTime="3.061261181s" totalInitContainerRuntime="1.064232948s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:39:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:39:12.426891796 +0000 UTC m=+304.144298280" watchObservedRunningTime="2026-07-27 21:39:12.42955792 +0000 UTC m=+304.146964401"
Jul 27 21:39:19.388612 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:19.388583    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c57b59594-gcr27"
Jul 27 21:39:23.412940 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:23.412905    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d57c545b5-svjgb"
Jul 27 21:39:28.628472 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.628412    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"]
Jul 27 21:39:28.631866 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.631841    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"
Jul 27 21:39:28.634963 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.634935    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 21:39:28.635838 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.635813    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 21:39:28.636192 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.636164    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 21:39:28.636311 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.636214    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 21:39:28.636476 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.636463    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-klfc9\""
Jul 27 21:39:28.647290 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.647268    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"]
Jul 27 21:39:28.739151 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.739110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19410132-3b17-46cd-bc3e-f4961cee6315-tmp\") pod \"kube-auth-proxy-6fd65f9cdf-rqfcx\" (UID: \"19410132-3b17-46cd-bc3e-f4961cee6315\") " pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"
Jul 27 21:39:28.739323 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.739182    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjrmb\" (UniqueName: \"kubernetes.io/projected/19410132-3b17-46cd-bc3e-f4961cee6315-kube-api-access-kjrmb\") pod \"kube-auth-proxy-6fd65f9cdf-rqfcx\" (UID: \"19410132-3b17-46cd-bc3e-f4961cee6315\") " pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"
Jul 27 21:39:28.739323 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.739241    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19410132-3b17-46cd-bc3e-f4961cee6315-tls-certs\") pod \"kube-auth-proxy-6fd65f9cdf-rqfcx\" (UID: \"19410132-3b17-46cd-bc3e-f4961cee6315\") " pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"
Jul 27 21:39:28.839780 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.839747    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19410132-3b17-46cd-bc3e-f4961cee6315-tmp\") pod \"kube-auth-proxy-6fd65f9cdf-rqfcx\" (UID: \"19410132-3b17-46cd-bc3e-f4961cee6315\") " pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"
Jul 27 21:39:28.839965 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.839789    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjrmb\" (UniqueName: \"kubernetes.io/projected/19410132-3b17-46cd-bc3e-f4961cee6315-kube-api-access-kjrmb\") pod \"kube-auth-proxy-6fd65f9cdf-rqfcx\" (UID: \"19410132-3b17-46cd-bc3e-f4961cee6315\") " pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"
Jul 27 21:39:28.839965 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.839843    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19410132-3b17-46cd-bc3e-f4961cee6315-tls-certs\") pod \"kube-auth-proxy-6fd65f9cdf-rqfcx\" (UID: \"19410132-3b17-46cd-bc3e-f4961cee6315\") " pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"
Jul 27 21:39:28.842413 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.842385    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19410132-3b17-46cd-bc3e-f4961cee6315-tmp\") pod \"kube-auth-proxy-6fd65f9cdf-rqfcx\" (UID: \"19410132-3b17-46cd-bc3e-f4961cee6315\") " pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"
Jul 27 21:39:28.842664 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.842632    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19410132-3b17-46cd-bc3e-f4961cee6315-tls-certs\") pod \"kube-auth-proxy-6fd65f9cdf-rqfcx\" (UID: \"19410132-3b17-46cd-bc3e-f4961cee6315\") " pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"
Jul 27 21:39:28.853747 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.853713    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjrmb\" (UniqueName: \"kubernetes.io/projected/19410132-3b17-46cd-bc3e-f4961cee6315-kube-api-access-kjrmb\") pod \"kube-auth-proxy-6fd65f9cdf-rqfcx\" (UID: \"19410132-3b17-46cd-bc3e-f4961cee6315\") " pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"
Jul 27 21:39:28.947217 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:28.947142    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"
Jul 27 21:39:29.087546 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:29.087521    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx"]
Jul 27 21:39:29.089965 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:39:29.089931    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19410132_3b17_46cd_bc3e_f4961cee6315.slice/crio-428fb1d36f60eb34b77a1b2f0f85271abb35522988125f77f8317216f3a1319b WatchSource:0}: Error finding container 428fb1d36f60eb34b77a1b2f0f85271abb35522988125f77f8317216f3a1319b: Status 404 returned error can't find the container with id 428fb1d36f60eb34b77a1b2f0f85271abb35522988125f77f8317216f3a1319b
Jul 27 21:39:29.483712 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:29.483618    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx" event={"ID":"19410132-3b17-46cd-bc3e-f4961cee6315","Type":"ContainerStarted","Data":"428fb1d36f60eb34b77a1b2f0f85271abb35522988125f77f8317216f3a1319b"}
Jul 27 21:39:32.498946 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:32.498902    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx" event={"ID":"19410132-3b17-46cd-bc3e-f4961cee6315","Type":"ContainerStarted","Data":"3569464bcb25f18cd01f02b25d09a1f65ad150a7c7e57e6bb56d8c6e3918728a"}
Jul 27 21:39:32.517831 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:39:32.517777    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fd65f9cdf-rqfcx" podStartSLOduration=1.8626944010000002 podStartE2EDuration="4.517760494s" totalImagesPullingTime="2.655066093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:39:32.515766877 +0000 UTC m=+324.233173359" watchObservedRunningTime="2026-07-27 21:39:32.517760494 +0000 UTC m=+324.235166974"
Jul 27 21:40:36.669151 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.669109    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c5b49469-ctgss"]
Jul 27 21:40:36.672041 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.672025    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.676068 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.676046    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 21:40:36.676789 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.676773    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 21:40:36.676844 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.676776    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4dc5n\""
Jul 27 21:40:36.677634 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.677606    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 21:40:36.677739 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.677667    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 21:40:36.677802 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.677786    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 21:40:36.679417 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.679370    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 21:40:36.679553 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.679519    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 21:40:36.681798 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.681780    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 21:40:36.690983 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.690963    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c5b49469-ctgss"]
Jul 27 21:40:36.817573 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.817537    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-console-config\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.817754 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.817590    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-service-ca\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.817754 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.817658    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-trusted-ca-bundle\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.817754 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.817699    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7922e4f9-3158-4220-909f-1592b5a197c0-console-serving-cert\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.817754 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.817717    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7922e4f9-3158-4220-909f-1592b5a197c0-console-oauth-config\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.817754 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.817751    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psfpn\" (UniqueName: \"kubernetes.io/projected/7922e4f9-3158-4220-909f-1592b5a197c0-kube-api-access-psfpn\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.817938 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.817779    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-oauth-serving-cert\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.918323 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.918294    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-service-ca\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.918504 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.918327    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-trusted-ca-bundle\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.918504 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.918354    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7922e4f9-3158-4220-909f-1592b5a197c0-console-serving-cert\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.918504 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.918376    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7922e4f9-3158-4220-909f-1592b5a197c0-console-oauth-config\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.918504 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.918418    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psfpn\" (UniqueName: \"kubernetes.io/projected/7922e4f9-3158-4220-909f-1592b5a197c0-kube-api-access-psfpn\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.918504 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.918476    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-oauth-serving-cert\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.918714 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.918528    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-console-config\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.919261 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.919183    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-service-ca\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.919261 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.919206    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-oauth-serving-cert\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.919261 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.919249    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-console-config\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.919691 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.919657    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7922e4f9-3158-4220-909f-1592b5a197c0-trusted-ca-bundle\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.921332 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.921314    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7922e4f9-3158-4220-909f-1592b5a197c0-console-oauth-config\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.921538 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.921520    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7922e4f9-3158-4220-909f-1592b5a197c0-console-serving-cert\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.927889 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.927863    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psfpn\" (UniqueName: \"kubernetes.io/projected/7922e4f9-3158-4220-909f-1592b5a197c0-kube-api-access-psfpn\") pod \"console-84c5b49469-ctgss\" (UID: \"7922e4f9-3158-4220-909f-1592b5a197c0\") " pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:36.982139 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:36.982098    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:37.121121 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:37.121100    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c5b49469-ctgss"]
Jul 27 21:40:37.123812 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:40:37.123778    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7922e4f9_3158_4220_909f_1592b5a197c0.slice/crio-5054f2b326cf8c725ed89850414fd55dad8476e4924e436c1fcf28f9f92cda63 WatchSource:0}: Error finding container 5054f2b326cf8c725ed89850414fd55dad8476e4924e436c1fcf28f9f92cda63: Status 404 returned error can't find the container with id 5054f2b326cf8c725ed89850414fd55dad8476e4924e436c1fcf28f9f92cda63
Jul 27 21:40:37.806420 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:37.806389    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c5b49469-ctgss" event={"ID":"7922e4f9-3158-4220-909f-1592b5a197c0","Type":"ContainerStarted","Data":"8d563c389efec85edd16bcab677c3862b02ed377c5803e531786caa8f4b45ec8"}
Jul 27 21:40:37.806840 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:37.806459    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c5b49469-ctgss" event={"ID":"7922e4f9-3158-4220-909f-1592b5a197c0","Type":"ContainerStarted","Data":"5054f2b326cf8c725ed89850414fd55dad8476e4924e436c1fcf28f9f92cda63"}
Jul 27 21:40:37.829823 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:37.829775    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84c5b49469-ctgss" podStartSLOduration=1.829752196 podStartE2EDuration="1.829752196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:37.829201873 +0000 UTC m=+389.546608355" watchObservedRunningTime="2026-07-27 21:40:37.829752196 +0000 UTC m=+389.547158677"
Jul 27 21:40:46.983085 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:46.983052    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:46.983502 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:46.983326    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:46.987694 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:46.987673    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:40:47.856573 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:40:47.856548    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84c5b49469-ctgss"
Jul 27 21:41:04.351998 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.351962    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"]
Jul 27 21:41:04.356404 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.356386    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:04.359677 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.359659    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 21:41:04.360309 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.360294    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ns8lb\""
Jul 27 21:41:04.360522 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.360508    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 21:41:04.429503 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.429471    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"]
Jul 27 21:41:04.475114 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.475074    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5947b\" (UniqueName: \"kubernetes.io/projected/6129ae50-de8b-484b-901e-3dc5384ce180-kube-api-access-5947b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\" (UID: \"6129ae50-de8b-484b-901e-3dc5384ce180\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:04.475286 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.475137    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6129ae50-de8b-484b-901e-3dc5384ce180-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\" (UID: \"6129ae50-de8b-484b-901e-3dc5384ce180\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:04.575836 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.575799    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6129ae50-de8b-484b-901e-3dc5384ce180-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\" (UID: \"6129ae50-de8b-484b-901e-3dc5384ce180\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:04.576004 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.575910    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5947b\" (UniqueName: \"kubernetes.io/projected/6129ae50-de8b-484b-901e-3dc5384ce180-kube-api-access-5947b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\" (UID: \"6129ae50-de8b-484b-901e-3dc5384ce180\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:04.576191 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.576169    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6129ae50-de8b-484b-901e-3dc5384ce180-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\" (UID: \"6129ae50-de8b-484b-901e-3dc5384ce180\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:04.585824 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.585798    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5947b\" (UniqueName: \"kubernetes.io/projected/6129ae50-de8b-484b-901e-3dc5384ce180-kube-api-access-5947b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\" (UID: \"6129ae50-de8b-484b-901e-3dc5384ce180\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:04.666970 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.666885    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:04.808121 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.808098    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"]
Jul 27 21:41:04.810576 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:41:04.810547    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6129ae50_de8b_484b_901e_3dc5384ce180.slice/crio-67bb309548954b92ca3dc63f70560ad55d97876f3767128b2a1e575c05af7ac2 WatchSource:0}: Error finding container 67bb309548954b92ca3dc63f70560ad55d97876f3767128b2a1e575c05af7ac2: Status 404 returned error can't find the container with id 67bb309548954b92ca3dc63f70560ad55d97876f3767128b2a1e575c05af7ac2
Jul 27 21:41:04.932899 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:04.932808    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz" event={"ID":"6129ae50-de8b-484b-901e-3dc5384ce180","Type":"ContainerStarted","Data":"67bb309548954b92ca3dc63f70560ad55d97876f3767128b2a1e575c05af7ac2"}
Jul 27 21:41:10.971725 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:10.971685    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz" event={"ID":"6129ae50-de8b-484b-901e-3dc5384ce180","Type":"ContainerStarted","Data":"670f101f47c400c6f12113e12ae3052b7d905647934b2007b92e8815b06d11c3"}
Jul 27 21:41:10.972152 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:10.971802    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:10.995887 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:10.995835    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz" podStartSLOduration=1.104109425 podStartE2EDuration="6.995819148s" totalImagesPullingTime="5.891709723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:10.994304638 +0000 UTC m=+422.711711120" watchObservedRunningTime="2026-07-27 21:41:10.995819148 +0000 UTC m=+422.713225631"
Jul 27 21:41:21.979720 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:21.979692    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:23.165297 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.165260    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"]
Jul 27 21:41:23.169299 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.169280    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:23.186653 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.186627    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"]
Jul 27 21:41:23.349066 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.349023    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7mmt\" (UniqueName: \"kubernetes.io/projected/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-kube-api-access-h7mmt\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l7ns7\" (UID: \"2fb3b34b-3222-45fb-bf93-3f4f9cdc1105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:23.349066 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.349069    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l7ns7\" (UID: \"2fb3b34b-3222-45fb-bf93-3f4f9cdc1105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:23.450633 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.450541    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mmt\" (UniqueName: \"kubernetes.io/projected/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-kube-api-access-h7mmt\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l7ns7\" (UID: \"2fb3b34b-3222-45fb-bf93-3f4f9cdc1105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:23.450633 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.450593    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l7ns7\" (UID: \"2fb3b34b-3222-45fb-bf93-3f4f9cdc1105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:23.450983 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.450966    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l7ns7\" (UID: \"2fb3b34b-3222-45fb-bf93-3f4f9cdc1105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:23.460146 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.460121    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7mmt\" (UniqueName: \"kubernetes.io/projected/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-kube-api-access-h7mmt\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l7ns7\" (UID: \"2fb3b34b-3222-45fb-bf93-3f4f9cdc1105\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:23.479762 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.479729    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:23.620610 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.620452    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"]
Jul 27 21:41:23.623670 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:41:23.623639    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb3b34b_3222_45fb_bf93_3f4f9cdc1105.slice/crio-f85fa81ef8bce25bb71a72fd8d57862e42504b6dc7827ed6ea9cd3ab8ee4d273 WatchSource:0}: Error finding container f85fa81ef8bce25bb71a72fd8d57862e42504b6dc7827ed6ea9cd3ab8ee4d273: Status 404 returned error can't find the container with id f85fa81ef8bce25bb71a72fd8d57862e42504b6dc7827ed6ea9cd3ab8ee4d273
Jul 27 21:41:23.854203 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.854173    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"]
Jul 27 21:41:23.855894 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.855865    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"]
Jul 27 21:41:23.867367 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.867338    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"]
Jul 27 21:41:23.867606 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.867573    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz" podUID="6129ae50-de8b-484b-901e-3dc5384ce180" containerName="manager" containerID="cri-o://670f101f47c400c6f12113e12ae3052b7d905647934b2007b92e8815b06d11c3" gracePeriod=2
Jul 27 21:41:23.878747 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.878720    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"]
Jul 27 21:41:23.879152 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.879134    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" containerName="manager"
Jul 27 21:41:23.879152 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.879153    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" containerName="manager"
Jul 27 21:41:23.879268 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.879230    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" containerName="manager"
Jul 27 21:41:23.881936 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.881918    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:23.884260 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.884239    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"]
Jul 27 21:41:23.889253 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:23.889186    2554 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6129ae50-de8b-484b-901e-3dc5384ce180\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\": pods \"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:23.891617 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:23.891592    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\" is forbidden: User \"system:node:ip-10-0-136-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-223.ec2.internal' and this object" podUID="6129ae50-de8b-484b-901e-3dc5384ce180" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:23.895686 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.895654    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"]
Jul 27 21:41:23.908009 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.907978    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"]
Jul 27 21:41:23.908421 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.908403    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6129ae50-de8b-484b-901e-3dc5384ce180" containerName="manager"
Jul 27 21:41:23.908527 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.908423    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6129ae50-de8b-484b-901e-3dc5384ce180" containerName="manager"
Jul 27 21:41:23.908587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.908547    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6129ae50-de8b-484b-901e-3dc5384ce180" containerName="manager"
Jul 27 21:41:23.910960 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.910941    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:23.923476 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:23.923442    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\" is forbidden: User \"system:node:ip-10-0-136-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-223.ec2.internal' and this object" podUID="6129ae50-de8b-484b-901e-3dc5384ce180" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:23.929412 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:23.929382    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"]
Jul 27 21:41:24.035866 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.035836    2554 generic.go:356] "Generic (PLEG): container finished" podID="6129ae50-de8b-484b-901e-3dc5384ce180" containerID="670f101f47c400c6f12113e12ae3052b7d905647934b2007b92e8815b06d11c3" exitCode=0
Jul 27 21:41:24.037705 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:24.037681    2554 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7" container="manager"
Jul 27 21:41:24.040249 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:24.040225    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-l7ns7\" is forbidden: User \"system:node:ip-10-0-136-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-223.ec2.internal' and this object" podUID="2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:24.042352 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:24.042322    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\" is forbidden: User \"system:node:ip-10-0-136-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-223.ec2.internal' and this object" podUID="6129ae50-de8b-484b-901e-3dc5384ce180" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:24.056460 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.056396    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d54eafa-8698-49d1-a366-e854f794dc18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ftvq5\" (UID: \"6d54eafa-8698-49d1-a366-e854f794dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:24.056603 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.056542    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh7gz\" (UniqueName: \"kubernetes.io/projected/8e95bfd0-de8b-4794-8807-c100c01f7ffb-kube-api-access-xh7gz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nl825\" (UID: \"8e95bfd0-de8b-4794-8807-c100c01f7ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:24.056603 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.056593    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e95bfd0-de8b-4794-8807-c100c01f7ffb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nl825\" (UID: \"8e95bfd0-de8b-4794-8807-c100c01f7ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:24.056698 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.056633    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sql2v\" (UniqueName: \"kubernetes.io/projected/6d54eafa-8698-49d1-a366-e854f794dc18-kube-api-access-sql2v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ftvq5\" (UID: \"6d54eafa-8698-49d1-a366-e854f794dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:24.098674 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.098648    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:24.101120 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:24.101098    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2c6nz\" is forbidden: User \"system:node:ip-10-0-136-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-223.ec2.internal' and this object" podUID="6129ae50-de8b-484b-901e-3dc5384ce180" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:24.103160 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:24.103134    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-l7ns7\" is forbidden: User \"system:node:ip-10-0-136-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-223.ec2.internal' and this object" podUID="2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:24.157397 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.157313    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh7gz\" (UniqueName: \"kubernetes.io/projected/8e95bfd0-de8b-4794-8807-c100c01f7ffb-kube-api-access-xh7gz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nl825\" (UID: \"8e95bfd0-de8b-4794-8807-c100c01f7ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:24.157397 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.157355    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e95bfd0-de8b-4794-8807-c100c01f7ffb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nl825\" (UID: \"8e95bfd0-de8b-4794-8807-c100c01f7ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:24.157397 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.157376    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sql2v\" (UniqueName: \"kubernetes.io/projected/6d54eafa-8698-49d1-a366-e854f794dc18-kube-api-access-sql2v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ftvq5\" (UID: \"6d54eafa-8698-49d1-a366-e854f794dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:24.157660 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.157463    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d54eafa-8698-49d1-a366-e854f794dc18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ftvq5\" (UID: \"6d54eafa-8698-49d1-a366-e854f794dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:24.157734 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.157716    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e95bfd0-de8b-4794-8807-c100c01f7ffb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nl825\" (UID: \"8e95bfd0-de8b-4794-8807-c100c01f7ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:24.157808 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.157791    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d54eafa-8698-49d1-a366-e854f794dc18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ftvq5\" (UID: \"6d54eafa-8698-49d1-a366-e854f794dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:24.175916 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.175886    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh7gz\" (UniqueName: \"kubernetes.io/projected/8e95bfd0-de8b-4794-8807-c100c01f7ffb-kube-api-access-xh7gz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nl825\" (UID: \"8e95bfd0-de8b-4794-8807-c100c01f7ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:24.176229 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.175929    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sql2v\" (UniqueName: \"kubernetes.io/projected/6d54eafa-8698-49d1-a366-e854f794dc18-kube-api-access-sql2v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ftvq5\" (UID: \"6d54eafa-8698-49d1-a366-e854f794dc18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:24.244219 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.244177    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:24.251908 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.251882    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:24.258482 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.258458    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5947b\" (UniqueName: \"kubernetes.io/projected/6129ae50-de8b-484b-901e-3dc5384ce180-kube-api-access-5947b\") pod \"6129ae50-de8b-484b-901e-3dc5384ce180\" (UID: \"6129ae50-de8b-484b-901e-3dc5384ce180\") "
Jul 27 21:41:24.258619 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.258507    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6129ae50-de8b-484b-901e-3dc5384ce180-extensions-socket-volume\") pod \"6129ae50-de8b-484b-901e-3dc5384ce180\" (UID: \"6129ae50-de8b-484b-901e-3dc5384ce180\") "
Jul 27 21:41:24.259155 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.259118    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6129ae50-de8b-484b-901e-3dc5384ce180-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6129ae50-de8b-484b-901e-3dc5384ce180" (UID: "6129ae50-de8b-484b-901e-3dc5384ce180"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:24.260762 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.260731    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6129ae50-de8b-484b-901e-3dc5384ce180-kube-api-access-5947b" (OuterVolumeSpecName: "kube-api-access-5947b") pod "6129ae50-de8b-484b-901e-3dc5384ce180" (UID: "6129ae50-de8b-484b-901e-3dc5384ce180"). InnerVolumeSpecName "kube-api-access-5947b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:41:24.359144 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.359112    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5947b\" (UniqueName: \"kubernetes.io/projected/6129ae50-de8b-484b-901e-3dc5384ce180-kube-api-access-5947b\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:41:24.359144 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.359141    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6129ae50-de8b-484b-901e-3dc5384ce180-extensions-socket-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:41:24.409809 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.409731    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"]
Jul 27 21:41:24.413610 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:41:24.413579    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d54eafa_8698_49d1_a366_e854f794dc18.slice/crio-3967e627903c4801c1044b9008fbcbd734615f83f72d66b0fe1bd5ed07c02ca5 WatchSource:0}: Error finding container 3967e627903c4801c1044b9008fbcbd734615f83f72d66b0fe1bd5ed07c02ca5: Status 404 returned error can't find the container with id 3967e627903c4801c1044b9008fbcbd734615f83f72d66b0fe1bd5ed07c02ca5
Jul 27 21:41:24.419999 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.419975    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"]
Jul 27 21:41:24.422643 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:41:24.422617    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e95bfd0_de8b_4794_8807_c100c01f7ffb.slice/crio-74a5a21c9d2bd8e6cd36a973d1cb1314e16c1bda97dbf07996c99127ccc27f19 WatchSource:0}: Error finding container 74a5a21c9d2bd8e6cd36a973d1cb1314e16c1bda97dbf07996c99127ccc27f19: Status 404 returned error can't find the container with id 74a5a21c9d2bd8e6cd36a973d1cb1314e16c1bda97dbf07996c99127ccc27f19
Jul 27 21:41:24.921758 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:24.921722    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6129ae50-de8b-484b-901e-3dc5384ce180" path="/var/lib/kubelet/pods/6129ae50-de8b-484b-901e-3dc5384ce180/volumes"
Jul 27 21:41:25.043958 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.043927    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5" event={"ID":"6d54eafa-8698-49d1-a366-e854f794dc18","Type":"ContainerStarted","Data":"75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e"}
Jul 27 21:41:25.044157 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.043977    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5" event={"ID":"6d54eafa-8698-49d1-a366-e854f794dc18","Type":"ContainerStarted","Data":"3967e627903c4801c1044b9008fbcbd734615f83f72d66b0fe1bd5ed07c02ca5"}
Jul 27 21:41:25.044157 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.044047    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:25.045750 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.045723    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825" event={"ID":"8e95bfd0-de8b-4794-8807-c100c01f7ffb","Type":"ContainerStarted","Data":"6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07"}
Jul 27 21:41:25.045869 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.045773    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:25.045869 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.045796    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825" event={"ID":"8e95bfd0-de8b-4794-8807-c100c01f7ffb","Type":"ContainerStarted","Data":"74a5a21c9d2bd8e6cd36a973d1cb1314e16c1bda97dbf07996c99127ccc27f19"}
Jul 27 21:41:25.046957 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.046935    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c6nz"
Jul 27 21:41:25.047074 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.046969    2554 scope.go:117] "RemoveContainer" containerID="670f101f47c400c6f12113e12ae3052b7d905647934b2007b92e8815b06d11c3"
Jul 27 21:41:25.048681 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.048653    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7" podUID="2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" containerName="manager" containerID="cri-o://07e80000501af3b0f088817e6685f817c01169af6175d17673542926c111bfc9" gracePeriod=2
Jul 27 21:41:25.069166 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.069118    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5" podStartSLOduration=2.069102442 podStartE2EDuration="2.069102442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:25.067229386 +0000 UTC m=+436.784635868" watchObservedRunningTime="2026-07-27 21:41:25.069102442 +0000 UTC m=+436.786508924"
Jul 27 21:41:25.095794 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.095745    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825" podStartSLOduration=2.095727519 podStartE2EDuration="2.095727519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:25.093474158 +0000 UTC m=+436.810880632" watchObservedRunningTime="2026-07-27 21:41:25.095727519 +0000 UTC m=+436.813134000"
Jul 27 21:41:25.294162 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.294138    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:25.296638 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:25.296608    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-l7ns7\" is forbidden: User \"system:node:ip-10-0-136-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-223.ec2.internal' and this object" podUID="2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:25.367052 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.367013    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-extensions-socket-volume\") pod \"2fb3b34b-3222-45fb-bf93-3f4f9cdc1105\" (UID: \"2fb3b34b-3222-45fb-bf93-3f4f9cdc1105\") "
Jul 27 21:41:25.367215 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.367107    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7mmt\" (UniqueName: \"kubernetes.io/projected/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-kube-api-access-h7mmt\") pod \"2fb3b34b-3222-45fb-bf93-3f4f9cdc1105\" (UID: \"2fb3b34b-3222-45fb-bf93-3f4f9cdc1105\") "
Jul 27 21:41:25.367297 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.367267    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" (UID: "2fb3b34b-3222-45fb-bf93-3f4f9cdc1105"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:25.369238 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.369210    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-kube-api-access-h7mmt" (OuterVolumeSpecName: "kube-api-access-h7mmt") pod "2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" (UID: "2fb3b34b-3222-45fb-bf93-3f4f9cdc1105"). InnerVolumeSpecName "kube-api-access-h7mmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:41:25.468429 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.468390    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7mmt\" (UniqueName: \"kubernetes.io/projected/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-kube-api-access-h7mmt\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:41:25.468429 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:25.468423    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105-extensions-socket-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:41:26.055093 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:26.055061    2554 generic.go:356] "Generic (PLEG): container finished" podID="2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" containerID="07e80000501af3b0f088817e6685f817c01169af6175d17673542926c111bfc9" exitCode=2
Jul 27 21:41:26.055299 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:26.055114    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:26.055299 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:26.055164    2554 scope.go:117] "RemoveContainer" containerID="07e80000501af3b0f088817e6685f817c01169af6175d17673542926c111bfc9"
Jul 27 21:41:26.057877 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:26.057844    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-l7ns7\" is forbidden: User \"system:node:ip-10-0-136-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-223.ec2.internal' and this object" podUID="2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:26.064890 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:26.064873    2554 scope.go:117] "RemoveContainer" containerID="07e80000501af3b0f088817e6685f817c01169af6175d17673542926c111bfc9"
Jul 27 21:41:26.065134 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:26.065117    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07e80000501af3b0f088817e6685f817c01169af6175d17673542926c111bfc9\": container with ID starting with 07e80000501af3b0f088817e6685f817c01169af6175d17673542926c111bfc9 not found: ID does not exist" containerID="07e80000501af3b0f088817e6685f817c01169af6175d17673542926c111bfc9"
Jul 27 21:41:26.065184 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:26.065141    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07e80000501af3b0f088817e6685f817c01169af6175d17673542926c111bfc9"} err="failed to get container status \"07e80000501af3b0f088817e6685f817c01169af6175d17673542926c111bfc9\": rpc error: code = NotFound desc = could not find container \"07e80000501af3b0f088817e6685f817c01169af6175d17673542926c111bfc9\": container with ID starting with 07e80000501af3b0f088817e6685f817c01169af6175d17673542926c111bfc9 not found: ID does not exist"
Jul 27 21:41:26.066772 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:26.066752    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-l7ns7\" is forbidden: User \"system:node:ip-10-0-136-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-223.ec2.internal' and this object" podUID="2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l7ns7"
Jul 27 21:41:26.921952 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:26.921920    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fb3b34b-3222-45fb-bf93-3f4f9cdc1105" path="/var/lib/kubelet/pods/2fb3b34b-3222-45fb-bf93-3f4f9cdc1105/volumes"
Jul 27 21:41:36.058472 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.058373    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:36.058839 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.058482    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:36.148536 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.148500    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"]
Jul 27 21:41:36.148731 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.148687    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5" podUID="6d54eafa-8698-49d1-a366-e854f794dc18" containerName="manager" containerID="cri-o://75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e" gracePeriod=10
Jul 27 21:41:36.397917 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.397874    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"]
Jul 27 21:41:36.418654 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.418627    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"]
Jul 27 21:41:36.418831 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.418730    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:41:36.425584 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.425555    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:36.462796 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.462756    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d54eafa-8698-49d1-a366-e854f794dc18-extensions-socket-volume\") pod \"6d54eafa-8698-49d1-a366-e854f794dc18\" (UID: \"6d54eafa-8698-49d1-a366-e854f794dc18\") "
Jul 27 21:41:36.462978 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.462824    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sql2v\" (UniqueName: \"kubernetes.io/projected/6d54eafa-8698-49d1-a366-e854f794dc18-kube-api-access-sql2v\") pod \"6d54eafa-8698-49d1-a366-e854f794dc18\" (UID: \"6d54eafa-8698-49d1-a366-e854f794dc18\") "
Jul 27 21:41:36.463043 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.462975    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wtwb\" (UniqueName: \"kubernetes.io/projected/2179f712-eb8a-4cf2-8231-94ac1f977cb6-kube-api-access-9wtwb\") pod \"kuadrant-operator-controller-manager-86878c769f-lcv4d\" (UID: \"2179f712-eb8a-4cf2-8231-94ac1f977cb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:41:36.463096 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.463067    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2179f712-eb8a-4cf2-8231-94ac1f977cb6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lcv4d\" (UID: \"2179f712-eb8a-4cf2-8231-94ac1f977cb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:41:36.463235 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.463209    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d54eafa-8698-49d1-a366-e854f794dc18-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6d54eafa-8698-49d1-a366-e854f794dc18" (UID: "6d54eafa-8698-49d1-a366-e854f794dc18"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:36.465254 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.465226    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d54eafa-8698-49d1-a366-e854f794dc18-kube-api-access-sql2v" (OuterVolumeSpecName: "kube-api-access-sql2v") pod "6d54eafa-8698-49d1-a366-e854f794dc18" (UID: "6d54eafa-8698-49d1-a366-e854f794dc18"). InnerVolumeSpecName "kube-api-access-sql2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:41:36.563651 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.563616    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2179f712-eb8a-4cf2-8231-94ac1f977cb6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lcv4d\" (UID: \"2179f712-eb8a-4cf2-8231-94ac1f977cb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:41:36.563874 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.563727    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wtwb\" (UniqueName: \"kubernetes.io/projected/2179f712-eb8a-4cf2-8231-94ac1f977cb6-kube-api-access-9wtwb\") pod \"kuadrant-operator-controller-manager-86878c769f-lcv4d\" (UID: \"2179f712-eb8a-4cf2-8231-94ac1f977cb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:41:36.563874 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.563771    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d54eafa-8698-49d1-a366-e854f794dc18-extensions-socket-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:41:36.563874 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.563785    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sql2v\" (UniqueName: \"kubernetes.io/projected/6d54eafa-8698-49d1-a366-e854f794dc18-kube-api-access-sql2v\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:41:36.563988 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.563975    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2179f712-eb8a-4cf2-8231-94ac1f977cb6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lcv4d\" (UID: \"2179f712-eb8a-4cf2-8231-94ac1f977cb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:41:36.574419 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.574344    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wtwb\" (UniqueName: \"kubernetes.io/projected/2179f712-eb8a-4cf2-8231-94ac1f977cb6-kube-api-access-9wtwb\") pod \"kuadrant-operator-controller-manager-86878c769f-lcv4d\" (UID: \"2179f712-eb8a-4cf2-8231-94ac1f977cb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:41:36.730629 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.730592    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:41:36.897468 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:36.897427    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"]
Jul 27 21:41:36.900155 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:41:36.900128    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2179f712_eb8a_4cf2_8231_94ac1f977cb6.slice/crio-dea8e2ee379b5e93e2f08ee37559bfe3960e10354e024380df49cfcef64f78e4 WatchSource:0}: Error finding container dea8e2ee379b5e93e2f08ee37559bfe3960e10354e024380df49cfcef64f78e4: Status 404 returned error can't find the container with id dea8e2ee379b5e93e2f08ee37559bfe3960e10354e024380df49cfcef64f78e4
Jul 27 21:41:37.116223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.116135    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d" event={"ID":"2179f712-eb8a-4cf2-8231-94ac1f977cb6","Type":"ContainerStarted","Data":"82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426"}
Jul 27 21:41:37.116645 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.116283    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:41:37.116645 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.116306    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d" event={"ID":"2179f712-eb8a-4cf2-8231-94ac1f977cb6","Type":"ContainerStarted","Data":"dea8e2ee379b5e93e2f08ee37559bfe3960e10354e024380df49cfcef64f78e4"}
Jul 27 21:41:37.117396 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.117374    2554 generic.go:356] "Generic (PLEG): container finished" podID="6d54eafa-8698-49d1-a366-e854f794dc18" containerID="75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e" exitCode=0
Jul 27 21:41:37.117461 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.117413    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"
Jul 27 21:41:37.117503 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.117414    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5" event={"ID":"6d54eafa-8698-49d1-a366-e854f794dc18","Type":"ContainerDied","Data":"75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e"}
Jul 27 21:41:37.117503 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.117492    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5" event={"ID":"6d54eafa-8698-49d1-a366-e854f794dc18","Type":"ContainerDied","Data":"3967e627903c4801c1044b9008fbcbd734615f83f72d66b0fe1bd5ed07c02ca5"}
Jul 27 21:41:37.117576 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.117522    2554 scope.go:117] "RemoveContainer" containerID="75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e"
Jul 27 21:41:37.126234 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.126214    2554 scope.go:117] "RemoveContainer" containerID="75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e"
Jul 27 21:41:37.126530 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:37.126513    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e\": container with ID starting with 75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e not found: ID does not exist" containerID="75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e"
Jul 27 21:41:37.126574 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.126540    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e"} err="failed to get container status \"75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e\": rpc error: code = NotFound desc = could not find container \"75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e\": container with ID starting with 75d1deae01de0a4bfb151d4004414149412c34a68fcafa2d35ad271bde72b05e not found: ID does not exist"
Jul 27 21:41:37.141134 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.141074    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d" podStartSLOduration=1.141051901 podStartE2EDuration="1.141051901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:37.139551048 +0000 UTC m=+448.856957531" watchObservedRunningTime="2026-07-27 21:41:37.141051901 +0000 UTC m=+448.858458384"
Jul 27 21:41:37.176855 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.176826    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"]
Jul 27 21:41:37.192739 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:37.192712    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ftvq5"]
Jul 27 21:41:38.920472 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:38.920418    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d54eafa-8698-49d1-a366-e854f794dc18" path="/var/lib/kubelet/pods/6d54eafa-8698-49d1-a366-e854f794dc18/volumes"
Jul 27 21:41:48.125311 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:48.125283    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:41:48.215480 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:48.215452    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"]
Jul 27 21:41:48.215677 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:48.215657    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825" podUID="8e95bfd0-de8b-4794-8807-c100c01f7ffb" containerName="manager" containerID="cri-o://6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07" gracePeriod=10
Jul 27 21:41:48.466185 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:48.466158    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:48.573762 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:48.573730    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e95bfd0-de8b-4794-8807-c100c01f7ffb-extensions-socket-volume\") pod \"8e95bfd0-de8b-4794-8807-c100c01f7ffb\" (UID: \"8e95bfd0-de8b-4794-8807-c100c01f7ffb\") "
Jul 27 21:41:48.573950 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:48.573790    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh7gz\" (UniqueName: \"kubernetes.io/projected/8e95bfd0-de8b-4794-8807-c100c01f7ffb-kube-api-access-xh7gz\") pod \"8e95bfd0-de8b-4794-8807-c100c01f7ffb\" (UID: \"8e95bfd0-de8b-4794-8807-c100c01f7ffb\") "
Jul 27 21:41:48.574096 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:48.574069    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e95bfd0-de8b-4794-8807-c100c01f7ffb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8e95bfd0-de8b-4794-8807-c100c01f7ffb" (UID: "8e95bfd0-de8b-4794-8807-c100c01f7ffb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:41:48.575969 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:48.575949    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e95bfd0-de8b-4794-8807-c100c01f7ffb-kube-api-access-xh7gz" (OuterVolumeSpecName: "kube-api-access-xh7gz") pod "8e95bfd0-de8b-4794-8807-c100c01f7ffb" (UID: "8e95bfd0-de8b-4794-8807-c100c01f7ffb"). InnerVolumeSpecName "kube-api-access-xh7gz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:41:48.675256 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:48.675183    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e95bfd0-de8b-4794-8807-c100c01f7ffb-extensions-socket-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:41:48.675256 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:48.675209    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh7gz\" (UniqueName: \"kubernetes.io/projected/8e95bfd0-de8b-4794-8807-c100c01f7ffb-kube-api-access-xh7gz\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:41:49.181910 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:49.181820    2554 generic.go:356] "Generic (PLEG): container finished" podID="8e95bfd0-de8b-4794-8807-c100c01f7ffb" containerID="6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07" exitCode=0
Jul 27 21:41:49.181910 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:49.181865    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"
Jul 27 21:41:49.182408 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:49.181917    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825" event={"ID":"8e95bfd0-de8b-4794-8807-c100c01f7ffb","Type":"ContainerDied","Data":"6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07"}
Jul 27 21:41:49.182408 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:49.181974    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825" event={"ID":"8e95bfd0-de8b-4794-8807-c100c01f7ffb","Type":"ContainerDied","Data":"74a5a21c9d2bd8e6cd36a973d1cb1314e16c1bda97dbf07996c99127ccc27f19"}
Jul 27 21:41:49.182408 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:49.182005    2554 scope.go:117] "RemoveContainer" containerID="6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07"
Jul 27 21:41:49.190889 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:49.190869    2554 scope.go:117] "RemoveContainer" containerID="6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07"
Jul 27 21:41:49.191170 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:41:49.191148    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07\": container with ID starting with 6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07 not found: ID does not exist" containerID="6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07"
Jul 27 21:41:49.191214 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:49.191179    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07"} err="failed to get container status \"6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07\": rpc error: code = NotFound desc = could not find container \"6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07\": container with ID starting with 6e1e48837399150622809a42cda30c5843fc850dd27a884d6526c5a442b40e07 not found: ID does not exist"
Jul 27 21:41:49.204471 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:49.204424    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"]
Jul 27 21:41:49.213305 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:49.213274    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nl825"]
Jul 27 21:41:50.920511 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:41:50.920480    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e95bfd0-de8b-4794-8807-c100c01f7ffb" path="/var/lib/kubelet/pods/8e95bfd0-de8b-4794-8807-c100c01f7ffb/volumes"
Jul 27 21:42:04.396291 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.396257    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ncfjf"]
Jul 27 21:42:04.396685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.396650    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e95bfd0-de8b-4794-8807-c100c01f7ffb" containerName="manager"
Jul 27 21:42:04.396685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.396662    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e95bfd0-de8b-4794-8807-c100c01f7ffb" containerName="manager"
Jul 27 21:42:04.396685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.396673    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d54eafa-8698-49d1-a366-e854f794dc18" containerName="manager"
Jul 27 21:42:04.396685 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.396678    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d54eafa-8698-49d1-a366-e854f794dc18" containerName="manager"
Jul 27 21:42:04.396815 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.396743    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e95bfd0-de8b-4794-8807-c100c01f7ffb" containerName="manager"
Jul 27 21:42:04.396815 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.396751    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d54eafa-8698-49d1-a366-e854f794dc18" containerName="manager"
Jul 27 21:42:04.400168 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.400145    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ncfjf"
Jul 27 21:42:04.403284 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.403257    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7prhk\""
Jul 27 21:42:04.410067 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.410041    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ncfjf"]
Jul 27 21:42:04.530479 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.530414    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j994n\" (UniqueName: \"kubernetes.io/projected/5e0cb495-87ca-4ae3-a956-24488b4fa4bb-kube-api-access-j994n\") pod \"authorino-58cd955675-ncfjf\" (UID: \"5e0cb495-87ca-4ae3-a956-24488b4fa4bb\") " pod="kuadrant-system/authorino-58cd955675-ncfjf"
Jul 27 21:42:04.631190 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.631154    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j994n\" (UniqueName: \"kubernetes.io/projected/5e0cb495-87ca-4ae3-a956-24488b4fa4bb-kube-api-access-j994n\") pod \"authorino-58cd955675-ncfjf\" (UID: \"5e0cb495-87ca-4ae3-a956-24488b4fa4bb\") " pod="kuadrant-system/authorino-58cd955675-ncfjf"
Jul 27 21:42:04.646144 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.646108    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j994n\" (UniqueName: \"kubernetes.io/projected/5e0cb495-87ca-4ae3-a956-24488b4fa4bb-kube-api-access-j994n\") pod \"authorino-58cd955675-ncfjf\" (UID: \"5e0cb495-87ca-4ae3-a956-24488b4fa4bb\") " pod="kuadrant-system/authorino-58cd955675-ncfjf"
Jul 27 21:42:04.713035 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.713007    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ncfjf"
Jul 27 21:42:04.782393 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.782328    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-g96lt"]
Jul 27 21:42:04.788765 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.788313    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g96lt"
Jul 27 21:42:04.790223 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.790197    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g96lt"]
Jul 27 21:42:04.859818 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.859608    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ncfjf"]
Jul 27 21:42:04.862390 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:42:04.862347    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e0cb495_87ca_4ae3_a956_24488b4fa4bb.slice/crio-3275dd9ebba4b462063b631ef8c0a7201fbe33790e90496c2336002bf0ff5a80 WatchSource:0}: Error finding container 3275dd9ebba4b462063b631ef8c0a7201fbe33790e90496c2336002bf0ff5a80: Status 404 returned error can't find the container with id 3275dd9ebba4b462063b631ef8c0a7201fbe33790e90496c2336002bf0ff5a80
Jul 27 21:42:04.934556 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:04.934517    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8kzq\" (UniqueName: \"kubernetes.io/projected/fd48eac0-03bf-447b-94f1-5d61ea6d8eec-kube-api-access-k8kzq\") pod \"authorino-75d556bd77-g96lt\" (UID: \"fd48eac0-03bf-447b-94f1-5d61ea6d8eec\") " pod="kuadrant-system/authorino-75d556bd77-g96lt"
Jul 27 21:42:05.036077 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:05.035991    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kzq\" (UniqueName: \"kubernetes.io/projected/fd48eac0-03bf-447b-94f1-5d61ea6d8eec-kube-api-access-k8kzq\") pod \"authorino-75d556bd77-g96lt\" (UID: \"fd48eac0-03bf-447b-94f1-5d61ea6d8eec\") " pod="kuadrant-system/authorino-75d556bd77-g96lt"
Jul 27 21:42:05.045520 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:05.045494    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8kzq\" (UniqueName: \"kubernetes.io/projected/fd48eac0-03bf-447b-94f1-5d61ea6d8eec-kube-api-access-k8kzq\") pod \"authorino-75d556bd77-g96lt\" (UID: \"fd48eac0-03bf-447b-94f1-5d61ea6d8eec\") " pod="kuadrant-system/authorino-75d556bd77-g96lt"
Jul 27 21:42:05.099637 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:05.099604    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g96lt"
Jul 27 21:42:05.237691 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:05.237660    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g96lt"]
Jul 27 21:42:05.240473 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:42:05.240416    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd48eac0_03bf_447b_94f1_5d61ea6d8eec.slice/crio-4cfe6af8e9b124eb449d1b5423f77c52a3037a79a48473745d4e544bd0c3a726 WatchSource:0}: Error finding container 4cfe6af8e9b124eb449d1b5423f77c52a3037a79a48473745d4e544bd0c3a726: Status 404 returned error can't find the container with id 4cfe6af8e9b124eb449d1b5423f77c52a3037a79a48473745d4e544bd0c3a726
Jul 27 21:42:05.266305 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:05.266265    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ncfjf" event={"ID":"5e0cb495-87ca-4ae3-a956-24488b4fa4bb","Type":"ContainerStarted","Data":"3275dd9ebba4b462063b631ef8c0a7201fbe33790e90496c2336002bf0ff5a80"}
Jul 27 21:42:05.267527 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:05.267490    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g96lt" event={"ID":"fd48eac0-03bf-447b-94f1-5d61ea6d8eec","Type":"ContainerStarted","Data":"4cfe6af8e9b124eb449d1b5423f77c52a3037a79a48473745d4e544bd0c3a726"}
Jul 27 21:42:08.746473 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:08.746421    2554 scope.go:117] "RemoveContainer" containerID="1e0b27e20d9f54f189727a430f3706dd51991af52c3b8e1f3d2f32c8a6b90e12"
Jul 27 21:42:09.298796 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:09.298740    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ncfjf" event={"ID":"5e0cb495-87ca-4ae3-a956-24488b4fa4bb","Type":"ContainerStarted","Data":"3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc"}
Jul 27 21:42:09.300265 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:09.300235    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g96lt" event={"ID":"fd48eac0-03bf-447b-94f1-5d61ea6d8eec","Type":"ContainerStarted","Data":"ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4"}
Jul 27 21:42:09.313935 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:09.313882    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ncfjf" podStartSLOduration=1.844556493 podStartE2EDuration="5.313868895s" totalImagesPullingTime="3.469312402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:42:09.313402214 +0000 UTC m=+481.030808696" watchObservedRunningTime="2026-07-27 21:42:09.313868895 +0000 UTC m=+481.031275377"
Jul 27 21:42:09.329680 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:09.329626    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-g96lt" podStartSLOduration=2.226954613 podStartE2EDuration="5.329608945s" totalImagesPullingTime="3.102654332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:42:09.328500945 +0000 UTC m=+481.045907429" watchObservedRunningTime="2026-07-27 21:42:09.329608945 +0000 UTC m=+481.047015429"
Jul 27 21:42:09.352954 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:09.352917    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ncfjf"]
Jul 27 21:42:11.310008 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:11.309963    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ncfjf" podUID="5e0cb495-87ca-4ae3-a956-24488b4fa4bb" containerName="authorino" containerID="cri-o://3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc" gracePeriod=30
Jul 27 21:42:11.574324 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:11.574267    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ncfjf"
Jul 27 21:42:11.600524 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:11.600489    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j994n\" (UniqueName: \"kubernetes.io/projected/5e0cb495-87ca-4ae3-a956-24488b4fa4bb-kube-api-access-j994n\") pod \"5e0cb495-87ca-4ae3-a956-24488b4fa4bb\" (UID: \"5e0cb495-87ca-4ae3-a956-24488b4fa4bb\") "
Jul 27 21:42:11.602890 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:11.602859    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e0cb495-87ca-4ae3-a956-24488b4fa4bb-kube-api-access-j994n" (OuterVolumeSpecName: "kube-api-access-j994n") pod "5e0cb495-87ca-4ae3-a956-24488b4fa4bb" (UID: "5e0cb495-87ca-4ae3-a956-24488b4fa4bb"). InnerVolumeSpecName "kube-api-access-j994n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:11.701355 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:11.701305    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j994n\" (UniqueName: \"kubernetes.io/projected/5e0cb495-87ca-4ae3-a956-24488b4fa4bb-kube-api-access-j994n\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:42:12.316929 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:12.316892    2554 generic.go:356] "Generic (PLEG): container finished" podID="5e0cb495-87ca-4ae3-a956-24488b4fa4bb" containerID="3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc" exitCode=0
Jul 27 21:42:12.317397 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:12.316934    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ncfjf"
Jul 27 21:42:12.317397 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:12.316977    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ncfjf" event={"ID":"5e0cb495-87ca-4ae3-a956-24488b4fa4bb","Type":"ContainerDied","Data":"3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc"}
Jul 27 21:42:12.317397 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:12.317025    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ncfjf" event={"ID":"5e0cb495-87ca-4ae3-a956-24488b4fa4bb","Type":"ContainerDied","Data":"3275dd9ebba4b462063b631ef8c0a7201fbe33790e90496c2336002bf0ff5a80"}
Jul 27 21:42:12.317397 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:12.317049    2554 scope.go:117] "RemoveContainer" containerID="3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc"
Jul 27 21:42:12.331964 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:12.331943    2554 scope.go:117] "RemoveContainer" containerID="3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc"
Jul 27 21:42:12.332251 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:42:12.332228    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc\": container with ID starting with 3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc not found: ID does not exist" containerID="3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc"
Jul 27 21:42:12.332331 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:12.332263    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc"} err="failed to get container status \"3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc\": rpc error: code = NotFound desc = could not find container \"3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc\": container with ID starting with 3d6cebecc1a0c1212302aad11558b5eb5fb841fc06be08079fd8e8d13c7298dc not found: ID does not exist"
Jul 27 21:42:12.342699 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:12.342671    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ncfjf"]
Jul 27 21:42:12.346116 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:12.346091    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ncfjf"]
Jul 27 21:42:12.921262 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:12.921225    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e0cb495-87ca-4ae3-a956-24488b4fa4bb" path="/var/lib/kubelet/pods/5e0cb495-87ca-4ae3-a956-24488b4fa4bb/volumes"
Jul 27 21:42:34.621325 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.621293    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zhq5c"]
Jul 27 21:42:34.621819 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.621668    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e0cb495-87ca-4ae3-a956-24488b4fa4bb" containerName="authorino"
Jul 27 21:42:34.621819 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.621679    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e0cb495-87ca-4ae3-a956-24488b4fa4bb" containerName="authorino"
Jul 27 21:42:34.621819 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.621754    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e0cb495-87ca-4ae3-a956-24488b4fa4bb" containerName="authorino"
Jul 27 21:42:34.625858 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.625838    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zhq5c"
Jul 27 21:42:34.631488 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.631463    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zhq5c"]
Jul 27 21:42:34.695539 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.695494    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88snb\" (UniqueName: \"kubernetes.io/projected/5d495805-f1a9-409c-a891-d47dccccfd2c-kube-api-access-88snb\") pod \"authorino-5d4b67c446-zhq5c\" (UID: \"5d495805-f1a9-409c-a891-d47dccccfd2c\") " pod="kuadrant-system/authorino-5d4b67c446-zhq5c"
Jul 27 21:42:34.796064 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.796031    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88snb\" (UniqueName: \"kubernetes.io/projected/5d495805-f1a9-409c-a891-d47dccccfd2c-kube-api-access-88snb\") pod \"authorino-5d4b67c446-zhq5c\" (UID: \"5d495805-f1a9-409c-a891-d47dccccfd2c\") " pod="kuadrant-system/authorino-5d4b67c446-zhq5c"
Jul 27 21:42:34.810529 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.810495    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88snb\" (UniqueName: \"kubernetes.io/projected/5d495805-f1a9-409c-a891-d47dccccfd2c-kube-api-access-88snb\") pod \"authorino-5d4b67c446-zhq5c\" (UID: \"5d495805-f1a9-409c-a891-d47dccccfd2c\") " pod="kuadrant-system/authorino-5d4b67c446-zhq5c"
Jul 27 21:42:34.884627 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.884519    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zhq5c"]
Jul 27 21:42:34.884868 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.884850    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zhq5c"
Jul 27 21:42:34.913519 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.913486    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86449479c7-bc6jw"]
Jul 27 21:42:34.918121 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.918095    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86449479c7-bc6jw"
Jul 27 21:42:34.925474 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.925426    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86449479c7-bc6jw"]
Jul 27 21:42:34.999205 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:34.998298    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z85m6\" (UniqueName: \"kubernetes.io/projected/8e250324-6214-4d36-8ae8-f59372d9bd28-kube-api-access-z85m6\") pod \"authorino-86449479c7-bc6jw\" (UID: \"8e250324-6214-4d36-8ae8-f59372d9bd28\") " pod="kuadrant-system/authorino-86449479c7-bc6jw"
Jul 27 21:42:35.030068 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.029864    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zhq5c"]
Jul 27 21:42:35.032455 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:42:35.032411    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d495805_f1a9_409c_a891_d47dccccfd2c.slice/crio-fca8d4d826340f85650fb904dc081674d4efff7c9465e652054d3a48c0765852 WatchSource:0}: Error finding container fca8d4d826340f85650fb904dc081674d4efff7c9465e652054d3a48c0765852: Status 404 returned error can't find the container with id fca8d4d826340f85650fb904dc081674d4efff7c9465e652054d3a48c0765852
Jul 27 21:42:35.052924 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.052894    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86449479c7-bc6jw"]
Jul 27 21:42:35.053202 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:42:35.053183    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-z85m6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-86449479c7-bc6jw" podUID="8e250324-6214-4d36-8ae8-f59372d9bd28"
Jul 27 21:42:35.086789 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.086741    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f58fb44b9-hfw67"]
Jul 27 21:42:35.091298 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.091278    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58fb44b9-hfw67"
Jul 27 21:42:35.094105 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.094082    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 21:42:35.098034 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.098008    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f58fb44b9-hfw67"]
Jul 27 21:42:35.098943 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.098918    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z85m6\" (UniqueName: \"kubernetes.io/projected/8e250324-6214-4d36-8ae8-f59372d9bd28-kube-api-access-z85m6\") pod \"authorino-86449479c7-bc6jw\" (UID: \"8e250324-6214-4d36-8ae8-f59372d9bd28\") " pod="kuadrant-system/authorino-86449479c7-bc6jw"
Jul 27 21:42:35.107991 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.107965    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z85m6\" (UniqueName: \"kubernetes.io/projected/8e250324-6214-4d36-8ae8-f59372d9bd28-kube-api-access-z85m6\") pod \"authorino-86449479c7-bc6jw\" (UID: \"8e250324-6214-4d36-8ae8-f59372d9bd28\") " pod="kuadrant-system/authorino-86449479c7-bc6jw"
Jul 27 21:42:35.200531 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.200422    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6hgp\" (UniqueName: \"kubernetes.io/projected/56fa948f-7126-4e32-a310-0fd505473c1a-kube-api-access-x6hgp\") pod \"authorino-5f58fb44b9-hfw67\" (UID: \"56fa948f-7126-4e32-a310-0fd505473c1a\") " pod="kuadrant-system/authorino-5f58fb44b9-hfw67"
Jul 27 21:42:35.200531 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.200500    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56fa948f-7126-4e32-a310-0fd505473c1a-tls-cert\") pod \"authorino-5f58fb44b9-hfw67\" (UID: \"56fa948f-7126-4e32-a310-0fd505473c1a\") " pod="kuadrant-system/authorino-5f58fb44b9-hfw67"
Jul 27 21:42:35.301768 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.301714    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6hgp\" (UniqueName: \"kubernetes.io/projected/56fa948f-7126-4e32-a310-0fd505473c1a-kube-api-access-x6hgp\") pod \"authorino-5f58fb44b9-hfw67\" (UID: \"56fa948f-7126-4e32-a310-0fd505473c1a\") " pod="kuadrant-system/authorino-5f58fb44b9-hfw67"
Jul 27 21:42:35.301768 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.301770    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56fa948f-7126-4e32-a310-0fd505473c1a-tls-cert\") pod \"authorino-5f58fb44b9-hfw67\" (UID: \"56fa948f-7126-4e32-a310-0fd505473c1a\") " pod="kuadrant-system/authorino-5f58fb44b9-hfw67"
Jul 27 21:42:35.304353 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.304333    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56fa948f-7126-4e32-a310-0fd505473c1a-tls-cert\") pod \"authorino-5f58fb44b9-hfw67\" (UID: \"56fa948f-7126-4e32-a310-0fd505473c1a\") " pod="kuadrant-system/authorino-5f58fb44b9-hfw67"
Jul 27 21:42:35.310226 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.310195    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6hgp\" (UniqueName: \"kubernetes.io/projected/56fa948f-7126-4e32-a310-0fd505473c1a-kube-api-access-x6hgp\") pod \"authorino-5f58fb44b9-hfw67\" (UID: \"56fa948f-7126-4e32-a310-0fd505473c1a\") " pod="kuadrant-system/authorino-5f58fb44b9-hfw67"
Jul 27 21:42:35.402575 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.402545    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58fb44b9-hfw67"
Jul 27 21:42:35.432826 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.432796    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zhq5c" event={"ID":"5d495805-f1a9-409c-a891-d47dccccfd2c","Type":"ContainerStarted","Data":"fca8d4d826340f85650fb904dc081674d4efff7c9465e652054d3a48c0765852"}
Jul 27 21:42:35.432961 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.432853    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86449479c7-bc6jw"
Jul 27 21:42:35.443484 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.443458    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86449479c7-bc6jw"
Jul 27 21:42:35.503519 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.503485    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z85m6\" (UniqueName: \"kubernetes.io/projected/8e250324-6214-4d36-8ae8-f59372d9bd28-kube-api-access-z85m6\") pod \"8e250324-6214-4d36-8ae8-f59372d9bd28\" (UID: \"8e250324-6214-4d36-8ae8-f59372d9bd28\") "
Jul 27 21:42:35.508183 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.508147    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e250324-6214-4d36-8ae8-f59372d9bd28-kube-api-access-z85m6" (OuterVolumeSpecName: "kube-api-access-z85m6") pod "8e250324-6214-4d36-8ae8-f59372d9bd28" (UID: "8e250324-6214-4d36-8ae8-f59372d9bd28"). InnerVolumeSpecName "kube-api-access-z85m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:35.560791 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.560766    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f58fb44b9-hfw67"]
Jul 27 21:42:35.562959 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:42:35.562928    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56fa948f_7126_4e32_a310_0fd505473c1a.slice/crio-39fc66727925aa251c3c0e2dcc100bc99222736ec76823662431550ea3e466c9 WatchSource:0}: Error finding container 39fc66727925aa251c3c0e2dcc100bc99222736ec76823662431550ea3e466c9: Status 404 returned error can't find the container with id 39fc66727925aa251c3c0e2dcc100bc99222736ec76823662431550ea3e466c9
Jul 27 21:42:35.604504 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:35.604468    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z85m6\" (UniqueName: \"kubernetes.io/projected/8e250324-6214-4d36-8ae8-f59372d9bd28-kube-api-access-z85m6\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:42:36.438884 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.438843    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58fb44b9-hfw67" event={"ID":"56fa948f-7126-4e32-a310-0fd505473c1a","Type":"ContainerStarted","Data":"3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d"}
Jul 27 21:42:36.439290 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.438896    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58fb44b9-hfw67" event={"ID":"56fa948f-7126-4e32-a310-0fd505473c1a","Type":"ContainerStarted","Data":"39fc66727925aa251c3c0e2dcc100bc99222736ec76823662431550ea3e466c9"}
Jul 27 21:42:36.440336 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.440317    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86449479c7-bc6jw"
Jul 27 21:42:36.440390 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.440330    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zhq5c" event={"ID":"5d495805-f1a9-409c-a891-d47dccccfd2c","Type":"ContainerStarted","Data":"35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0"}
Jul 27 21:42:36.440390 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.440345    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-zhq5c" podUID="5d495805-f1a9-409c-a891-d47dccccfd2c" containerName="authorino" containerID="cri-o://35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0" gracePeriod=30
Jul 27 21:42:36.455523 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.455466    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f58fb44b9-hfw67" podStartSLOduration=1.14140933 podStartE2EDuration="1.455427282s" totalImagesPullingTime="314.017952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:42:36.455238881 +0000 UTC m=+508.172645364" watchObservedRunningTime="2026-07-27 21:42:36.455427282 +0000 UTC m=+508.172833762"
Jul 27 21:42:36.473032 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.472970    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-zhq5c" podStartSLOduration=2.135168306 podStartE2EDuration="2.472948213s" totalImagesPullingTime="337.779907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:42:36.471568763 +0000 UTC m=+508.188975246" watchObservedRunningTime="2026-07-27 21:42:36.472948213 +0000 UTC m=+508.190354696"
Jul 27 21:42:36.486062 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.486026    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g96lt"]
Jul 27 21:42:36.486259 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.486239    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-g96lt" podUID="fd48eac0-03bf-447b-94f1-5d61ea6d8eec" containerName="authorino" containerID="cri-o://ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4" gracePeriod=30
Jul 27 21:42:36.501725 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.501558    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86449479c7-bc6jw"]
Jul 27 21:42:36.503216 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.503195    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86449479c7-bc6jw"]
Jul 27 21:42:36.719890 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.719864    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zhq5c"
Jul 27 21:42:36.756039 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.756015    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g96lt"
Jul 27 21:42:36.816676 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.816652    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88snb\" (UniqueName: \"kubernetes.io/projected/5d495805-f1a9-409c-a891-d47dccccfd2c-kube-api-access-88snb\") pod \"5d495805-f1a9-409c-a891-d47dccccfd2c\" (UID: \"5d495805-f1a9-409c-a891-d47dccccfd2c\") "
Jul 27 21:42:36.816788 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.816773    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8kzq\" (UniqueName: \"kubernetes.io/projected/fd48eac0-03bf-447b-94f1-5d61ea6d8eec-kube-api-access-k8kzq\") pod \"fd48eac0-03bf-447b-94f1-5d61ea6d8eec\" (UID: \"fd48eac0-03bf-447b-94f1-5d61ea6d8eec\") "
Jul 27 21:42:36.819147 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.819111    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd48eac0-03bf-447b-94f1-5d61ea6d8eec-kube-api-access-k8kzq" (OuterVolumeSpecName: "kube-api-access-k8kzq") pod "fd48eac0-03bf-447b-94f1-5d61ea6d8eec" (UID: "fd48eac0-03bf-447b-94f1-5d61ea6d8eec"). InnerVolumeSpecName "kube-api-access-k8kzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:36.819147 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.819132    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d495805-f1a9-409c-a891-d47dccccfd2c-kube-api-access-88snb" (OuterVolumeSpecName: "kube-api-access-88snb") pod "5d495805-f1a9-409c-a891-d47dccccfd2c" (UID: "5d495805-f1a9-409c-a891-d47dccccfd2c"). InnerVolumeSpecName "kube-api-access-88snb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:36.917661 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.917628    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8kzq\" (UniqueName: \"kubernetes.io/projected/fd48eac0-03bf-447b-94f1-5d61ea6d8eec-kube-api-access-k8kzq\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:42:36.917661 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.917657    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88snb\" (UniqueName: \"kubernetes.io/projected/5d495805-f1a9-409c-a891-d47dccccfd2c-kube-api-access-88snb\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:42:36.921488 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:36.921429    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e250324-6214-4d36-8ae8-f59372d9bd28" path="/var/lib/kubelet/pods/8e250324-6214-4d36-8ae8-f59372d9bd28/volumes"
Jul 27 21:42:37.446610 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.446573    2554 generic.go:356] "Generic (PLEG): container finished" podID="fd48eac0-03bf-447b-94f1-5d61ea6d8eec" containerID="ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4" exitCode=0
Jul 27 21:42:37.446988 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.446660    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g96lt" event={"ID":"fd48eac0-03bf-447b-94f1-5d61ea6d8eec","Type":"ContainerDied","Data":"ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4"}
Jul 27 21:42:37.446988 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.446703    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g96lt" event={"ID":"fd48eac0-03bf-447b-94f1-5d61ea6d8eec","Type":"ContainerDied","Data":"4cfe6af8e9b124eb449d1b5423f77c52a3037a79a48473745d4e544bd0c3a726"}
Jul 27 21:42:37.446988 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.446725    2554 scope.go:117] "RemoveContainer" containerID="ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4"
Jul 27 21:42:37.446988 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.446667    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g96lt"
Jul 27 21:42:37.448051 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.447970    2554 generic.go:356] "Generic (PLEG): container finished" podID="5d495805-f1a9-409c-a891-d47dccccfd2c" containerID="35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0" exitCode=0
Jul 27 21:42:37.448051 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.448012    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zhq5c"
Jul 27 21:42:37.448137 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.448051    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zhq5c" event={"ID":"5d495805-f1a9-409c-a891-d47dccccfd2c","Type":"ContainerDied","Data":"35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0"}
Jul 27 21:42:37.448137 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.448073    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zhq5c" event={"ID":"5d495805-f1a9-409c-a891-d47dccccfd2c","Type":"ContainerDied","Data":"fca8d4d826340f85650fb904dc081674d4efff7c9465e652054d3a48c0765852"}
Jul 27 21:42:37.456022 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.455997    2554 scope.go:117] "RemoveContainer" containerID="ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4"
Jul 27 21:42:37.456246 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:42:37.456230    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4\": container with ID starting with ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4 not found: ID does not exist" containerID="ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4"
Jul 27 21:42:37.456291 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.456254    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4"} err="failed to get container status \"ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4\": rpc error: code = NotFound desc = could not find container \"ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4\": container with ID starting with ae5d387c6f74801f6b694d6597f49882486cd11ff4e478c434e368506415ebf4 not found: ID does not exist"
Jul 27 21:42:37.456291 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.456276    2554 scope.go:117] "RemoveContainer" containerID="35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0"
Jul 27 21:42:37.463907 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.463891    2554 scope.go:117] "RemoveContainer" containerID="35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0"
Jul 27 21:42:37.464176 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:42:37.464159    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0\": container with ID starting with 35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0 not found: ID does not exist" containerID="35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0"
Jul 27 21:42:37.464250 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.464185    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0"} err="failed to get container status \"35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0\": rpc error: code = NotFound desc = could not find container \"35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0\": container with ID starting with 35f5c87d6f42e129aa9bd4033fe11507d078816b139fdd326e12932cf37b8cd0 not found: ID does not exist"
Jul 27 21:42:37.466534 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.466515    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g96lt"]
Jul 27 21:42:37.473664 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.473645    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g96lt"]
Jul 27 21:42:37.492373 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.492345    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zhq5c"]
Jul 27 21:42:37.495216 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:37.495197    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zhq5c"]
Jul 27 21:42:38.920493 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:38.920461    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d495805-f1a9-409c-a891-d47dccccfd2c" path="/var/lib/kubelet/pods/5d495805-f1a9-409c-a891-d47dccccfd2c/volumes"
Jul 27 21:42:38.920857 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:42:38.920797    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd48eac0-03bf-447b-94f1-5d61ea6d8eec" path="/var/lib/kubelet/pods/fd48eac0-03bf-447b-94f1-5d61ea6d8eec/volumes"
Jul 27 21:43:17.454506 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.454463    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"]
Jul 27 21:43:17.455088 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.455012    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd48eac0-03bf-447b-94f1-5d61ea6d8eec" containerName="authorino"
Jul 27 21:43:17.455088 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.455031    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd48eac0-03bf-447b-94f1-5d61ea6d8eec" containerName="authorino"
Jul 27 21:43:17.455088 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.455046    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d495805-f1a9-409c-a891-d47dccccfd2c" containerName="authorino"
Jul 27 21:43:17.455088 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.455054    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d495805-f1a9-409c-a891-d47dccccfd2c" containerName="authorino"
Jul 27 21:43:17.455276 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.455154    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd48eac0-03bf-447b-94f1-5d61ea6d8eec" containerName="authorino"
Jul 27 21:43:17.455276 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.455167    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d495805-f1a9-409c-a891-d47dccccfd2c" containerName="authorino"
Jul 27 21:43:17.459464 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.458984    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"
Jul 27 21:43:17.467457 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.466592    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9c4jr\""
Jul 27 21:43:17.468856 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.468736    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 21:43:17.476458 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.475630    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"]
Jul 27 21:43:17.580947 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.580904    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-768pd\" (UniqueName: \"kubernetes.io/projected/eae449a6-8f51-4162-8645-2809579ef364-kube-api-access-768pd\") pod \"payload-pre-processing-687dbb6cf6-rpm4j\" (UID: \"eae449a6-8f51-4162-8645-2809579ef364\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"
Jul 27 21:43:17.581112 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.581077    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eae449a6-8f51-4162-8645-2809579ef364-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-rpm4j\" (UID: \"eae449a6-8f51-4162-8645-2809579ef364\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"
Jul 27 21:43:17.681581 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.681543    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eae449a6-8f51-4162-8645-2809579ef364-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-rpm4j\" (UID: \"eae449a6-8f51-4162-8645-2809579ef364\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"
Jul 27 21:43:17.681746 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.681611    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-768pd\" (UniqueName: \"kubernetes.io/projected/eae449a6-8f51-4162-8645-2809579ef364-kube-api-access-768pd\") pod \"payload-pre-processing-687dbb6cf6-rpm4j\" (UID: \"eae449a6-8f51-4162-8645-2809579ef364\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"
Jul 27 21:43:17.682236 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.682217    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eae449a6-8f51-4162-8645-2809579ef364-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-rpm4j\" (UID: \"eae449a6-8f51-4162-8645-2809579ef364\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"
Jul 27 21:43:17.690828 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.690769    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-768pd\" (UniqueName: \"kubernetes.io/projected/eae449a6-8f51-4162-8645-2809579ef364-kube-api-access-768pd\") pod \"payload-pre-processing-687dbb6cf6-rpm4j\" (UID: \"eae449a6-8f51-4162-8645-2809579ef364\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"
Jul 27 21:43:17.776688 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.776647    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"
Jul 27 21:43:17.941157 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:17.941133    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"]
Jul 27 21:43:17.943366 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:43:17.943340    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae449a6_8f51_4162_8645_2809579ef364.slice/crio-eef0552ad13b52d162f301aee8f3d079fb06ebf4a9b17012b0d160d43657cd69 WatchSource:0}: Error finding container eef0552ad13b52d162f301aee8f3d079fb06ebf4a9b17012b0d160d43657cd69: Status 404 returned error can't find the container with id eef0552ad13b52d162f301aee8f3d079fb06ebf4a9b17012b0d160d43657cd69
Jul 27 21:43:18.662878 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:18.662809    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j" event={"ID":"eae449a6-8f51-4162-8645-2809579ef364","Type":"ContainerStarted","Data":"eef0552ad13b52d162f301aee8f3d079fb06ebf4a9b17012b0d160d43657cd69"}
Jul 27 21:43:19.669461 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:19.669354    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j" event={"ID":"eae449a6-8f51-4162-8645-2809579ef364","Type":"ContainerStarted","Data":"7a73444ac8cac596590b2c6c6ed36c0d13fcea6716ea85f320d4e6a9461e2d5e"}
Jul 27 21:43:19.669832 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:19.669489    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"
Jul 27 21:43:19.686392 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:19.686344    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j" podStartSLOduration=1.242211585 podStartE2EDuration="2.686329496s" totalImagesPullingTime="1.444117911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:43:19.684221361 +0000 UTC m=+551.401627846" watchObservedRunningTime="2026-07-27 21:43:19.686329496 +0000 UTC m=+551.403735976"
Jul 27 21:43:30.676528 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:30.676498    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rpm4j"
Jul 27 21:43:32.064454 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.064408    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"]
Jul 27 21:43:32.067188 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.067173    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.070285 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.070260    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 21:43:32.070415 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.070287    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 21:43:32.071331 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.071311    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dwq99\""
Jul 27 21:43:32.071487 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.071312    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 21:43:32.076820 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.076797    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"]
Jul 27 21:43:32.218837 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.218781    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d69f0c13-40c6-4c19-94f0-bb8862f91b20-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.219041 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.218849    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.219041 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.218875    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.219041 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.218915    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.219041 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.218984    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.219041 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.219008    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzmp7\" (UniqueName: \"kubernetes.io/projected/d69f0c13-40c6-4c19-94f0-bb8862f91b20-kube-api-access-hzmp7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.320197 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.320111    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.320197 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.320167    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.320197 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.320189    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzmp7\" (UniqueName: \"kubernetes.io/projected/d69f0c13-40c6-4c19-94f0-bb8862f91b20-kube-api-access-hzmp7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.320488 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.320236    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d69f0c13-40c6-4c19-94f0-bb8862f91b20-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.320488 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.320260    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.320488 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.320274    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.320672 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.320593    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.320672 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.320635    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.320741 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.320700    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.322587 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.322567    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d69f0c13-40c6-4c19-94f0-bb8862f91b20-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.322725 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.322710    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d69f0c13-40c6-4c19-94f0-bb8862f91b20-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.328654 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.328634    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzmp7\" (UniqueName: \"kubernetes.io/projected/d69f0c13-40c6-4c19-94f0-bb8862f91b20-kube-api-access-hzmp7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm\" (UID: \"d69f0c13-40c6-4c19-94f0-bb8862f91b20\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.377790 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.377751    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:32.516640 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.516618    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"]
Jul 27 21:43:32.519489 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:43:32.519462    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69f0c13_40c6_4c19_94f0_bb8862f91b20.slice/crio-edee07cd8bd13869fc97d56ecb9b74158c16ef01ffd9355b51d8ca6e1a369b9a WatchSource:0}: Error finding container edee07cd8bd13869fc97d56ecb9b74158c16ef01ffd9355b51d8ca6e1a369b9a: Status 404 returned error can't find the container with id edee07cd8bd13869fc97d56ecb9b74158c16ef01ffd9355b51d8ca6e1a369b9a
Jul 27 21:43:32.737754 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:32.737673    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm" event={"ID":"d69f0c13-40c6-4c19-94f0-bb8862f91b20","Type":"ContainerStarted","Data":"edee07cd8bd13869fc97d56ecb9b74158c16ef01ffd9355b51d8ca6e1a369b9a"}
Jul 27 21:43:34.751257 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:34.751217    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm" event={"ID":"d69f0c13-40c6-4c19-94f0-bb8862f91b20","Type":"ContainerStarted","Data":"9ce71c8746dc7fc4d9868ab470f5cf60102374bb1e6c2b3066a7411724260fc9"}
Jul 27 21:43:34.773391 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:34.773334    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm" podStartSLOduration=1.607841832 podStartE2EDuration="2.773315568s" totalImagesPullingTime="1.165473736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:43:34.77198404 +0000 UTC m=+566.489390521" watchObservedRunningTime="2026-07-27 21:43:34.773315568 +0000 UTC m=+566.490722049"
Jul 27 21:43:42.377985 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:42.377949    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:42.378603 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:42.378016    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:42.390220 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:42.390192    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:43:42.799924 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:43:42.799894    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm"
Jul 27 21:44:10.215448 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.215406    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:44:10.217144 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.216698    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:44:10.282759 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.282725    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"]
Jul 27 21:44:10.285610 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.285593    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.288444 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.288410    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 21:44:10.302080 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.302057    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"]
Jul 27 21:44:10.393271 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.393231    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nz2z\" (UniqueName: \"kubernetes.io/projected/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-kube-api-access-4nz2z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.393471 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.393348    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.393471 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.393373    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.393546 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.393473    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.393546 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.393502    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.393607 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.393545    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.494396 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.494302    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.494396 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.494357    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nz2z\" (UniqueName: \"kubernetes.io/projected/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-kube-api-access-4nz2z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.494634 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.494461    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.494634 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.494488    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.494634 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.494513    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.494634 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.494529    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.494863 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.494743    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.494920 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.494893    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.494971 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.494916    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.496901 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.496877    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.497234 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.497212    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.504311 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.504287    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nz2z\" (UniqueName: \"kubernetes.io/projected/0a6cc990-f32c-4881-8f9e-3ae5ff691d40-kube-api-access-4nz2z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9\" (UID: \"0a6cc990-f32c-4881-8f9e-3ae5ff691d40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.596056 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.596018    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:10.752530 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.752413    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"]
Jul 27 21:44:10.756703 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:44:10.756673    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6cc990_f32c_4881_8f9e_3ae5ff691d40.slice/crio-d2cca9f80bf6f345807840143c3f9a5d66ff117028168f5d15538f384e877fb4 WatchSource:0}: Error finding container d2cca9f80bf6f345807840143c3f9a5d66ff117028168f5d15538f384e877fb4: Status 404 returned error can't find the container with id d2cca9f80bf6f345807840143c3f9a5d66ff117028168f5d15538f384e877fb4
Jul 27 21:44:10.924364 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:10.924329    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9" event={"ID":"0a6cc990-f32c-4881-8f9e-3ae5ff691d40","Type":"ContainerStarted","Data":"d2cca9f80bf6f345807840143c3f9a5d66ff117028168f5d15538f384e877fb4"}
Jul 27 21:44:11.931149 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:11.931103    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9" event={"ID":"0a6cc990-f32c-4881-8f9e-3ae5ff691d40","Type":"ContainerStarted","Data":"44850304d0f6b8c5c079d86959b27ba742984a793fe3a1b56c4d54974b0924a6"}
Jul 27 21:44:11.952965 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:11.952918    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9" podStartSLOduration=1.7601132000000002 podStartE2EDuration="1.952900547s" totalImagesPullingTime="192.787347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:44:11.950558153 +0000 UTC m=+603.667964660" watchObservedRunningTime="2026-07-27 21:44:11.952900547 +0000 UTC m=+603.670307027"
Jul 27 21:44:20.596328 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:20.596286    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:20.596851 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:20.596355    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:20.608489 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:20.608451    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:44:20.993782 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:44:20.993752    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9"
Jul 27 21:45:13.339214 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.339180    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8766b45b-vzw5q"]
Jul 27 21:45:13.342194 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.342175    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8766b45b-vzw5q"
Jul 27 21:45:13.350004 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.349974    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8766b45b-vzw5q"]
Jul 27 21:45:13.410268 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.410232    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8-tls-cert\") pod \"authorino-8766b45b-vzw5q\" (UID: \"5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8\") " pod="kuadrant-system/authorino-8766b45b-vzw5q"
Jul 27 21:45:13.410503 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.410359    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lrlk\" (UniqueName: \"kubernetes.io/projected/5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8-kube-api-access-6lrlk\") pod \"authorino-8766b45b-vzw5q\" (UID: \"5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8\") " pod="kuadrant-system/authorino-8766b45b-vzw5q"
Jul 27 21:45:13.511036 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.511003    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lrlk\" (UniqueName: \"kubernetes.io/projected/5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8-kube-api-access-6lrlk\") pod \"authorino-8766b45b-vzw5q\" (UID: \"5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8\") " pod="kuadrant-system/authorino-8766b45b-vzw5q"
Jul 27 21:45:13.511194 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.511057    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8-tls-cert\") pod \"authorino-8766b45b-vzw5q\" (UID: \"5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8\") " pod="kuadrant-system/authorino-8766b45b-vzw5q"
Jul 27 21:45:13.513512 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.513494    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8-tls-cert\") pod \"authorino-8766b45b-vzw5q\" (UID: \"5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8\") " pod="kuadrant-system/authorino-8766b45b-vzw5q"
Jul 27 21:45:13.519682 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.519654    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lrlk\" (UniqueName: \"kubernetes.io/projected/5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8-kube-api-access-6lrlk\") pod \"authorino-8766b45b-vzw5q\" (UID: \"5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8\") " pod="kuadrant-system/authorino-8766b45b-vzw5q"
Jul 27 21:45:13.652164 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.652071    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8766b45b-vzw5q"
Jul 27 21:45:13.797051 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.797028    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8766b45b-vzw5q"]
Jul 27 21:45:13.799698 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:45:13.799667    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5627db5c_4d0d_4d9d_ad24_34f0cf08f6e8.slice/crio-64abf93aac2115509923742e644f57ed2b3a52574531f0350d4ca2e24731f437 WatchSource:0}: Error finding container 64abf93aac2115509923742e644f57ed2b3a52574531f0350d4ca2e24731f437: Status 404 returned error can't find the container with id 64abf93aac2115509923742e644f57ed2b3a52574531f0350d4ca2e24731f437
Jul 27 21:45:13.801025 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:13.801005    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:45:14.233778 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:14.233745    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8766b45b-vzw5q" event={"ID":"5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8","Type":"ContainerStarted","Data":"64abf93aac2115509923742e644f57ed2b3a52574531f0350d4ca2e24731f437"}
Jul 27 21:45:15.242500 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:15.242469    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8766b45b-vzw5q" event={"ID":"5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8","Type":"ContainerStarted","Data":"d7ab9c7c0a5cc37861dce6ad169c74eba49386f7d099c6724da66c6349b008a1"}
Jul 27 21:45:15.264291 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:15.264223    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8766b45b-vzw5q" podStartSLOduration=1.667777294 podStartE2EDuration="2.264201761s" totalImagesPullingTime="596.424467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:45:15.261611965 +0000 UTC m=+666.979018448" watchObservedRunningTime="2026-07-27 21:45:15.264201761 +0000 UTC m=+666.981608242"
Jul 27 21:45:15.298315 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:15.298278    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f58fb44b9-hfw67"]
Jul 27 21:45:15.298553 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:15.298521    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5f58fb44b9-hfw67" podUID="56fa948f-7126-4e32-a310-0fd505473c1a" containerName="authorino" containerID="cri-o://3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d" gracePeriod=30
Jul 27 21:45:15.553023 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:15.552987    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58fb44b9-hfw67"
Jul 27 21:45:15.632313 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:15.632269    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56fa948f-7126-4e32-a310-0fd505473c1a-tls-cert\") pod \"56fa948f-7126-4e32-a310-0fd505473c1a\" (UID: \"56fa948f-7126-4e32-a310-0fd505473c1a\") "
Jul 27 21:45:15.632517 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:15.632337    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6hgp\" (UniqueName: \"kubernetes.io/projected/56fa948f-7126-4e32-a310-0fd505473c1a-kube-api-access-x6hgp\") pod \"56fa948f-7126-4e32-a310-0fd505473c1a\" (UID: \"56fa948f-7126-4e32-a310-0fd505473c1a\") "
Jul 27 21:45:15.635115 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:15.635078    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56fa948f-7126-4e32-a310-0fd505473c1a-kube-api-access-x6hgp" (OuterVolumeSpecName: "kube-api-access-x6hgp") pod "56fa948f-7126-4e32-a310-0fd505473c1a" (UID: "56fa948f-7126-4e32-a310-0fd505473c1a"). InnerVolumeSpecName "kube-api-access-x6hgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:45:15.645196 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:15.645167    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fa948f-7126-4e32-a310-0fd505473c1a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "56fa948f-7126-4e32-a310-0fd505473c1a" (UID: "56fa948f-7126-4e32-a310-0fd505473c1a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:45:15.733798 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:15.733759    2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56fa948f-7126-4e32-a310-0fd505473c1a-tls-cert\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:45:15.733798 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:15.733791    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6hgp\" (UniqueName: \"kubernetes.io/projected/56fa948f-7126-4e32-a310-0fd505473c1a-kube-api-access-x6hgp\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:45:16.250209 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:16.250168    2554 generic.go:356] "Generic (PLEG): container finished" podID="56fa948f-7126-4e32-a310-0fd505473c1a" containerID="3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d" exitCode=0
Jul 27 21:45:16.250700 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:16.250231    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58fb44b9-hfw67"
Jul 27 21:45:16.250700 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:16.250258    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58fb44b9-hfw67" event={"ID":"56fa948f-7126-4e32-a310-0fd505473c1a","Type":"ContainerDied","Data":"3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d"}
Jul 27 21:45:16.250700 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:16.250299    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58fb44b9-hfw67" event={"ID":"56fa948f-7126-4e32-a310-0fd505473c1a","Type":"ContainerDied","Data":"39fc66727925aa251c3c0e2dcc100bc99222736ec76823662431550ea3e466c9"}
Jul 27 21:45:16.250700 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:16.250315    2554 scope.go:117] "RemoveContainer" containerID="3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d"
Jul 27 21:45:16.259627 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:16.259606    2554 scope.go:117] "RemoveContainer" containerID="3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d"
Jul 27 21:45:16.259914 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:45:16.259879    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d\": container with ID starting with 3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d not found: ID does not exist" containerID="3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d"
Jul 27 21:45:16.260008 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:16.259913    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d"} err="failed to get container status \"3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d\": rpc error: code = NotFound desc = could not find container \"3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d\": container with ID starting with 3f55a9b31c526418f0879e89361df7bf573315aa1af5219a6ed4efa675fab28d not found: ID does not exist"
Jul 27 21:45:16.278021 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:16.277997    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f58fb44b9-hfw67"]
Jul 27 21:45:16.283938 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:16.283909    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f58fb44b9-hfw67"]
Jul 27 21:45:16.920515 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:45:16.920482    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56fa948f-7126-4e32-a310-0fd505473c1a" path="/var/lib/kubelet/pods/56fa948f-7126-4e32-a310-0fd505473c1a/volumes"
Jul 27 21:49:10.255365 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:49:10.255245    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:49:10.260909 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:49:10.257620    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:52:12.043031 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:12.042945    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"]
Jul 27 21:52:12.043545 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:12.043200    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d" podUID="2179f712-eb8a-4cf2-8231-94ac1f977cb6" containerName="manager" containerID="cri-o://82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426" gracePeriod=10
Jul 27 21:52:15.214137 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.214105    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:52:15.320965 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.320873    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wtwb\" (UniqueName: \"kubernetes.io/projected/2179f712-eb8a-4cf2-8231-94ac1f977cb6-kube-api-access-9wtwb\") pod \"2179f712-eb8a-4cf2-8231-94ac1f977cb6\" (UID: \"2179f712-eb8a-4cf2-8231-94ac1f977cb6\") "
Jul 27 21:52:15.320965 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.320955    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2179f712-eb8a-4cf2-8231-94ac1f977cb6-extensions-socket-volume\") pod \"2179f712-eb8a-4cf2-8231-94ac1f977cb6\" (UID: \"2179f712-eb8a-4cf2-8231-94ac1f977cb6\") "
Jul 27 21:52:15.321403 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.321371    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2179f712-eb8a-4cf2-8231-94ac1f977cb6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2179f712-eb8a-4cf2-8231-94ac1f977cb6" (UID: "2179f712-eb8a-4cf2-8231-94ac1f977cb6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:52:15.323142 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.323111    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2179f712-eb8a-4cf2-8231-94ac1f977cb6-kube-api-access-9wtwb" (OuterVolumeSpecName: "kube-api-access-9wtwb") pod "2179f712-eb8a-4cf2-8231-94ac1f977cb6" (UID: "2179f712-eb8a-4cf2-8231-94ac1f977cb6"). InnerVolumeSpecName "kube-api-access-9wtwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:52:15.406408 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.406371    2554 generic.go:356] "Generic (PLEG): container finished" podID="2179f712-eb8a-4cf2-8231-94ac1f977cb6" containerID="82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426" exitCode=0
Jul 27 21:52:15.406585 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.406418    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"
Jul 27 21:52:15.406585 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.406421    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d" event={"ID":"2179f712-eb8a-4cf2-8231-94ac1f977cb6","Type":"ContainerDied","Data":"82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426"}
Jul 27 21:52:15.406585 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.406573    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d" event={"ID":"2179f712-eb8a-4cf2-8231-94ac1f977cb6","Type":"ContainerDied","Data":"dea8e2ee379b5e93e2f08ee37559bfe3960e10354e024380df49cfcef64f78e4"}
Jul 27 21:52:15.406694 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.406602    2554 scope.go:117] "RemoveContainer" containerID="82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426"
Jul 27 21:52:15.418420 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.418393    2554 scope.go:117] "RemoveContainer" containerID="82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426"
Jul 27 21:52:15.418779 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:52:15.418741    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426\": container with ID starting with 82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426 not found: ID does not exist" containerID="82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426"
Jul 27 21:52:15.418843 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.418792    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426"} err="failed to get container status \"82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426\": rpc error: code = NotFound desc = could not find container \"82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426\": container with ID starting with 82262dbfbfe3bb9bceb7d03da94cfab7c57e35cb90dd427f1128c0edc752c426 not found: ID does not exist"
Jul 27 21:52:15.422676 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.422641    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wtwb\" (UniqueName: \"kubernetes.io/projected/2179f712-eb8a-4cf2-8231-94ac1f977cb6-kube-api-access-9wtwb\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:52:15.422676 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.422673    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2179f712-eb8a-4cf2-8231-94ac1f977cb6-extensions-socket-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:52:15.429991 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.429950    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"]
Jul 27 21:52:15.433464 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:15.433406    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lcv4d"]
Jul 27 21:52:16.921880 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:52:16.921835    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2179f712-eb8a-4cf2-8231-94ac1f977cb6" path="/var/lib/kubelet/pods/2179f712-eb8a-4cf2-8231-94ac1f977cb6/volumes"
Jul 27 21:53:13.223837 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.223799    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"]
Jul 27 21:53:13.224249 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.224192    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fa948f-7126-4e32-a310-0fd505473c1a" containerName="authorino"
Jul 27 21:53:13.224249 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.224203    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fa948f-7126-4e32-a310-0fd505473c1a" containerName="authorino"
Jul 27 21:53:13.224249 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.224224    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2179f712-eb8a-4cf2-8231-94ac1f977cb6" containerName="manager"
Jul 27 21:53:13.224249 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.224229    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2179f712-eb8a-4cf2-8231-94ac1f977cb6" containerName="manager"
Jul 27 21:53:13.224381 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.224288    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2179f712-eb8a-4cf2-8231-94ac1f977cb6" containerName="manager"
Jul 27 21:53:13.224381 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.224299    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fa948f-7126-4e32-a310-0fd505473c1a" containerName="authorino"
Jul 27 21:53:13.228120 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.228095    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"
Jul 27 21:53:13.231293 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.231271    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ns8lb\""
Jul 27 21:53:13.238619 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.238586    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"]
Jul 27 21:53:13.391628 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.391585    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eefea127-b6ea-4928-b497-8c0851d18c96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v6ns2\" (UID: \"eefea127-b6ea-4928-b497-8c0851d18c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"
Jul 27 21:53:13.391628 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.391623    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcrbc\" (UniqueName: \"kubernetes.io/projected/eefea127-b6ea-4928-b497-8c0851d18c96-kube-api-access-mcrbc\") pod \"kuadrant-operator-controller-manager-86878c769f-v6ns2\" (UID: \"eefea127-b6ea-4928-b497-8c0851d18c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"
Jul 27 21:53:13.492779 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.492677    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eefea127-b6ea-4928-b497-8c0851d18c96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v6ns2\" (UID: \"eefea127-b6ea-4928-b497-8c0851d18c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"
Jul 27 21:53:13.492779 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.492719    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcrbc\" (UniqueName: \"kubernetes.io/projected/eefea127-b6ea-4928-b497-8c0851d18c96-kube-api-access-mcrbc\") pod \"kuadrant-operator-controller-manager-86878c769f-v6ns2\" (UID: \"eefea127-b6ea-4928-b497-8c0851d18c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"
Jul 27 21:53:13.493105 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.493083    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eefea127-b6ea-4928-b497-8c0851d18c96-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v6ns2\" (UID: \"eefea127-b6ea-4928-b497-8c0851d18c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"
Jul 27 21:53:13.501730 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.501699    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcrbc\" (UniqueName: \"kubernetes.io/projected/eefea127-b6ea-4928-b497-8c0851d18c96-kube-api-access-mcrbc\") pod \"kuadrant-operator-controller-manager-86878c769f-v6ns2\" (UID: \"eefea127-b6ea-4928-b497-8c0851d18c96\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"
Jul 27 21:53:13.540703 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.540659    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"
Jul 27 21:53:13.694366 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.694335    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"]
Jul 27 21:53:13.696980 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:53:13.696949    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefea127_b6ea_4928_b497_8c0851d18c96.slice/crio-7299f7581a0c85926e07c8de1b9f0204b0b90489a5c4a951a18a1f9a0a05a1a9 WatchSource:0}: Error finding container 7299f7581a0c85926e07c8de1b9f0204b0b90489a5c4a951a18a1f9a0a05a1a9: Status 404 returned error can't find the container with id 7299f7581a0c85926e07c8de1b9f0204b0b90489a5c4a951a18a1f9a0a05a1a9
Jul 27 21:53:13.717152 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:13.717110    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2" event={"ID":"eefea127-b6ea-4928-b497-8c0851d18c96","Type":"ContainerStarted","Data":"7299f7581a0c85926e07c8de1b9f0204b0b90489a5c4a951a18a1f9a0a05a1a9"}
Jul 27 21:53:14.723596 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:14.723557    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2" event={"ID":"eefea127-b6ea-4928-b497-8c0851d18c96","Type":"ContainerStarted","Data":"6fd954af68cc0bd8fbc7f1e10d9442080bbb2b6df600b134c330e38f48714900"}
Jul 27 21:53:14.724070 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:14.723625    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"
Jul 27 21:53:14.744163 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:14.744093    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2" podStartSLOduration=1.744066948 podStartE2EDuration="1.744066948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:53:14.743236799 +0000 UTC m=+1146.460643282" watchObservedRunningTime="2026-07-27 21:53:14.744066948 +0000 UTC m=+1146.461473431"
Jul 27 21:53:25.731158 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:53:25.731079    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v6ns2"
Jul 27 21:54:10.293883 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:54:10.293766    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:54:10.298536 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:54:10.298516    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:56:32.278910 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.278811    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"]
Jul 27 21:56:32.282824 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.282800    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.285583 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.285556    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-b1bf115a-kserve-self-signed-certs\""
Jul 27 21:56:32.294307 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.294272    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"]
Jul 27 21:56:32.367040 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.366997    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60816256-cf9c-4149-9499-b0cca19bd994-tls-certs\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.367040 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.367039    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-tmp-dir\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.367267 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.367077    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-dshm\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.367267 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.367134    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-home\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.367267 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.367174    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdm7c\" (UniqueName: \"kubernetes.io/projected/60816256-cf9c-4149-9499-b0cca19bd994-kube-api-access-sdm7c\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.367377 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.367284    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-model-cache\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.468230 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.468181    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60816256-cf9c-4149-9499-b0cca19bd994-tls-certs\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.468230 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.468231    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-tmp-dir\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.468568 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.468281    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-dshm\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.468568 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.468385    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-home\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.468568 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.468423    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdm7c\" (UniqueName: \"kubernetes.io/projected/60816256-cf9c-4149-9499-b0cca19bd994-kube-api-access-sdm7c\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.468733 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.468593    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-model-cache\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.468838 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.468814    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-home\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.468902 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.468841    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-tmp-dir\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.468902 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.468886    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-model-cache\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.470917 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.470891    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-dshm\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.471206 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.471185    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60816256-cf9c-4149-9499-b0cca19bd994-tls-certs\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.477935 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.477906    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdm7c\" (UniqueName: \"kubernetes.io/projected/60816256-cf9c-4149-9499-b0cca19bd994-kube-api-access-sdm7c\") pod \"e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") " pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.593510 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.593377    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:32.763577 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.763546    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"]
Jul 27 21:56:32.766681 ip-10-0-136-223 kubenswrapper[2554]: W0727 21:56:32.766638    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60816256_cf9c_4149_9499_b0cca19bd994.slice/crio-951f5c7d9311beb571e1e3175fd4d427e18d8e3876420cfc630b84fdaea444fb WatchSource:0}: Error finding container 951f5c7d9311beb571e1e3175fd4d427e18d8e3876420cfc630b84fdaea444fb: Status 404 returned error can't find the container with id 951f5c7d9311beb571e1e3175fd4d427e18d8e3876420cfc630b84fdaea444fb
Jul 27 21:56:32.787127 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:32.787094    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh" event={"ID":"60816256-cf9c-4149-9499-b0cca19bd994","Type":"ContainerStarted","Data":"951f5c7d9311beb571e1e3175fd4d427e18d8e3876420cfc630b84fdaea444fb"}
Jul 27 21:56:33.794668 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:33.794604    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh" event={"ID":"60816256-cf9c-4149-9499-b0cca19bd994","Type":"ContainerStarted","Data":"b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d"}
Jul 27 21:56:33.814093 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:33.814031    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh" podStartSLOduration=1.8140123479999999 podStartE2EDuration="1.814012348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:33.813041187 +0000 UTC m=+1345.530447668" watchObservedRunningTime="2026-07-27 21:56:33.814012348 +0000 UTC m=+1345.531418830"
Jul 27 21:56:42.594350 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:42.594308    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:42.594889 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:42.594367    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:42.607200 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:42.607171    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:42.855981 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:42.855897    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:56:52.031229 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:56:52.031191    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"]
Jul 27 21:57:07.052533 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.052425    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh" podUID="60816256-cf9c-4149-9499-b0cca19bd994" containerName="main" containerID="cri-o://b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d" gracePeriod=45
Jul 27 21:57:07.319276 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.319243    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:57:07.415156 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.415123    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-tmp-dir\") pod \"60816256-cf9c-4149-9499-b0cca19bd994\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") "
Jul 27 21:57:07.415349 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.415172    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-home\") pod \"60816256-cf9c-4149-9499-b0cca19bd994\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") "
Jul 27 21:57:07.415349 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.415220    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdm7c\" (UniqueName: \"kubernetes.io/projected/60816256-cf9c-4149-9499-b0cca19bd994-kube-api-access-sdm7c\") pod \"60816256-cf9c-4149-9499-b0cca19bd994\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") "
Jul 27 21:57:07.415349 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.415258    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60816256-cf9c-4149-9499-b0cca19bd994-tls-certs\") pod \"60816256-cf9c-4149-9499-b0cca19bd994\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") "
Jul 27 21:57:07.415349 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.415279    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-model-cache\") pod \"60816256-cf9c-4149-9499-b0cca19bd994\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") "
Jul 27 21:57:07.415349 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.415336    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-dshm\") pod \"60816256-cf9c-4149-9499-b0cca19bd994\" (UID: \"60816256-cf9c-4149-9499-b0cca19bd994\") "
Jul 27 21:57:07.415642 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.415477    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60816256-cf9c-4149-9499-b0cca19bd994" (UID: "60816256-cf9c-4149-9499-b0cca19bd994"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:57:07.415642 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.415604    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-home" (OuterVolumeSpecName: "home") pod "60816256-cf9c-4149-9499-b0cca19bd994" (UID: "60816256-cf9c-4149-9499-b0cca19bd994"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:57:07.415795 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.415769    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-home\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:57:07.415939 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.415804    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-model-cache" (OuterVolumeSpecName: "model-cache") pod "60816256-cf9c-4149-9499-b0cca19bd994" (UID: "60816256-cf9c-4149-9499-b0cca19bd994"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:57:07.415939 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.415822    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-tmp-dir\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:57:07.417870 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.417831    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-dshm" (OuterVolumeSpecName: "dshm") pod "60816256-cf9c-4149-9499-b0cca19bd994" (UID: "60816256-cf9c-4149-9499-b0cca19bd994"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:57:07.417984 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.417878    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60816256-cf9c-4149-9499-b0cca19bd994-kube-api-access-sdm7c" (OuterVolumeSpecName: "kube-api-access-sdm7c") pod "60816256-cf9c-4149-9499-b0cca19bd994" (UID: "60816256-cf9c-4149-9499-b0cca19bd994"). InnerVolumeSpecName "kube-api-access-sdm7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:57:07.417984 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.417930    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60816256-cf9c-4149-9499-b0cca19bd994-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60816256-cf9c-4149-9499-b0cca19bd994" (UID: "60816256-cf9c-4149-9499-b0cca19bd994"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:57:07.516660 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.516620    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdm7c\" (UniqueName: \"kubernetes.io/projected/60816256-cf9c-4149-9499-b0cca19bd994-kube-api-access-sdm7c\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:57:07.516660 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.516653    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60816256-cf9c-4149-9499-b0cca19bd994-tls-certs\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:57:07.516660 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.516664    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-model-cache\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:57:07.516660 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.516672    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60816256-cf9c-4149-9499-b0cca19bd994-dshm\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 21:57:07.989862 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.989826    2554 generic.go:356] "Generic (PLEG): container finished" podID="60816256-cf9c-4149-9499-b0cca19bd994" containerID="b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d" exitCode=0
Jul 27 21:57:07.989862 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.989869    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"
Jul 27 21:57:07.990101 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.989903    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh" event={"ID":"60816256-cf9c-4149-9499-b0cca19bd994","Type":"ContainerDied","Data":"b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d"}
Jul 27 21:57:07.990101 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.989948    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh" event={"ID":"60816256-cf9c-4149-9499-b0cca19bd994","Type":"ContainerDied","Data":"951f5c7d9311beb571e1e3175fd4d427e18d8e3876420cfc630b84fdaea444fb"}
Jul 27 21:57:07.990101 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:07.989966    2554 scope.go:117] "RemoveContainer" containerID="b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d"
Jul 27 21:57:08.000046 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:08.000025    2554 scope.go:117] "RemoveContainer" containerID="b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d"
Jul 27 21:57:08.000380 ip-10-0-136-223 kubenswrapper[2554]: E0727 21:57:08.000358    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d\": container with ID starting with b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d not found: ID does not exist" containerID="b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d"
Jul 27 21:57:08.000523 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:08.000392    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d"} err="failed to get container status \"b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d\": rpc error: code = NotFound desc = could not find container \"b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d\": container with ID starting with b50a20aa35361cb76141c62c3c515fea5e05e974ffaa741d6e2234924f57990d not found: ID does not exist"
Jul 27 21:57:08.017465 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:08.017405    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"]
Jul 27 21:57:08.021759 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:08.021717    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-b1bf115a-kserve-5968f8c6c9-f58sh"]
Jul 27 21:57:08.922913 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:57:08.922878    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60816256-cf9c-4149-9499-b0cca19bd994" path="/var/lib/kubelet/pods/60816256-cf9c-4149-9499-b0cca19bd994/volumes"
Jul 27 21:59:10.326557 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:59:10.326420    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 21:59:10.337006 ip-10-0-136-223 kubenswrapper[2554]: I0727 21:59:10.336977    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:00:38.813924 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:38.813879    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"]
Jul 27 22:00:38.814399 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:38.814300    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60816256-cf9c-4149-9499-b0cca19bd994" containerName="main"
Jul 27 22:00:38.814399 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:38.814311    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="60816256-cf9c-4149-9499-b0cca19bd994" containerName="main"
Jul 27 22:00:38.814399 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:38.814367    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="60816256-cf9c-4149-9499-b0cca19bd994" containerName="main"
Jul 27 22:00:38.817537 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:38.817510    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:00:38.821161 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:38.821138    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b8dde9de\""
Jul 27 22:00:38.821585 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:38.821564    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b8dde9de-dockercfg-kgqv4\""
Jul 27 22:00:38.834730 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:38.834698    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"]
Jul 27 22:00:38.951273 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:38.951233    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f754\" (UniqueName: \"kubernetes.io/projected/d9e75caf-f7ea-4f85-9bad-07bf17905c23-kube-api-access-6f754\") pod \"payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs\" (UID: \"d9e75caf-f7ea-4f85-9bad-07bf17905c23\") " pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:00:38.951505 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:38.951327    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9e75caf-f7ea-4f85-9bad-07bf17905c23-plugins-config-volume\") pod \"payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs\" (UID: \"d9e75caf-f7ea-4f85-9bad-07bf17905c23\") " pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:00:39.052873 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:39.052833    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9e75caf-f7ea-4f85-9bad-07bf17905c23-plugins-config-volume\") pod \"payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs\" (UID: \"d9e75caf-f7ea-4f85-9bad-07bf17905c23\") " pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:00:39.053079 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:39.052932    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f754\" (UniqueName: \"kubernetes.io/projected/d9e75caf-f7ea-4f85-9bad-07bf17905c23-kube-api-access-6f754\") pod \"payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs\" (UID: \"d9e75caf-f7ea-4f85-9bad-07bf17905c23\") " pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:00:39.053622 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:39.053600    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9e75caf-f7ea-4f85-9bad-07bf17905c23-plugins-config-volume\") pod \"payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs\" (UID: \"d9e75caf-f7ea-4f85-9bad-07bf17905c23\") " pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:00:39.064019 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:39.063935    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f754\" (UniqueName: \"kubernetes.io/projected/d9e75caf-f7ea-4f85-9bad-07bf17905c23-kube-api-access-6f754\") pod \"payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs\" (UID: \"d9e75caf-f7ea-4f85-9bad-07bf17905c23\") " pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:00:39.129552 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:39.129520    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:00:39.286462 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:39.286403    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"]
Jul 27 22:00:39.290308 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:00:39.290280    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e75caf_f7ea_4f85_9bad_07bf17905c23.slice/crio-5e610a4ce239fb3e9b4c1398e62c7227a04e79350f2885764dbee8d24a016e58 WatchSource:0}: Error finding container 5e610a4ce239fb3e9b4c1398e62c7227a04e79350f2885764dbee8d24a016e58: Status 404 returned error can't find the container with id 5e610a4ce239fb3e9b4c1398e62c7227a04e79350f2885764dbee8d24a016e58
Jul 27 22:00:40.092638 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:40.092596    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs" event={"ID":"d9e75caf-f7ea-4f85-9bad-07bf17905c23","Type":"ContainerStarted","Data":"a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20"}
Jul 27 22:00:40.093033 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:40.092651    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs" event={"ID":"d9e75caf-f7ea-4f85-9bad-07bf17905c23","Type":"ContainerStarted","Data":"5e610a4ce239fb3e9b4c1398e62c7227a04e79350f2885764dbee8d24a016e58"}
Jul 27 22:00:40.093033 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:40.092674    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:00:40.114011 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:40.113943    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs" podStartSLOduration=2.113924756 podStartE2EDuration="2.113924756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:00:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:00:40.112503794 +0000 UTC m=+1591.829910275" watchObservedRunningTime="2026-07-27 22:00:40.113924756 +0000 UTC m=+1591.831331237"
Jul 27 22:00:51.099853 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:00:51.099817    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:01:19.191863 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:19.191816    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"]
Jul 27 22:01:19.192415 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:19.192109    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs" podUID="d9e75caf-f7ea-4f85-9bad-07bf17905c23" containerName="payload-processing" containerID="cri-o://a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20" gracePeriod=30
Jul 27 22:01:19.466255 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:19.466218    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:01:19.549706 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:19.549668    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9e75caf-f7ea-4f85-9bad-07bf17905c23-plugins-config-volume\") pod \"d9e75caf-f7ea-4f85-9bad-07bf17905c23\" (UID: \"d9e75caf-f7ea-4f85-9bad-07bf17905c23\") "
Jul 27 22:01:19.549874 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:19.549746    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f754\" (UniqueName: \"kubernetes.io/projected/d9e75caf-f7ea-4f85-9bad-07bf17905c23-kube-api-access-6f754\") pod \"d9e75caf-f7ea-4f85-9bad-07bf17905c23\" (UID: \"d9e75caf-f7ea-4f85-9bad-07bf17905c23\") "
Jul 27 22:01:19.550102 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:19.550075    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e75caf-f7ea-4f85-9bad-07bf17905c23-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d9e75caf-f7ea-4f85-9bad-07bf17905c23" (UID: "d9e75caf-f7ea-4f85-9bad-07bf17905c23"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:01:19.552209 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:19.552175    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e75caf-f7ea-4f85-9bad-07bf17905c23-kube-api-access-6f754" (OuterVolumeSpecName: "kube-api-access-6f754") pod "d9e75caf-f7ea-4f85-9bad-07bf17905c23" (UID: "d9e75caf-f7ea-4f85-9bad-07bf17905c23"). InnerVolumeSpecName "kube-api-access-6f754". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:01:19.650808 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:19.650749    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f754\" (UniqueName: \"kubernetes.io/projected/d9e75caf-f7ea-4f85-9bad-07bf17905c23-kube-api-access-6f754\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:01:19.650808 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:19.650795    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9e75caf-f7ea-4f85-9bad-07bf17905c23-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:01:20.306246 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:20.306204    2554 generic.go:356] "Generic (PLEG): container finished" podID="d9e75caf-f7ea-4f85-9bad-07bf17905c23" containerID="a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20" exitCode=0
Jul 27 22:01:20.306246 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:20.306250    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"
Jul 27 22:01:20.306783 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:20.306289    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs" event={"ID":"d9e75caf-f7ea-4f85-9bad-07bf17905c23","Type":"ContainerDied","Data":"a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20"}
Jul 27 22:01:20.306783 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:20.306349    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs" event={"ID":"d9e75caf-f7ea-4f85-9bad-07bf17905c23","Type":"ContainerDied","Data":"5e610a4ce239fb3e9b4c1398e62c7227a04e79350f2885764dbee8d24a016e58"}
Jul 27 22:01:20.306783 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:20.306376    2554 scope.go:117] "RemoveContainer" containerID="a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20"
Jul 27 22:01:20.316348 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:20.316328    2554 scope.go:117] "RemoveContainer" containerID="a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20"
Jul 27 22:01:20.316690 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:01:20.316669    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20\": container with ID starting with a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20 not found: ID does not exist" containerID="a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20"
Jul 27 22:01:20.316759 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:20.316698    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20"} err="failed to get container status \"a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20\": rpc error: code = NotFound desc = could not find container \"a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20\": container with ID starting with a7c2f8abc5e05a7bf8f94d4191968844e75fdfe925c7d9423c4953346a250c20 not found: ID does not exist"
Jul 27 22:01:20.350351 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:20.350315    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"]
Jul 27 22:01:20.358990 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:20.358954    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b8dde9de-85db5b5cf8-h6rgs"]
Jul 27 22:01:20.921274 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:20.921237    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9e75caf-f7ea-4f85-9bad-07bf17905c23" path="/var/lib/kubelet/pods/d9e75caf-f7ea-4f85-9bad-07bf17905c23/volumes"
Jul 27 22:01:27.308064 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.308026    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"]
Jul 27 22:01:27.308506 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.308472    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e75caf-f7ea-4f85-9bad-07bf17905c23" containerName="payload-processing"
Jul 27 22:01:27.308506 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.308489    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e75caf-f7ea-4f85-9bad-07bf17905c23" containerName="payload-processing"
Jul 27 22:01:27.308582 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.308560    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e75caf-f7ea-4f85-9bad-07bf17905c23" containerName="payload-processing"
Jul 27 22:01:27.313217 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.313189    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"]
Jul 27 22:01:27.313386 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.313323    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:27.316853 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.316831    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:27.318603 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.318582    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d38e15cc\""
Jul 27 22:01:27.318716 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.318584    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d38e15cc-dockercfg-k4ctd\""
Jul 27 22:01:27.339874 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.339836    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"]
Jul 27 22:01:27.342290 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.342256    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"]
Jul 27 22:01:27.421519 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.421487    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9f129cd-72f0-45cd-b1c3-8215266d348d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd\" (UID: \"c9f129cd-72f0-45cd-b1c3-8215266d348d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:27.421519 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.421524    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g\" (UID: \"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:27.421800 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.421545    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rcrj\" (UniqueName: \"kubernetes.io/projected/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-kube-api-access-9rcrj\") pod \"payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g\" (UID: \"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:27.421800 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.421577    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gtxz\" (UniqueName: \"kubernetes.io/projected/c9f129cd-72f0-45cd-b1c3-8215266d348d-kube-api-access-8gtxz\") pod \"payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd\" (UID: \"c9f129cd-72f0-45cd-b1c3-8215266d348d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:27.523167 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.523121    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9f129cd-72f0-45cd-b1c3-8215266d348d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd\" (UID: \"c9f129cd-72f0-45cd-b1c3-8215266d348d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:27.523167 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.523170    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g\" (UID: \"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:27.523384 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.523218    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rcrj\" (UniqueName: \"kubernetes.io/projected/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-kube-api-access-9rcrj\") pod \"payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g\" (UID: \"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:27.523384 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.523260    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gtxz\" (UniqueName: \"kubernetes.io/projected/c9f129cd-72f0-45cd-b1c3-8215266d348d-kube-api-access-8gtxz\") pod \"payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd\" (UID: \"c9f129cd-72f0-45cd-b1c3-8215266d348d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:27.524027 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.524007    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9f129cd-72f0-45cd-b1c3-8215266d348d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd\" (UID: \"c9f129cd-72f0-45cd-b1c3-8215266d348d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:27.524096 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.524074    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g\" (UID: \"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:27.539153 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.539114    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gtxz\" (UniqueName: \"kubernetes.io/projected/c9f129cd-72f0-45cd-b1c3-8215266d348d-kube-api-access-8gtxz\") pod \"payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd\" (UID: \"c9f129cd-72f0-45cd-b1c3-8215266d348d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:27.539561 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.539539    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rcrj\" (UniqueName: \"kubernetes.io/projected/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-kube-api-access-9rcrj\") pod \"payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g\" (UID: \"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4\") " pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:27.626417 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.626265    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:27.633623 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.633578    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:27.838849 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.838805    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"]
Jul 27 22:01:27.848188 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:01:27.848155    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f129cd_72f0_45cd_b1c3_8215266d348d.slice/crio-0f835b5bef7178cbdd539a9ddac185b7acaf7f11d350b70785fe7caf3c359f61 WatchSource:0}: Error finding container 0f835b5bef7178cbdd539a9ddac185b7acaf7f11d350b70785fe7caf3c359f61: Status 404 returned error can't find the container with id 0f835b5bef7178cbdd539a9ddac185b7acaf7f11d350b70785fe7caf3c359f61
Jul 27 22:01:27.852954 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:27.852924    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"]
Jul 27 22:01:27.855370 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:01:27.855338    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf84a18f_0421_4fe2_9f56_5c7f2efe3fa4.slice/crio-c55316040bc9811ed1b6780779cd4ba563d58b4aeab6eb41c8ccaaea355fe94d WatchSource:0}: Error finding container c55316040bc9811ed1b6780779cd4ba563d58b4aeab6eb41c8ccaaea355fe94d: Status 404 returned error can't find the container with id c55316040bc9811ed1b6780779cd4ba563d58b4aeab6eb41c8ccaaea355fe94d
Jul 27 22:01:28.356316 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:28.356280    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd" event={"ID":"c9f129cd-72f0-45cd-b1c3-8215266d348d","Type":"ContainerStarted","Data":"7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e"}
Jul 27 22:01:28.356804 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:28.356335    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd" event={"ID":"c9f129cd-72f0-45cd-b1c3-8215266d348d","Type":"ContainerStarted","Data":"0f835b5bef7178cbdd539a9ddac185b7acaf7f11d350b70785fe7caf3c359f61"}
Jul 27 22:01:28.356804 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:28.356368    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:28.357922 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:28.357900    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g" event={"ID":"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4","Type":"ContainerStarted","Data":"f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c"}
Jul 27 22:01:28.358002 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:28.357940    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g" event={"ID":"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4","Type":"ContainerStarted","Data":"c55316040bc9811ed1b6780779cd4ba563d58b4aeab6eb41c8ccaaea355fe94d"}
Jul 27 22:01:28.358002 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:28.357972    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:28.467694 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:28.467635    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd" podStartSLOduration=1.467613037 podStartE2EDuration="1.467613037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:01:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:01:28.460221232 +0000 UTC m=+1640.177627708" watchObservedRunningTime="2026-07-27 22:01:28.467613037 +0000 UTC m=+1640.185019521"
Jul 27 22:01:28.574587 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:28.574530    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g" podStartSLOduration=1.574506255 podStartE2EDuration="1.574506255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:01:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:01:28.570578993 +0000 UTC m=+1640.287985476" watchObservedRunningTime="2026-07-27 22:01:28.574506255 +0000 UTC m=+1640.291912741"
Jul 27 22:01:39.366753 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:39.366702    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd" podUID="c9f129cd-72f0-45cd-b1c3-8215266d348d" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.45:9004: connect: connection refused"
Jul 27 22:01:39.367219 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:39.367122    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:49.365720 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:49.365688    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:51.042539 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:51.042498    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"]
Jul 27 22:01:51.046314 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:51.046290    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"
Jul 27 22:01:51.056065 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:51.056038    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:01:51.064820 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:51.064794    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:01:51.076884 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:51.076826    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"]
Jul 27 22:01:51.157469 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:51.157394    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26232dab-32f0-4b10-a0f7-393aee68b468-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822\" (UID: \"26232dab-32f0-4b10-a0f7-393aee68b468\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"
Jul 27 22:01:51.258172 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:51.258131    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26232dab-32f0-4b10-a0f7-393aee68b468-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822\" (UID: \"26232dab-32f0-4b10-a0f7-393aee68b468\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"
Jul 27 22:01:51.258854 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:51.258827    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26232dab-32f0-4b10-a0f7-393aee68b468-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822\" (UID: \"26232dab-32f0-4b10-a0f7-393aee68b468\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"
Jul 27 22:01:51.359507 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:51.359397    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"
Jul 27 22:01:51.520294 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:51.520258    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"]
Jul 27 22:01:51.523863 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:01:51.523819    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26232dab_32f0_4b10_a0f7_393aee68b468.slice/crio-8af810d7dfe00150db226f0e187422d1d1a340228d928f76ce8c28db408a4894 WatchSource:0}: Error finding container 8af810d7dfe00150db226f0e187422d1d1a340228d928f76ce8c28db408a4894: Status 404 returned error can't find the container with id 8af810d7dfe00150db226f0e187422d1d1a340228d928f76ce8c28db408a4894
Jul 27 22:01:51.526017 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:51.525997    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 22:01:52.498265 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:52.498227    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822" event={"ID":"26232dab-32f0-4b10-a0f7-393aee68b468","Type":"ContainerStarted","Data":"8af810d7dfe00150db226f0e187422d1d1a340228d928f76ce8c28db408a4894"}
Jul 27 22:01:54.511176 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:54.511135    2554 generic.go:356] "Generic (PLEG): container finished" podID="26232dab-32f0-4b10-a0f7-393aee68b468" containerID="d90e02322911ccbd3b1f5e55b939e97732ffb35644302100e3c59688557a2353" exitCode=0
Jul 27 22:01:54.511592 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:54.511217    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822" event={"ID":"26232dab-32f0-4b10-a0f7-393aee68b468","Type":"ContainerDied","Data":"d90e02322911ccbd3b1f5e55b939e97732ffb35644302100e3c59688557a2353"}
Jul 27 22:01:55.658615 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:55.658580    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"
Jul 27 22:01:55.808169 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:55.808077    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26232dab-32f0-4b10-a0f7-393aee68b468-maas-api-service-ca\") pod \"26232dab-32f0-4b10-a0f7-393aee68b468\" (UID: \"26232dab-32f0-4b10-a0f7-393aee68b468\") "
Jul 27 22:01:55.808507 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:55.808475    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26232dab-32f0-4b10-a0f7-393aee68b468-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "26232dab-32f0-4b10-a0f7-393aee68b468" (UID: "26232dab-32f0-4b10-a0f7-393aee68b468"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:01:55.909129 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:55.909086    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26232dab-32f0-4b10-a0f7-393aee68b468-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:01:56.523075 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:56.523045    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"
Jul 27 22:01:56.523075 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:56.523052    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822" event={"ID":"26232dab-32f0-4b10-a0f7-393aee68b468","Type":"ContainerDied","Data":"8af810d7dfe00150db226f0e187422d1d1a340228d928f76ce8c28db408a4894"}
Jul 27 22:01:56.523289 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:56.523127    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8af810d7dfe00150db226f0e187422d1d1a340228d928f76ce8c28db408a4894"
Jul 27 22:01:57.929614 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:57.929579    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"]
Jul 27 22:01:57.930078 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:57.929827    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g" podUID="cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4" containerName="payload-processing" containerID="cri-o://f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c" gracePeriod=30
Jul 27 22:01:57.965608 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:57.965560    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"]
Jul 27 22:01:57.965847 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:57.965819    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd" podUID="c9f129cd-72f0-45cd-b1c3-8215266d348d" containerName="payload-pre-processing" containerID="cri-o://7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e" gracePeriod=30
Jul 27 22:01:58.259672 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.259640    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:58.263518 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.263481    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:58.333339 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.333294    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-plugins-config-volume\") pod \"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4\" (UID: \"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4\") "
Jul 27 22:01:58.333573 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.333399    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rcrj\" (UniqueName: \"kubernetes.io/projected/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-kube-api-access-9rcrj\") pod \"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4\" (UID: \"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4\") "
Jul 27 22:01:58.333856 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.333825    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4" (UID: "cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:01:58.335930 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.335896    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-kube-api-access-9rcrj" (OuterVolumeSpecName: "kube-api-access-9rcrj") pod "cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4" (UID: "cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4"). InnerVolumeSpecName "kube-api-access-9rcrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:01:58.434459 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.434395    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gtxz\" (UniqueName: \"kubernetes.io/projected/c9f129cd-72f0-45cd-b1c3-8215266d348d-kube-api-access-8gtxz\") pod \"c9f129cd-72f0-45cd-b1c3-8215266d348d\" (UID: \"c9f129cd-72f0-45cd-b1c3-8215266d348d\") "
Jul 27 22:01:58.434630 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.434543    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9f129cd-72f0-45cd-b1c3-8215266d348d-plugins-config-volume\") pod \"c9f129cd-72f0-45cd-b1c3-8215266d348d\" (UID: \"c9f129cd-72f0-45cd-b1c3-8215266d348d\") "
Jul 27 22:01:58.434848 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.434828    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:01:58.434848 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.434849    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rcrj\" (UniqueName: \"kubernetes.io/projected/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4-kube-api-access-9rcrj\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:01:58.435028 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.434953    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f129cd-72f0-45cd-b1c3-8215266d348d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c9f129cd-72f0-45cd-b1c3-8215266d348d" (UID: "c9f129cd-72f0-45cd-b1c3-8215266d348d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:01:58.436850 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.436825    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9f129cd-72f0-45cd-b1c3-8215266d348d-kube-api-access-8gtxz" (OuterVolumeSpecName: "kube-api-access-8gtxz") pod "c9f129cd-72f0-45cd-b1c3-8215266d348d" (UID: "c9f129cd-72f0-45cd-b1c3-8215266d348d"). InnerVolumeSpecName "kube-api-access-8gtxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:01:58.439365 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.439328    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"]
Jul 27 22:01:58.448649 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.448616    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d38e15cc-j4822"]
Jul 27 22:01:58.535992 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.535899    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gtxz\" (UniqueName: \"kubernetes.io/projected/c9f129cd-72f0-45cd-b1c3-8215266d348d-kube-api-access-8gtxz\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:01:58.535992 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.535933    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9f129cd-72f0-45cd-b1c3-8215266d348d-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:01:58.537112 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.537077    2554 generic.go:356] "Generic (PLEG): container finished" podID="cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4" containerID="f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c" exitCode=0
Jul 27 22:01:58.537268 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.537120    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"
Jul 27 22:01:58.537268 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.537161    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g" event={"ID":"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4","Type":"ContainerDied","Data":"f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c"}
Jul 27 22:01:58.537268 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.537211    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g" event={"ID":"cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4","Type":"ContainerDied","Data":"c55316040bc9811ed1b6780779cd4ba563d58b4aeab6eb41c8ccaaea355fe94d"}
Jul 27 22:01:58.537268 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.537235    2554 scope.go:117] "RemoveContainer" containerID="f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c"
Jul 27 22:01:58.538646 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.538619    2554 generic.go:356] "Generic (PLEG): container finished" podID="c9f129cd-72f0-45cd-b1c3-8215266d348d" containerID="7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e" exitCode=0
Jul 27 22:01:58.538784 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.538672    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"
Jul 27 22:01:58.538784 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.538705    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd" event={"ID":"c9f129cd-72f0-45cd-b1c3-8215266d348d","Type":"ContainerDied","Data":"7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e"}
Jul 27 22:01:58.538784 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.538752    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd" event={"ID":"c9f129cd-72f0-45cd-b1c3-8215266d348d","Type":"ContainerDied","Data":"0f835b5bef7178cbdd539a9ddac185b7acaf7f11d350b70785fe7caf3c359f61"}
Jul 27 22:01:58.547774 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.547747    2554 scope.go:117] "RemoveContainer" containerID="f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c"
Jul 27 22:01:58.548149 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:01:58.548120    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c\": container with ID starting with f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c not found: ID does not exist" containerID="f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c"
Jul 27 22:01:58.548229 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.548163    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c"} err="failed to get container status \"f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c\": rpc error: code = NotFound desc = could not find container \"f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c\": container with ID starting with f6b8e54fed794e50c9f2ff208a654d96509b86502b815fb7e38229f73dc5037c not found: ID does not exist"
Jul 27 22:01:58.548229 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.548189    2554 scope.go:117] "RemoveContainer" containerID="7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e"
Jul 27 22:01:58.557609 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.557587    2554 scope.go:117] "RemoveContainer" containerID="7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e"
Jul 27 22:01:58.557937 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:01:58.557918    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e\": container with ID starting with 7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e not found: ID does not exist" containerID="7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e"
Jul 27 22:01:58.557985 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.557947    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e"} err="failed to get container status \"7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e\": rpc error: code = NotFound desc = could not find container \"7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e\": container with ID starting with 7d712cf94cd870f7386e7a37ed9685c4619c69723c3223f4ee71218903d10b4e not found: ID does not exist"
Jul 27 22:01:58.611634 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.611600    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"]
Jul 27 22:01:58.625490 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.625450    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d38e15cc-6c55767b4-kfkgd"]
Jul 27 22:01:58.653734 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.653692    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"]
Jul 27 22:01:58.673178 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.673140    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d38e15cc-7cc64c7489-r8g6g"]
Jul 27 22:01:58.923216 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.923121    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26232dab-32f0-4b10-a0f7-393aee68b468" path="/var/lib/kubelet/pods/26232dab-32f0-4b10-a0f7-393aee68b468/volumes"
Jul 27 22:01:58.923518 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.923504    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9f129cd-72f0-45cd-b1c3-8215266d348d" path="/var/lib/kubelet/pods/c9f129cd-72f0-45cd-b1c3-8215266d348d/volumes"
Jul 27 22:01:58.923830 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:01:58.923817    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4" path="/var/lib/kubelet/pods/cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4/volumes"
Jul 27 22:02:03.830703 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.830656    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"]
Jul 27 22:02:03.831304 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.831282    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4" containerName="payload-processing"
Jul 27 22:02:03.831304 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.831303    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4" containerName="payload-processing"
Jul 27 22:02:03.831387 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.831317    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26232dab-32f0-4b10-a0f7-393aee68b468" containerName="revoke-keys"
Jul 27 22:02:03.831387 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.831326    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="26232dab-32f0-4b10-a0f7-393aee68b468" containerName="revoke-keys"
Jul 27 22:02:03.831387 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.831358    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9f129cd-72f0-45cd-b1c3-8215266d348d" containerName="payload-pre-processing"
Jul 27 22:02:03.831387 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.831367    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f129cd-72f0-45cd-b1c3-8215266d348d" containerName="payload-pre-processing"
Jul 27 22:02:03.831547 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.831480    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="26232dab-32f0-4b10-a0f7-393aee68b468" containerName="revoke-keys"
Jul 27 22:02:03.831547 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.831493    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9f129cd-72f0-45cd-b1c3-8215266d348d" containerName="payload-pre-processing"
Jul 27 22:02:03.831547 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.831502    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf84a18f-0421-4fe2-9f56-5c7f2efe3fa4" containerName="payload-processing"
Jul 27 22:02:03.837830 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.837800    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:03.841699 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.841666    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-58e80fe2-dockercfg-7zxwc\""
Jul 27 22:02:03.842050 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.842033    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-58e80fe2\""
Jul 27 22:02:03.858101 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.858066    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"]
Jul 27 22:02:03.917940 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.917900    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"]
Jul 27 22:02:03.921293 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.921264    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:03.958266 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.958219    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"]
Jul 27 22:02:03.987031 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.986976    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cz8w\" (UniqueName: \"kubernetes.io/projected/a98cff8e-4d15-448b-aa21-24f77421188d-kube-api-access-2cz8w\") pod \"payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr\" (UID: \"a98cff8e-4d15-448b-aa21-24f77421188d\") " pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:03.987031 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:03.987026    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98cff8e-4d15-448b-aa21-24f77421188d-plugins-config-volume\") pod \"payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr\" (UID: \"a98cff8e-4d15-448b-aa21-24f77421188d\") " pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:04.088285 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.088196    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98cff8e-4d15-448b-aa21-24f77421188d-plugins-config-volume\") pod \"payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr\" (UID: \"a98cff8e-4d15-448b-aa21-24f77421188d\") " pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:04.088285 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.088242    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf927\" (UniqueName: \"kubernetes.io/projected/726eb0dd-f920-4787-b59b-d9576690b5fa-kube-api-access-kf927\") pod \"payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g\" (UID: \"726eb0dd-f920-4787-b59b-d9576690b5fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:04.088541 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.088312    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/726eb0dd-f920-4787-b59b-d9576690b5fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g\" (UID: \"726eb0dd-f920-4787-b59b-d9576690b5fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:04.088541 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.088488    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cz8w\" (UniqueName: \"kubernetes.io/projected/a98cff8e-4d15-448b-aa21-24f77421188d-kube-api-access-2cz8w\") pod \"payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr\" (UID: \"a98cff8e-4d15-448b-aa21-24f77421188d\") " pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:04.089087 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.089060    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98cff8e-4d15-448b-aa21-24f77421188d-plugins-config-volume\") pod \"payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr\" (UID: \"a98cff8e-4d15-448b-aa21-24f77421188d\") " pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:04.116093 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.116056    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cz8w\" (UniqueName: \"kubernetes.io/projected/a98cff8e-4d15-448b-aa21-24f77421188d-kube-api-access-2cz8w\") pod \"payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr\" (UID: \"a98cff8e-4d15-448b-aa21-24f77421188d\") " pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:04.149969 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.149930    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:04.189464 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.189410    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/726eb0dd-f920-4787-b59b-d9576690b5fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g\" (UID: \"726eb0dd-f920-4787-b59b-d9576690b5fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:04.189641 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.189565    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf927\" (UniqueName: \"kubernetes.io/projected/726eb0dd-f920-4787-b59b-d9576690b5fa-kube-api-access-kf927\") pod \"payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g\" (UID: \"726eb0dd-f920-4787-b59b-d9576690b5fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:04.190154 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.190135    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/726eb0dd-f920-4787-b59b-d9576690b5fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g\" (UID: \"726eb0dd-f920-4787-b59b-d9576690b5fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:04.207237 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.207191    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf927\" (UniqueName: \"kubernetes.io/projected/726eb0dd-f920-4787-b59b-d9576690b5fa-kube-api-access-kf927\") pod \"payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g\" (UID: \"726eb0dd-f920-4787-b59b-d9576690b5fa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:04.232228 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.232185    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:04.350969 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.350929    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"]
Jul 27 22:02:04.356055 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:02:04.356003    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98cff8e_4d15_448b_aa21_24f77421188d.slice/crio-8b311d3c12ce18e62f41a4248c6050c94aef03bd8a7459e7fc81d6e8982a443e WatchSource:0}: Error finding container 8b311d3c12ce18e62f41a4248c6050c94aef03bd8a7459e7fc81d6e8982a443e: Status 404 returned error can't find the container with id 8b311d3c12ce18e62f41a4248c6050c94aef03bd8a7459e7fc81d6e8982a443e
Jul 27 22:02:04.421425 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.421391    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"]
Jul 27 22:02:04.435558 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:02:04.435524    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726eb0dd_f920_4787_b59b_d9576690b5fa.slice/crio-3e5fb59bb95a2d76180b0b6c4db000fe201ea8ed19e3dd7abdf24a8407c72a97 WatchSource:0}: Error finding container 3e5fb59bb95a2d76180b0b6c4db000fe201ea8ed19e3dd7abdf24a8407c72a97: Status 404 returned error can't find the container with id 3e5fb59bb95a2d76180b0b6c4db000fe201ea8ed19e3dd7abdf24a8407c72a97
Jul 27 22:02:04.573608 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.573575    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g" event={"ID":"726eb0dd-f920-4787-b59b-d9576690b5fa","Type":"ContainerStarted","Data":"e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72"}
Jul 27 22:02:04.573776 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.573630    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g" event={"ID":"726eb0dd-f920-4787-b59b-d9576690b5fa","Type":"ContainerStarted","Data":"3e5fb59bb95a2d76180b0b6c4db000fe201ea8ed19e3dd7abdf24a8407c72a97"}
Jul 27 22:02:04.573776 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.573673    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:04.575190 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.575167    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr" event={"ID":"a98cff8e-4d15-448b-aa21-24f77421188d","Type":"ContainerStarted","Data":"1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e"}
Jul 27 22:02:04.575348 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.575209    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr" event={"ID":"a98cff8e-4d15-448b-aa21-24f77421188d","Type":"ContainerStarted","Data":"8b311d3c12ce18e62f41a4248c6050c94aef03bd8a7459e7fc81d6e8982a443e"}
Jul 27 22:02:04.575348 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.575242    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:04.673787 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.673670    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr" podStartSLOduration=1.673652808 podStartE2EDuration="1.673652808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:02:04.672601033 +0000 UTC m=+1676.390007514" watchObservedRunningTime="2026-07-27 22:02:04.673652808 +0000 UTC m=+1676.391059289"
Jul 27 22:02:04.673787 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:04.673764    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g" podStartSLOduration=1.6737592079999999 podStartE2EDuration="1.673759208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:02:04.626256627 +0000 UTC m=+1676.343663109" watchObservedRunningTime="2026-07-27 22:02:04.673759208 +0000 UTC m=+1676.391165690"
Jul 27 22:02:15.583595 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:15.583560    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:15.584152 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:15.583649    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:27.967398 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:27.967357    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"]
Jul 27 22:02:27.972997 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:27.972958    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"
Jul 27 22:02:27.976517 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:27.976488    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:02:27.976701 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:27.976654    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:02:27.984385 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:27.983866    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"]
Jul 27 22:02:28.039961 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:28.039914    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b43303-1b7e-4dfd-a3a2-cfe1a6f56884-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c\" (UID: \"30b43303-1b7e-4dfd-a3a2-cfe1a6f56884\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"
Jul 27 22:02:28.140773 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:28.140731    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b43303-1b7e-4dfd-a3a2-cfe1a6f56884-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c\" (UID: \"30b43303-1b7e-4dfd-a3a2-cfe1a6f56884\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"
Jul 27 22:02:28.141394 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:28.141372    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b43303-1b7e-4dfd-a3a2-cfe1a6f56884-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c\" (UID: \"30b43303-1b7e-4dfd-a3a2-cfe1a6f56884\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"
Jul 27 22:02:28.289625 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:28.289527    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"
Jul 27 22:02:28.459628 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:28.459594    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"]
Jul 27 22:02:28.462498 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:02:28.462467    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b43303_1b7e_4dfd_a3a2_cfe1a6f56884.slice/crio-f3a662bfd33f937d56acca3db830c03412587bf64635cff5b2a72e062e4e6003 WatchSource:0}: Error finding container f3a662bfd33f937d56acca3db830c03412587bf64635cff5b2a72e062e4e6003: Status 404 returned error can't find the container with id f3a662bfd33f937d56acca3db830c03412587bf64635cff5b2a72e062e4e6003
Jul 27 22:02:28.709211 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:28.709170    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c" event={"ID":"30b43303-1b7e-4dfd-a3a2-cfe1a6f56884","Type":"ContainerStarted","Data":"f3a662bfd33f937d56acca3db830c03412587bf64635cff5b2a72e062e4e6003"}
Jul 27 22:02:29.716364 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:29.716331    2554 generic.go:356] "Generic (PLEG): container finished" podID="30b43303-1b7e-4dfd-a3a2-cfe1a6f56884" containerID="9d2a0ea7d8e049ccf191dd179e2ccf4187fb927dd0d21dd2255e5b85ef8d350d" exitCode=0
Jul 27 22:02:29.716780 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:29.716382    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c" event={"ID":"30b43303-1b7e-4dfd-a3a2-cfe1a6f56884","Type":"ContainerDied","Data":"9d2a0ea7d8e049ccf191dd179e2ccf4187fb927dd0d21dd2255e5b85ef8d350d"}
Jul 27 22:02:30.868053 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:30.868023    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"
Jul 27 22:02:30.978770 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:30.978677    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b43303-1b7e-4dfd-a3a2-cfe1a6f56884-maas-api-service-ca\") pod \"30b43303-1b7e-4dfd-a3a2-cfe1a6f56884\" (UID: \"30b43303-1b7e-4dfd-a3a2-cfe1a6f56884\") "
Jul 27 22:02:30.979082 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:30.979051    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b43303-1b7e-4dfd-a3a2-cfe1a6f56884-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "30b43303-1b7e-4dfd-a3a2-cfe1a6f56884" (UID: "30b43303-1b7e-4dfd-a3a2-cfe1a6f56884"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:02:31.080654 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:31.080618    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b43303-1b7e-4dfd-a3a2-cfe1a6f56884-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:02:31.727934 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:31.727902    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c" event={"ID":"30b43303-1b7e-4dfd-a3a2-cfe1a6f56884","Type":"ContainerDied","Data":"f3a662bfd33f937d56acca3db830c03412587bf64635cff5b2a72e062e4e6003"}
Jul 27 22:02:31.728108 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:31.727939    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"
Jul 27 22:02:31.728108 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:31.727949    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3a662bfd33f937d56acca3db830c03412587bf64635cff5b2a72e062e4e6003"
Jul 27 22:02:33.727202 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:33.727169    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"]
Jul 27 22:02:33.727661 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:33.727427    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr" podUID="a98cff8e-4d15-448b-aa21-24f77421188d" containerName="payload-processing" containerID="cri-o://1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e" gracePeriod=30
Jul 27 22:02:33.736175 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:33.736133    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"]
Jul 27 22:02:33.737020 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:33.736371    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g" podUID="726eb0dd-f920-4787-b59b-d9576690b5fa" containerName="payload-pre-processing" containerID="cri-o://e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72" gracePeriod=30
Jul 27 22:02:33.943819 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:33.943754    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"]
Jul 27 22:02:33.946023 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:33.945861    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58e80fe2-8l76c"]
Jul 27 22:02:34.028542 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.028510    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:34.032076 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.032047    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:34.211419 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.211380    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf927\" (UniqueName: \"kubernetes.io/projected/726eb0dd-f920-4787-b59b-d9576690b5fa-kube-api-access-kf927\") pod \"726eb0dd-f920-4787-b59b-d9576690b5fa\" (UID: \"726eb0dd-f920-4787-b59b-d9576690b5fa\") "
Jul 27 22:02:34.211651 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.211477    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98cff8e-4d15-448b-aa21-24f77421188d-plugins-config-volume\") pod \"a98cff8e-4d15-448b-aa21-24f77421188d\" (UID: \"a98cff8e-4d15-448b-aa21-24f77421188d\") "
Jul 27 22:02:34.211651 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.211539    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/726eb0dd-f920-4787-b59b-d9576690b5fa-plugins-config-volume\") pod \"726eb0dd-f920-4787-b59b-d9576690b5fa\" (UID: \"726eb0dd-f920-4787-b59b-d9576690b5fa\") "
Jul 27 22:02:34.211651 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.211606    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cz8w\" (UniqueName: \"kubernetes.io/projected/a98cff8e-4d15-448b-aa21-24f77421188d-kube-api-access-2cz8w\") pod \"a98cff8e-4d15-448b-aa21-24f77421188d\" (UID: \"a98cff8e-4d15-448b-aa21-24f77421188d\") "
Jul 27 22:02:34.211872 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.211847    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a98cff8e-4d15-448b-aa21-24f77421188d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a98cff8e-4d15-448b-aa21-24f77421188d" (UID: "a98cff8e-4d15-448b-aa21-24f77421188d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:02:34.211943 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.211873    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/726eb0dd-f920-4787-b59b-d9576690b5fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "726eb0dd-f920-4787-b59b-d9576690b5fa" (UID: "726eb0dd-f920-4787-b59b-d9576690b5fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:02:34.212014 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.211998    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a98cff8e-4d15-448b-aa21-24f77421188d-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:02:34.212059 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.212019    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/726eb0dd-f920-4787-b59b-d9576690b5fa-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:02:34.213944 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.213912    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/726eb0dd-f920-4787-b59b-d9576690b5fa-kube-api-access-kf927" (OuterVolumeSpecName: "kube-api-access-kf927") pod "726eb0dd-f920-4787-b59b-d9576690b5fa" (UID: "726eb0dd-f920-4787-b59b-d9576690b5fa"). InnerVolumeSpecName "kube-api-access-kf927". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:02:34.214035 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.213908    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a98cff8e-4d15-448b-aa21-24f77421188d-kube-api-access-2cz8w" (OuterVolumeSpecName: "kube-api-access-2cz8w") pod "a98cff8e-4d15-448b-aa21-24f77421188d" (UID: "a98cff8e-4d15-448b-aa21-24f77421188d"). InnerVolumeSpecName "kube-api-access-2cz8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:02:34.313175 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.313080    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf927\" (UniqueName: \"kubernetes.io/projected/726eb0dd-f920-4787-b59b-d9576690b5fa-kube-api-access-kf927\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:02:34.313175 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.313115    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cz8w\" (UniqueName: \"kubernetes.io/projected/a98cff8e-4d15-448b-aa21-24f77421188d-kube-api-access-2cz8w\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:02:34.749026 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.748991    2554 generic.go:356] "Generic (PLEG): container finished" podID="a98cff8e-4d15-448b-aa21-24f77421188d" containerID="1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e" exitCode=0
Jul 27 22:02:34.749480 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.749042    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"
Jul 27 22:02:34.749480 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.749074    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr" event={"ID":"a98cff8e-4d15-448b-aa21-24f77421188d","Type":"ContainerDied","Data":"1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e"}
Jul 27 22:02:34.749480 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.749130    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr" event={"ID":"a98cff8e-4d15-448b-aa21-24f77421188d","Type":"ContainerDied","Data":"8b311d3c12ce18e62f41a4248c6050c94aef03bd8a7459e7fc81d6e8982a443e"}
Jul 27 22:02:34.749480 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.749163    2554 scope.go:117] "RemoveContainer" containerID="1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e"
Jul 27 22:02:34.750758 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.750730    2554 generic.go:356] "Generic (PLEG): container finished" podID="726eb0dd-f920-4787-b59b-d9576690b5fa" containerID="e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72" exitCode=0
Jul 27 22:02:34.750876 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.750794    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"
Jul 27 22:02:34.750876 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.750811    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g" event={"ID":"726eb0dd-f920-4787-b59b-d9576690b5fa","Type":"ContainerDied","Data":"e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72"}
Jul 27 22:02:34.750876 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.750862    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g" event={"ID":"726eb0dd-f920-4787-b59b-d9576690b5fa","Type":"ContainerDied","Data":"3e5fb59bb95a2d76180b0b6c4db000fe201ea8ed19e3dd7abdf24a8407c72a97"}
Jul 27 22:02:34.760487 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.760412    2554 scope.go:117] "RemoveContainer" containerID="1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e"
Jul 27 22:02:34.760865 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:02:34.760825    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e\": container with ID starting with 1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e not found: ID does not exist" containerID="1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e"
Jul 27 22:02:34.760865 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.760856    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e"} err="failed to get container status \"1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e\": rpc error: code = NotFound desc = could not find container \"1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e\": container with ID starting with 1e584a3490e0f0f5f585df6c8c76a0730d4f94225cba711fb225bafde3f69a3e not found: ID does not exist"
Jul 27 22:02:34.760990 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.760876    2554 scope.go:117] "RemoveContainer" containerID="e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72"
Jul 27 22:02:34.770648 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.770615    2554 scope.go:117] "RemoveContainer" containerID="e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72"
Jul 27 22:02:34.771036 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:02:34.771014    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72\": container with ID starting with e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72 not found: ID does not exist" containerID="e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72"
Jul 27 22:02:34.771112 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.771045    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72"} err="failed to get container status \"e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72\": rpc error: code = NotFound desc = could not find container \"e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72\": container with ID starting with e815d3bf3322e4e33b8d46471211b5ee6f0fda0d03942db6048cb746e674ff72 not found: ID does not exist"
Jul 27 22:02:34.794599 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.794556    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"]
Jul 27 22:02:34.797357 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.797321    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-58e80fe2-64bdb8cf74-rbrqr"]
Jul 27 22:02:34.822609 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.822573    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"]
Jul 27 22:02:34.824242 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.824214    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-58e80fe2-87b55d4d8-v295g"]
Jul 27 22:02:34.930993 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.930953    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b43303-1b7e-4dfd-a3a2-cfe1a6f56884" path="/var/lib/kubelet/pods/30b43303-1b7e-4dfd-a3a2-cfe1a6f56884/volumes"
Jul 27 22:02:34.931330 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.931316    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="726eb0dd-f920-4787-b59b-d9576690b5fa" path="/var/lib/kubelet/pods/726eb0dd-f920-4787-b59b-d9576690b5fa/volumes"
Jul 27 22:02:34.931695 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:34.931680    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a98cff8e-4d15-448b-aa21-24f77421188d" path="/var/lib/kubelet/pods/a98cff8e-4d15-448b-aa21-24f77421188d/volumes"
Jul 27 22:02:39.621998 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.621961    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"]
Jul 27 22:02:39.622548 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.622500    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a98cff8e-4d15-448b-aa21-24f77421188d" containerName="payload-processing"
Jul 27 22:02:39.622548 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.622516    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a98cff8e-4d15-448b-aa21-24f77421188d" containerName="payload-processing"
Jul 27 22:02:39.622548 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.622530    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b43303-1b7e-4dfd-a3a2-cfe1a6f56884" containerName="revoke-keys"
Jul 27 22:02:39.622548 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.622535    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b43303-1b7e-4dfd-a3a2-cfe1a6f56884" containerName="revoke-keys"
Jul 27 22:02:39.622548 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.622550    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726eb0dd-f920-4787-b59b-d9576690b5fa" containerName="payload-pre-processing"
Jul 27 22:02:39.622842 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.622556    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="726eb0dd-f920-4787-b59b-d9576690b5fa" containerName="payload-pre-processing"
Jul 27 22:02:39.622842 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.622629    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b43303-1b7e-4dfd-a3a2-cfe1a6f56884" containerName="revoke-keys"
Jul 27 22:02:39.622842 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.622637    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a98cff8e-4d15-448b-aa21-24f77421188d" containerName="payload-processing"
Jul 27 22:02:39.622842 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.622644    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="726eb0dd-f920-4787-b59b-d9576690b5fa" containerName="payload-pre-processing"
Jul 27 22:02:39.624714 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.624694    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"]
Jul 27 22:02:39.624855 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.624832    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:02:39.627241 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.627213    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:02:39.645334 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.645304    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-52fa39dc-dockercfg-sw9pb\""
Jul 27 22:02:39.648664 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.648642    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-52fa39dc\""
Jul 27 22:02:39.659955 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.659917    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"]
Jul 27 22:02:39.662532 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.662501    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcvql\" (UniqueName: \"kubernetes.io/projected/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-kube-api-access-bcvql\") pod \"payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8\" (UID: \"a7ce56f6-0885-4ebb-9858-fd33e9a3d037\") " pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:02:39.662697 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.662629    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-plugins-config-volume\") pod \"payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8\" (UID: \"a7ce56f6-0885-4ebb-9858-fd33e9a3d037\") " pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:02:39.662697 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.662679    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lknsk\" (UniqueName: \"kubernetes.io/projected/0e357b28-8352-4c76-ac5a-6f353ebd6e49-kube-api-access-lknsk\") pod \"payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr\" (UID: \"0e357b28-8352-4c76-ac5a-6f353ebd6e49\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:02:39.662842 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.662713    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e357b28-8352-4c76-ac5a-6f353ebd6e49-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr\" (UID: \"0e357b28-8352-4c76-ac5a-6f353ebd6e49\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:02:39.667290 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.667250    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"]
Jul 27 22:02:39.763519 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.763479    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcvql\" (UniqueName: \"kubernetes.io/projected/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-kube-api-access-bcvql\") pod \"payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8\" (UID: \"a7ce56f6-0885-4ebb-9858-fd33e9a3d037\") " pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:02:39.763701 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.763576    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-plugins-config-volume\") pod \"payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8\" (UID: \"a7ce56f6-0885-4ebb-9858-fd33e9a3d037\") " pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:02:39.763701 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.763609    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lknsk\" (UniqueName: \"kubernetes.io/projected/0e357b28-8352-4c76-ac5a-6f353ebd6e49-kube-api-access-lknsk\") pod \"payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr\" (UID: \"0e357b28-8352-4c76-ac5a-6f353ebd6e49\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:02:39.763701 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.763695    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e357b28-8352-4c76-ac5a-6f353ebd6e49-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr\" (UID: \"0e357b28-8352-4c76-ac5a-6f353ebd6e49\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:02:39.764472 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.764415    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-plugins-config-volume\") pod \"payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8\" (UID: \"a7ce56f6-0885-4ebb-9858-fd33e9a3d037\") " pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:02:39.764518 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.764463    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e357b28-8352-4c76-ac5a-6f353ebd6e49-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr\" (UID: \"0e357b28-8352-4c76-ac5a-6f353ebd6e49\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:02:39.777051 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.777016    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lknsk\" (UniqueName: \"kubernetes.io/projected/0e357b28-8352-4c76-ac5a-6f353ebd6e49-kube-api-access-lknsk\") pod \"payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr\" (UID: \"0e357b28-8352-4c76-ac5a-6f353ebd6e49\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:02:39.778717 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.778691    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcvql\" (UniqueName: \"kubernetes.io/projected/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-kube-api-access-bcvql\") pod \"payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8\" (UID: \"a7ce56f6-0885-4ebb-9858-fd33e9a3d037\") " pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:02:39.938495 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.938378    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:02:39.944638 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:39.944606    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:02:40.116254 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:40.116210    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"]
Jul 27 22:02:40.120809 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:02:40.120778    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e357b28_8352_4c76_ac5a_6f353ebd6e49.slice/crio-c74e1464a4a6dcb70d2ab44f117b57d495570c937acf435116e1657737993832 WatchSource:0}: Error finding container c74e1464a4a6dcb70d2ab44f117b57d495570c937acf435116e1657737993832: Status 404 returned error can't find the container with id c74e1464a4a6dcb70d2ab44f117b57d495570c937acf435116e1657737993832
Jul 27 22:02:40.142859 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:40.142833    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"]
Jul 27 22:02:40.153892 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:02:40.153858    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ce56f6_0885_4ebb_9858_fd33e9a3d037.slice/crio-a6662d0c769767c58ecc55d08f8285e0c4b329c079cc74b210eb0a49bc7fa630 WatchSource:0}: Error finding container a6662d0c769767c58ecc55d08f8285e0c4b329c079cc74b210eb0a49bc7fa630: Status 404 returned error can't find the container with id a6662d0c769767c58ecc55d08f8285e0c4b329c079cc74b210eb0a49bc7fa630
Jul 27 22:02:40.788333 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:40.788284    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr" event={"ID":"0e357b28-8352-4c76-ac5a-6f353ebd6e49","Type":"ContainerStarted","Data":"55adcc647ca76229da8a8b5d803e4b230315da2c06c3518f5d0edb936c1eef48"}
Jul 27 22:02:40.788829 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:40.788392    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:02:40.788829 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:40.788410    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr" event={"ID":"0e357b28-8352-4c76-ac5a-6f353ebd6e49","Type":"ContainerStarted","Data":"c74e1464a4a6dcb70d2ab44f117b57d495570c937acf435116e1657737993832"}
Jul 27 22:02:40.789928 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:40.789901    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8" event={"ID":"a7ce56f6-0885-4ebb-9858-fd33e9a3d037","Type":"ContainerStarted","Data":"4256853206eba5cb5200e43bd1445249849f63ebfc9ba349b96d161ab6818ec8"}
Jul 27 22:02:40.790050 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:40.789955    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8" event={"ID":"a7ce56f6-0885-4ebb-9858-fd33e9a3d037","Type":"ContainerStarted","Data":"a6662d0c769767c58ecc55d08f8285e0c4b329c079cc74b210eb0a49bc7fa630"}
Jul 27 22:02:40.790050 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:40.789981    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:02:40.880192 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:40.880134    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr" podStartSLOduration=1.880118079 podStartE2EDuration="1.880118079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:02:40.879591272 +0000 UTC m=+1712.596997755" watchObservedRunningTime="2026-07-27 22:02:40.880118079 +0000 UTC m=+1712.597524560"
Jul 27 22:02:40.954702 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:40.954634    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8" podStartSLOduration=1.9546086329999999 podStartE2EDuration="1.954608633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:02:40.953289411 +0000 UTC m=+1712.670695892" watchObservedRunningTime="2026-07-27 22:02:40.954608633 +0000 UTC m=+1712.672015114"
Jul 27 22:02:51.797381 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:51.797350    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:02:51.797894 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:51.797450    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:02:59.717898 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:59.717856    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"]
Jul 27 22:02:59.718381 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:59.718050    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8" podUID="a7ce56f6-0885-4ebb-9858-fd33e9a3d037" containerName="payload-processing" containerID="cri-o://4256853206eba5cb5200e43bd1445249849f63ebfc9ba349b96d161ab6818ec8" gracePeriod=30
Jul 27 22:02:59.739541 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:59.738786    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"]
Jul 27 22:02:59.739541 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:59.739010    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr" podUID="0e357b28-8352-4c76-ac5a-6f353ebd6e49" containerName="payload-pre-processing" containerID="cri-o://55adcc647ca76229da8a8b5d803e4b230315da2c06c3518f5d0edb936c1eef48" gracePeriod=30
Jul 27 22:02:59.918357 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:59.918288    2554 generic.go:356] "Generic (PLEG): container finished" podID="0e357b28-8352-4c76-ac5a-6f353ebd6e49" containerID="55adcc647ca76229da8a8b5d803e4b230315da2c06c3518f5d0edb936c1eef48" exitCode=0
Jul 27 22:02:59.918733 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:59.918563    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr" event={"ID":"0e357b28-8352-4c76-ac5a-6f353ebd6e49","Type":"ContainerDied","Data":"55adcc647ca76229da8a8b5d803e4b230315da2c06c3518f5d0edb936c1eef48"}
Jul 27 22:02:59.921086 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:59.920893    2554 generic.go:356] "Generic (PLEG): container finished" podID="a7ce56f6-0885-4ebb-9858-fd33e9a3d037" containerID="4256853206eba5cb5200e43bd1445249849f63ebfc9ba349b96d161ab6818ec8" exitCode=0
Jul 27 22:02:59.921086 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:02:59.921024    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8" event={"ID":"a7ce56f6-0885-4ebb-9858-fd33e9a3d037","Type":"ContainerDied","Data":"4256853206eba5cb5200e43bd1445249849f63ebfc9ba349b96d161ab6818ec8"}
Jul 27 22:03:00.023149 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.023123    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:03:00.026709 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.026678    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:03:00.159055 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.159018    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-plugins-config-volume\") pod \"a7ce56f6-0885-4ebb-9858-fd33e9a3d037\" (UID: \"a7ce56f6-0885-4ebb-9858-fd33e9a3d037\") "
Jul 27 22:03:00.159238 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.159109    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcvql\" (UniqueName: \"kubernetes.io/projected/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-kube-api-access-bcvql\") pod \"a7ce56f6-0885-4ebb-9858-fd33e9a3d037\" (UID: \"a7ce56f6-0885-4ebb-9858-fd33e9a3d037\") "
Jul 27 22:03:00.159238 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.159152    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e357b28-8352-4c76-ac5a-6f353ebd6e49-plugins-config-volume\") pod \"0e357b28-8352-4c76-ac5a-6f353ebd6e49\" (UID: \"0e357b28-8352-4c76-ac5a-6f353ebd6e49\") "
Jul 27 22:03:00.159238 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.159184    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lknsk\" (UniqueName: \"kubernetes.io/projected/0e357b28-8352-4c76-ac5a-6f353ebd6e49-kube-api-access-lknsk\") pod \"0e357b28-8352-4c76-ac5a-6f353ebd6e49\" (UID: \"0e357b28-8352-4c76-ac5a-6f353ebd6e49\") "
Jul 27 22:03:00.159582 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.159552    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a7ce56f6-0885-4ebb-9858-fd33e9a3d037" (UID: "a7ce56f6-0885-4ebb-9858-fd33e9a3d037"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:03:00.159671 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.159589    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e357b28-8352-4c76-ac5a-6f353ebd6e49-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e357b28-8352-4c76-ac5a-6f353ebd6e49" (UID: "0e357b28-8352-4c76-ac5a-6f353ebd6e49"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:03:00.161691 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.161659    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-kube-api-access-bcvql" (OuterVolumeSpecName: "kube-api-access-bcvql") pod "a7ce56f6-0885-4ebb-9858-fd33e9a3d037" (UID: "a7ce56f6-0885-4ebb-9858-fd33e9a3d037"). InnerVolumeSpecName "kube-api-access-bcvql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:03:00.161790 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.161693    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e357b28-8352-4c76-ac5a-6f353ebd6e49-kube-api-access-lknsk" (OuterVolumeSpecName: "kube-api-access-lknsk") pod "0e357b28-8352-4c76-ac5a-6f353ebd6e49" (UID: "0e357b28-8352-4c76-ac5a-6f353ebd6e49"). InnerVolumeSpecName "kube-api-access-lknsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:03:00.260461 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.260333    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcvql\" (UniqueName: \"kubernetes.io/projected/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-kube-api-access-bcvql\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:03:00.260461 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.260379    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e357b28-8352-4c76-ac5a-6f353ebd6e49-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:03:00.260461 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.260389    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lknsk\" (UniqueName: \"kubernetes.io/projected/0e357b28-8352-4c76-ac5a-6f353ebd6e49-kube-api-access-lknsk\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:03:00.260461 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.260399    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7ce56f6-0885-4ebb-9858-fd33e9a3d037-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:03:00.928334 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.928303    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"
Jul 27 22:03:00.928846 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.928303    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr" event={"ID":"0e357b28-8352-4c76-ac5a-6f353ebd6e49","Type":"ContainerDied","Data":"c74e1464a4a6dcb70d2ab44f117b57d495570c937acf435116e1657737993832"}
Jul 27 22:03:00.928846 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.928486    2554 scope.go:117] "RemoveContainer" containerID="55adcc647ca76229da8a8b5d803e4b230315da2c06c3518f5d0edb936c1eef48"
Jul 27 22:03:00.930228 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.930176    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8" event={"ID":"a7ce56f6-0885-4ebb-9858-fd33e9a3d037","Type":"ContainerDied","Data":"a6662d0c769767c58ecc55d08f8285e0c4b329c079cc74b210eb0a49bc7fa630"}
Jul 27 22:03:00.931028 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.930901    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"
Jul 27 22:03:00.941925 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.941897    2554 scope.go:117] "RemoveContainer" containerID="4256853206eba5cb5200e43bd1445249849f63ebfc9ba349b96d161ab6818ec8"
Jul 27 22:03:00.986074 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:00.985971    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"]
Jul 27 22:03:01.002346 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:01.002303    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-52fa39dc-7bf5676b74-kdnb8"]
Jul 27 22:03:01.094240 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:01.094191    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"]
Jul 27 22:03:01.115701 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:01.115662    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-52fa39dc-7f88587bdd-rxczr"]
Jul 27 22:03:02.921891 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:02.921837    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e357b28-8352-4c76-ac5a-6f353ebd6e49" path="/var/lib/kubelet/pods/0e357b28-8352-4c76-ac5a-6f353ebd6e49/volumes"
Jul 27 22:03:02.922392 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:03:02.922376    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7ce56f6-0885-4ebb-9858-fd33e9a3d037" path="/var/lib/kubelet/pods/a7ce56f6-0885-4ebb-9858-fd33e9a3d037/volumes"
Jul 27 22:04:10.369719 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:04:10.369615    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:04:10.376634 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:04:10.376388    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:06:00.921567 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.921525    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"]
Jul 27 22:06:00.922063 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.921927    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e357b28-8352-4c76-ac5a-6f353ebd6e49" containerName="payload-pre-processing"
Jul 27 22:06:00.922063 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.921940    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e357b28-8352-4c76-ac5a-6f353ebd6e49" containerName="payload-pre-processing"
Jul 27 22:06:00.922063 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.921967    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7ce56f6-0885-4ebb-9858-fd33e9a3d037" containerName="payload-processing"
Jul 27 22:06:00.922063 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.921974    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7ce56f6-0885-4ebb-9858-fd33e9a3d037" containerName="payload-processing"
Jul 27 22:06:00.922063 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.922035    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e357b28-8352-4c76-ac5a-6f353ebd6e49" containerName="payload-pre-processing"
Jul 27 22:06:00.922063 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.922043    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7ce56f6-0885-4ebb-9858-fd33e9a3d037" containerName="payload-processing"
Jul 27 22:06:00.924518 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.924493    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:06:00.931021 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.930756    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e2733d0b\""
Jul 27 22:06:00.931912 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.931883    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e2733d0b-dockercfg-jqlrb\""
Jul 27 22:06:00.932322 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.932291    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"]
Jul 27 22:06:00.964869 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.964827    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"]
Jul 27 22:06:00.967851 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.967827    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:06:00.985762 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:00.985725    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"]
Jul 27 22:06:01.012570 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.012520    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/feb87982-e8ec-4db0-9c42-85fc58232373-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc\" (UID: \"feb87982-e8ec-4db0-9c42-85fc58232373\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:06:01.012759 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.012576    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js56x\" (UniqueName: \"kubernetes.io/projected/feb87982-e8ec-4db0-9c42-85fc58232373-kube-api-access-js56x\") pod \"payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc\" (UID: \"feb87982-e8ec-4db0-9c42-85fc58232373\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:06:01.113885 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.113825    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/feb87982-e8ec-4db0-9c42-85fc58232373-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc\" (UID: \"feb87982-e8ec-4db0-9c42-85fc58232373\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:06:01.113885 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.113885    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js56x\" (UniqueName: \"kubernetes.io/projected/feb87982-e8ec-4db0-9c42-85fc58232373-kube-api-access-js56x\") pod \"payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc\" (UID: \"feb87982-e8ec-4db0-9c42-85fc58232373\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:06:01.114145 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.113926    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54a21b16-570d-44e7-ab1d-00d663b851bb-plugins-config-volume\") pod \"payload-processing-e2e-mt-e2733d0b-74b8699498-h478b\" (UID: \"54a21b16-570d-44e7-ab1d-00d663b851bb\") " pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:06:01.114145 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.113977    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s828\" (UniqueName: \"kubernetes.io/projected/54a21b16-570d-44e7-ab1d-00d663b851bb-kube-api-access-7s828\") pod \"payload-processing-e2e-mt-e2733d0b-74b8699498-h478b\" (UID: \"54a21b16-570d-44e7-ab1d-00d663b851bb\") " pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:06:01.114678 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.114659    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/feb87982-e8ec-4db0-9c42-85fc58232373-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc\" (UID: \"feb87982-e8ec-4db0-9c42-85fc58232373\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:06:01.124400 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.124367    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js56x\" (UniqueName: \"kubernetes.io/projected/feb87982-e8ec-4db0-9c42-85fc58232373-kube-api-access-js56x\") pod \"payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc\" (UID: \"feb87982-e8ec-4db0-9c42-85fc58232373\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:06:01.215270 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.215229    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54a21b16-570d-44e7-ab1d-00d663b851bb-plugins-config-volume\") pod \"payload-processing-e2e-mt-e2733d0b-74b8699498-h478b\" (UID: \"54a21b16-570d-44e7-ab1d-00d663b851bb\") " pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:06:01.215546 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.215292    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s828\" (UniqueName: \"kubernetes.io/projected/54a21b16-570d-44e7-ab1d-00d663b851bb-kube-api-access-7s828\") pod \"payload-processing-e2e-mt-e2733d0b-74b8699498-h478b\" (UID: \"54a21b16-570d-44e7-ab1d-00d663b851bb\") " pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:06:01.216039 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.216013    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54a21b16-570d-44e7-ab1d-00d663b851bb-plugins-config-volume\") pod \"payload-processing-e2e-mt-e2733d0b-74b8699498-h478b\" (UID: \"54a21b16-570d-44e7-ab1d-00d663b851bb\") " pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:06:01.225232 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.225206    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s828\" (UniqueName: \"kubernetes.io/projected/54a21b16-570d-44e7-ab1d-00d663b851bb-kube-api-access-7s828\") pod \"payload-processing-e2e-mt-e2733d0b-74b8699498-h478b\" (UID: \"54a21b16-570d-44e7-ab1d-00d663b851bb\") " pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:06:01.238771 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.238728    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:06:01.279507 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.279462    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:06:01.414690 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.414649    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"]
Jul 27 22:06:01.417556 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:06:01.417509    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb87982_e8ec_4db0_9c42_85fc58232373.slice/crio-63a565c9e75aa85a2a52aef18390ebbb173f47d5bc3a46079cbe07bbdbd39262 WatchSource:0}: Error finding container 63a565c9e75aa85a2a52aef18390ebbb173f47d5bc3a46079cbe07bbdbd39262: Status 404 returned error can't find the container with id 63a565c9e75aa85a2a52aef18390ebbb173f47d5bc3a46079cbe07bbdbd39262
Jul 27 22:06:01.456584 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.456553    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"]
Jul 27 22:06:01.459581 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:06:01.459552    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a21b16_570d_44e7_ab1d_00d663b851bb.slice/crio-1770e311ef065a6baf0d3dadddc0843aa19331f0f3d667a4b72ae0ae23ffaff1 WatchSource:0}: Error finding container 1770e311ef065a6baf0d3dadddc0843aa19331f0f3d667a4b72ae0ae23ffaff1: Status 404 returned error can't find the container with id 1770e311ef065a6baf0d3dadddc0843aa19331f0f3d667a4b72ae0ae23ffaff1
Jul 27 22:06:01.907578 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.907484    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc" event={"ID":"feb87982-e8ec-4db0-9c42-85fc58232373","Type":"ContainerStarted","Data":"44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60"}
Jul 27 22:06:01.907578 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.907537    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc" event={"ID":"feb87982-e8ec-4db0-9c42-85fc58232373","Type":"ContainerStarted","Data":"63a565c9e75aa85a2a52aef18390ebbb173f47d5bc3a46079cbe07bbdbd39262"}
Jul 27 22:06:01.907790 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.907670    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:06:01.909029 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.909002    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b" event={"ID":"54a21b16-570d-44e7-ab1d-00d663b851bb","Type":"ContainerStarted","Data":"2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7"}
Jul 27 22:06:01.909160 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.909044    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b" event={"ID":"54a21b16-570d-44e7-ab1d-00d663b851bb","Type":"ContainerStarted","Data":"1770e311ef065a6baf0d3dadddc0843aa19331f0f3d667a4b72ae0ae23ffaff1"}
Jul 27 22:06:01.909160 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.909066    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:06:01.937648 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.937574    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc" podStartSLOduration=1.937549122 podStartE2EDuration="1.937549122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:06:01.934716078 +0000 UTC m=+1913.652122559" watchObservedRunningTime="2026-07-27 22:06:01.937549122 +0000 UTC m=+1913.654955605"
Jul 27 22:06:01.968986 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:01.968904    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b" podStartSLOduration=1.968878346 podStartE2EDuration="1.968878346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:06:01.966251868 +0000 UTC m=+1913.683658357" watchObservedRunningTime="2026-07-27 22:06:01.968878346 +0000 UTC m=+1913.686284832"
Jul 27 22:06:12.921642 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:12.921604    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:06:12.922078 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:12.921678    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:06:34.771089 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.771046    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"]
Jul 27 22:06:34.775330 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.775305    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.780224 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.780193    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e2733d0b\"/\"kube-root-ca.crt\""
Jul 27 22:06:34.780224 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.780214    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e2733d0b\"/\"e2e-lifecycle-model-e2733d0b-kserve-self-signed-certs\""
Jul 27 22:06:34.780521 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.780238    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e2733d0b\"/\"default-dockercfg-2kdg7\""
Jul 27 22:06:34.780828 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.780803    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e2733d0b\"/\"openshift-service-ca.crt\""
Jul 27 22:06:34.787476 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.787417    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"]
Jul 27 22:06:34.855576 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.855538    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-tmp-dir\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.855576 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.855584    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-home\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.855837 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.855608    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-dshm\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.855837 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.855623    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8becc097-a902-4450-9d50-808e76765464-tls-certs\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.855837 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.855713    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-model-cache\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.855837 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.855808    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hczg\" (UniqueName: \"kubernetes.io/projected/8becc097-a902-4450-9d50-808e76765464-kube-api-access-4hczg\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.956630 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.956589    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-tmp-dir\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.956818 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.956646    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-home\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.956818 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.956683    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-dshm\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.956818 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.956706    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8becc097-a902-4450-9d50-808e76765464-tls-certs\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.956818 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.956772    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-model-cache\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.957029 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.956843    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hczg\" (UniqueName: \"kubernetes.io/projected/8becc097-a902-4450-9d50-808e76765464-kube-api-access-4hczg\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.957087 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.957047    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-tmp-dir\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.957167 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.957141    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-home\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.957228 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.957199    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-model-cache\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.959361 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.959322    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-dshm\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.959579 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.959553    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8becc097-a902-4450-9d50-808e76765464-tls-certs\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:34.966349 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:34.966320    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hczg\" (UniqueName: \"kubernetes.io/projected/8becc097-a902-4450-9d50-808e76765464-kube-api-access-4hczg\") pod \"e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") " pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:35.086333 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:35.086235    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:35.242649 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:35.242620    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"]
Jul 27 22:06:35.244350 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:06:35.244317    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8becc097_a902_4450_9d50_808e76765464.slice/crio-8ad927b3ad229e67e77393a88d7ff9ba517415c058185a0d4a4175e0230d96bd WatchSource:0}: Error finding container 8ad927b3ad229e67e77393a88d7ff9ba517415c058185a0d4a4175e0230d96bd: Status 404 returned error can't find the container with id 8ad927b3ad229e67e77393a88d7ff9ba517415c058185a0d4a4175e0230d96bd
Jul 27 22:06:36.099992 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:36.099953    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw" event={"ID":"8becc097-a902-4450-9d50-808e76765464","Type":"ContainerStarted","Data":"eb3c328f7845e7f3e9e8a2c031abe673336247fb30a85a957492ddabbe692912"}
Jul 27 22:06:36.099992 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:36.100006    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw" event={"ID":"8becc097-a902-4450-9d50-808e76765464","Type":"ContainerStarted","Data":"8ad927b3ad229e67e77393a88d7ff9ba517415c058185a0d4a4175e0230d96bd"}
Jul 27 22:06:36.120349 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:36.120293    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw" podStartSLOduration=2.120273708 podStartE2EDuration="2.120273708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:06:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:06:36.118684711 +0000 UTC m=+1947.836091194" watchObservedRunningTime="2026-07-27 22:06:36.120273708 +0000 UTC m=+1947.837680193"
Jul 27 22:06:45.086807 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:45.086768    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:45.087289 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:45.086835    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:45.101309 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:45.101276    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:45.160283 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:45.160251    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:06:59.205550 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:59.205460    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"]
Jul 27 22:06:59.209303 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:59.209276    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"
Jul 27 22:06:59.212307 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:59.212274    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:06:59.212474 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:59.212345    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:06:59.217408 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:59.217372    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"]
Jul 27 22:06:59.293090 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:59.293037    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ae9078-5aac-42cd-8f80-8e021bf719f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr\" (UID: \"36ae9078-5aac-42cd-8f80-8e021bf719f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"
Jul 27 22:06:59.394489 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:59.394446    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ae9078-5aac-42cd-8f80-8e021bf719f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr\" (UID: \"36ae9078-5aac-42cd-8f80-8e021bf719f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"
Jul 27 22:06:59.395103 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:59.395079    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ae9078-5aac-42cd-8f80-8e021bf719f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr\" (UID: \"36ae9078-5aac-42cd-8f80-8e021bf719f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"
Jul 27 22:06:59.524235 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:59.524193    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"
Jul 27 22:06:59.674549 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:06:59.674500    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"]
Jul 27 22:06:59.677307 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:06:59.677267    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ae9078_5aac_42cd_8f80_8e021bf719f7.slice/crio-8f4b997102c048ce6776f63a9ac85e171228b2249f790ebd7ca7f07bca487f23 WatchSource:0}: Error finding container 8f4b997102c048ce6776f63a9ac85e171228b2249f790ebd7ca7f07bca487f23: Status 404 returned error can't find the container with id 8f4b997102c048ce6776f63a9ac85e171228b2249f790ebd7ca7f07bca487f23
Jul 27 22:07:00.231598 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:00.231553    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr" event={"ID":"36ae9078-5aac-42cd-8f80-8e021bf719f7","Type":"ContainerStarted","Data":"277605d69cf4e49b547301b449b848ce38fd84009ea87b0673848cf93f5be664"}
Jul 27 22:07:00.232092 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:00.231617    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr" event={"ID":"36ae9078-5aac-42cd-8f80-8e021bf719f7","Type":"ContainerStarted","Data":"8f4b997102c048ce6776f63a9ac85e171228b2249f790ebd7ca7f07bca487f23"}
Jul 27 22:07:00.249865 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:00.249799    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr" podStartSLOduration=1.249781715 podStartE2EDuration="1.249781715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:06:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:07:00.24856949 +0000 UTC m=+1971.965975973" watchObservedRunningTime="2026-07-27 22:07:00.249781715 +0000 UTC m=+1971.967188246"
Jul 27 22:07:01.239008 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:01.238970    2554 generic.go:356] "Generic (PLEG): container finished" podID="36ae9078-5aac-42cd-8f80-8e021bf719f7" containerID="277605d69cf4e49b547301b449b848ce38fd84009ea87b0673848cf93f5be664" exitCode=0
Jul 27 22:07:01.239479 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:01.239077    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr" event={"ID":"36ae9078-5aac-42cd-8f80-8e021bf719f7","Type":"ContainerDied","Data":"277605d69cf4e49b547301b449b848ce38fd84009ea87b0673848cf93f5be664"}
Jul 27 22:07:02.386691 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:02.386656    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"
Jul 27 22:07:02.426824 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:02.426792    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ae9078-5aac-42cd-8f80-8e021bf719f7-maas-api-service-ca\") pod \"36ae9078-5aac-42cd-8f80-8e021bf719f7\" (UID: \"36ae9078-5aac-42cd-8f80-8e021bf719f7\") "
Jul 27 22:07:02.427316 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:02.427269    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ae9078-5aac-42cd-8f80-8e021bf719f7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "36ae9078-5aac-42cd-8f80-8e021bf719f7" (UID: "36ae9078-5aac-42cd-8f80-8e021bf719f7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:07:02.528625 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:02.528532    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ae9078-5aac-42cd-8f80-8e021bf719f7-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:07:03.251667 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:03.251639    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"
Jul 27 22:07:03.251819 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:03.251687    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr" event={"ID":"36ae9078-5aac-42cd-8f80-8e021bf719f7","Type":"ContainerDied","Data":"8f4b997102c048ce6776f63a9ac85e171228b2249f790ebd7ca7f07bca487f23"}
Jul 27 22:07:03.251819 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:03.251732    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f4b997102c048ce6776f63a9ac85e171228b2249f790ebd7ca7f07bca487f23"
Jul 27 22:07:14.735420 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:14.735386    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"]
Jul 27 22:07:14.736039 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:14.735650    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b" podUID="54a21b16-570d-44e7-ab1d-00d663b851bb" containerName="payload-processing" containerID="cri-o://2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7" gracePeriod=30
Jul 27 22:07:14.745546 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:14.745516    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"]
Jul 27 22:07:14.745801 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:14.745752    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc" podUID="feb87982-e8ec-4db0-9c42-85fc58232373" containerName="payload-pre-processing" containerID="cri-o://44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60" gracePeriod=30
Jul 27 22:07:14.880848 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:14.880799    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"]
Jul 27 22:07:14.882933 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:14.882886    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e2733d0b-29tdr"]
Jul 27 22:07:14.925216 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:14.925184    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36ae9078-5aac-42cd-8f80-8e021bf719f7" path="/var/lib/kubelet/pods/36ae9078-5aac-42cd-8f80-8e021bf719f7/volumes"
Jul 27 22:07:14.995974 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:14.995907    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:07:15.022667 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.022640    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:07:15.161883 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.161851    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54a21b16-570d-44e7-ab1d-00d663b851bb-plugins-config-volume\") pod \"54a21b16-570d-44e7-ab1d-00d663b851bb\" (UID: \"54a21b16-570d-44e7-ab1d-00d663b851bb\") "
Jul 27 22:07:15.162069 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.161963    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/feb87982-e8ec-4db0-9c42-85fc58232373-plugins-config-volume\") pod \"feb87982-e8ec-4db0-9c42-85fc58232373\" (UID: \"feb87982-e8ec-4db0-9c42-85fc58232373\") "
Jul 27 22:07:15.162069 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.162025    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js56x\" (UniqueName: \"kubernetes.io/projected/feb87982-e8ec-4db0-9c42-85fc58232373-kube-api-access-js56x\") pod \"feb87982-e8ec-4db0-9c42-85fc58232373\" (UID: \"feb87982-e8ec-4db0-9c42-85fc58232373\") "
Jul 27 22:07:15.162069 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.162053    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s828\" (UniqueName: \"kubernetes.io/projected/54a21b16-570d-44e7-ab1d-00d663b851bb-kube-api-access-7s828\") pod \"54a21b16-570d-44e7-ab1d-00d663b851bb\" (UID: \"54a21b16-570d-44e7-ab1d-00d663b851bb\") "
Jul 27 22:07:15.162249 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.162188    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54a21b16-570d-44e7-ab1d-00d663b851bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54a21b16-570d-44e7-ab1d-00d663b851bb" (UID: "54a21b16-570d-44e7-ab1d-00d663b851bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:07:15.162349 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.162326    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb87982-e8ec-4db0-9c42-85fc58232373-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "feb87982-e8ec-4db0-9c42-85fc58232373" (UID: "feb87982-e8ec-4db0-9c42-85fc58232373"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:07:15.162401 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.162334    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54a21b16-570d-44e7-ab1d-00d663b851bb-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:07:15.164248 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.164229    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54a21b16-570d-44e7-ab1d-00d663b851bb-kube-api-access-7s828" (OuterVolumeSpecName: "kube-api-access-7s828") pod "54a21b16-570d-44e7-ab1d-00d663b851bb" (UID: "54a21b16-570d-44e7-ab1d-00d663b851bb"). InnerVolumeSpecName "kube-api-access-7s828". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:07:15.164248 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.164234    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb87982-e8ec-4db0-9c42-85fc58232373-kube-api-access-js56x" (OuterVolumeSpecName: "kube-api-access-js56x") pod "feb87982-e8ec-4db0-9c42-85fc58232373" (UID: "feb87982-e8ec-4db0-9c42-85fc58232373"). InnerVolumeSpecName "kube-api-access-js56x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:07:15.262988 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.262881    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/feb87982-e8ec-4db0-9c42-85fc58232373-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:07:15.262988 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.262930    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js56x\" (UniqueName: \"kubernetes.io/projected/feb87982-e8ec-4db0-9c42-85fc58232373-kube-api-access-js56x\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:07:15.262988 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.262939    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s828\" (UniqueName: \"kubernetes.io/projected/54a21b16-570d-44e7-ab1d-00d663b851bb-kube-api-access-7s828\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:07:15.315392 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.315354    2554 generic.go:356] "Generic (PLEG): container finished" podID="feb87982-e8ec-4db0-9c42-85fc58232373" containerID="44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60" exitCode=0
Jul 27 22:07:15.315618 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.315402    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"
Jul 27 22:07:15.315618 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.315460    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc" event={"ID":"feb87982-e8ec-4db0-9c42-85fc58232373","Type":"ContainerDied","Data":"44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60"}
Jul 27 22:07:15.315618 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.315556    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc" event={"ID":"feb87982-e8ec-4db0-9c42-85fc58232373","Type":"ContainerDied","Data":"63a565c9e75aa85a2a52aef18390ebbb173f47d5bc3a46079cbe07bbdbd39262"}
Jul 27 22:07:15.315618 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.315588    2554 scope.go:117] "RemoveContainer" containerID="44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60"
Jul 27 22:07:15.320358 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.320332    2554 generic.go:356] "Generic (PLEG): container finished" podID="54a21b16-570d-44e7-ab1d-00d663b851bb" containerID="2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7" exitCode=0
Jul 27 22:07:15.320563 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.320381    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"
Jul 27 22:07:15.320563 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.320411    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b" event={"ID":"54a21b16-570d-44e7-ab1d-00d663b851bb","Type":"ContainerDied","Data":"2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7"}
Jul 27 22:07:15.320563 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.320486    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b" event={"ID":"54a21b16-570d-44e7-ab1d-00d663b851bb","Type":"ContainerDied","Data":"1770e311ef065a6baf0d3dadddc0843aa19331f0f3d667a4b72ae0ae23ffaff1"}
Jul 27 22:07:15.329384 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.329364    2554 scope.go:117] "RemoveContainer" containerID="44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60"
Jul 27 22:07:15.329760 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:07:15.329734    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60\": container with ID starting with 44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60 not found: ID does not exist" containerID="44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60"
Jul 27 22:07:15.329867 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.329766    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60"} err="failed to get container status \"44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60\": rpc error: code = NotFound desc = could not find container \"44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60\": container with ID starting with 44cd957786fea3ea6379defb377b6ed16221ae99d4c35fe3126b8bb857b14b60 not found: ID does not exist"
Jul 27 22:07:15.329867 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.329783    2554 scope.go:117] "RemoveContainer" containerID="2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7"
Jul 27 22:07:15.340110 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.340087    2554 scope.go:117] "RemoveContainer" containerID="2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7"
Jul 27 22:07:15.340553 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:07:15.340517    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7\": container with ID starting with 2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7 not found: ID does not exist" containerID="2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7"
Jul 27 22:07:15.340652 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.340559    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7"} err="failed to get container status \"2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7\": rpc error: code = NotFound desc = could not find container \"2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7\": container with ID starting with 2e891d581e1b11663fb7833b1d594efc7369583374f4b34f4d5eb101a008abd7 not found: ID does not exist"
Jul 27 22:07:15.341826 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.341806    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"]
Jul 27 22:07:15.346367 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.346346    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e2733d0b-54585b855b-qrnvc"]
Jul 27 22:07:15.358757 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.358734    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"]
Jul 27 22:07:15.362589 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:15.362567    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e2733d0b-74b8699498-h478b"]
Jul 27 22:07:16.920824 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:16.920797    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54a21b16-570d-44e7-ab1d-00d663b851bb" path="/var/lib/kubelet/pods/54a21b16-570d-44e7-ab1d-00d663b851bb/volumes"
Jul 27 22:07:16.921219 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:16.921205    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb87982-e8ec-4db0-9c42-85fc58232373" path="/var/lib/kubelet/pods/feb87982-e8ec-4db0-9c42-85fc58232373/volumes"
Jul 27 22:07:23.197940 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:23.197905    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"]
Jul 27 22:07:38.217821 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.217775    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw" podUID="8becc097-a902-4450-9d50-808e76765464" containerName="main" containerID="cri-o://eb3c328f7845e7f3e9e8a2c031abe673336247fb30a85a957492ddabbe692912" gracePeriod=45
Jul 27 22:07:38.441098 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.441064    2554 generic.go:356] "Generic (PLEG): container finished" podID="8becc097-a902-4450-9d50-808e76765464" containerID="eb3c328f7845e7f3e9e8a2c031abe673336247fb30a85a957492ddabbe692912" exitCode=0
Jul 27 22:07:38.441266 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.441132    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw" event={"ID":"8becc097-a902-4450-9d50-808e76765464","Type":"ContainerDied","Data":"eb3c328f7845e7f3e9e8a2c031abe673336247fb30a85a957492ddabbe692912"}
Jul 27 22:07:38.470269 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.470214    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:07:38.575263 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575229    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-model-cache\") pod \"8becc097-a902-4450-9d50-808e76765464\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") "
Jul 27 22:07:38.575473 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575283    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-home\") pod \"8becc097-a902-4450-9d50-808e76765464\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") "
Jul 27 22:07:38.575473 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575318    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hczg\" (UniqueName: \"kubernetes.io/projected/8becc097-a902-4450-9d50-808e76765464-kube-api-access-4hczg\") pod \"8becc097-a902-4450-9d50-808e76765464\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") "
Jul 27 22:07:38.575473 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575354    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8becc097-a902-4450-9d50-808e76765464-tls-certs\") pod \"8becc097-a902-4450-9d50-808e76765464\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") "
Jul 27 22:07:38.575473 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575386    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-tmp-dir\") pod \"8becc097-a902-4450-9d50-808e76765464\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") "
Jul 27 22:07:38.575473 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575417    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-dshm\") pod \"8becc097-a902-4450-9d50-808e76765464\" (UID: \"8becc097-a902-4450-9d50-808e76765464\") "
Jul 27 22:07:38.575749 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575583    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-model-cache" (OuterVolumeSpecName: "model-cache") pod "8becc097-a902-4450-9d50-808e76765464" (UID: "8becc097-a902-4450-9d50-808e76765464"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:07:38.575749 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575655    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8becc097-a902-4450-9d50-808e76765464" (UID: "8becc097-a902-4450-9d50-808e76765464"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:07:38.575749 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575671    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-home" (OuterVolumeSpecName: "home") pod "8becc097-a902-4450-9d50-808e76765464" (UID: "8becc097-a902-4450-9d50-808e76765464"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:07:38.575879 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575801    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-model-cache\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:07:38.575879 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575814    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-home\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:07:38.575879 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.575822    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-tmp-dir\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:07:38.577863 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.577840    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-dshm" (OuterVolumeSpecName: "dshm") pod "8becc097-a902-4450-9d50-808e76765464" (UID: "8becc097-a902-4450-9d50-808e76765464"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:07:38.577943 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.577867    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8becc097-a902-4450-9d50-808e76765464-kube-api-access-4hczg" (OuterVolumeSpecName: "kube-api-access-4hczg") pod "8becc097-a902-4450-9d50-808e76765464" (UID: "8becc097-a902-4450-9d50-808e76765464"). InnerVolumeSpecName "kube-api-access-4hczg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:07:38.577943 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.577934    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8becc097-a902-4450-9d50-808e76765464-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8becc097-a902-4450-9d50-808e76765464" (UID: "8becc097-a902-4450-9d50-808e76765464"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:07:38.676803 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.676762    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hczg\" (UniqueName: \"kubernetes.io/projected/8becc097-a902-4450-9d50-808e76765464-kube-api-access-4hczg\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:07:38.676803 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.676792    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8becc097-a902-4450-9d50-808e76765464-tls-certs\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:07:38.676803 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:38.676803    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8becc097-a902-4450-9d50-808e76765464-dshm\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:07:39.447916 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:39.447884    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"
Jul 27 22:07:39.447916 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:39.447894    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw" event={"ID":"8becc097-a902-4450-9d50-808e76765464","Type":"ContainerDied","Data":"8ad927b3ad229e67e77393a88d7ff9ba517415c058185a0d4a4175e0230d96bd"}
Jul 27 22:07:39.448479 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:39.447945    2554 scope.go:117] "RemoveContainer" containerID="eb3c328f7845e7f3e9e8a2c031abe673336247fb30a85a957492ddabbe692912"
Jul 27 22:07:39.475809 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:39.475783    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"]
Jul 27 22:07:39.479263 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:39.479236    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e2733d0b/e2e-lifecycle-model-e2733d0b-kserve-6c7c98f675-mm2bw"]
Jul 27 22:07:40.921064 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:07:40.921029    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8becc097-a902-4450-9d50-808e76765464" path="/var/lib/kubelet/pods/8becc097-a902-4450-9d50-808e76765464/volumes"
Jul 27 22:08:09.053845 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:08:09.053814    2554 scope.go:117] "RemoveContainer" containerID="d90e02322911ccbd3b1f5e55b939e97732ffb35644302100e3c59688557a2353"
Jul 27 22:09:05.394798 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.394755    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"]
Jul 27 22:09:05.395489 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395389    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ae9078-5aac-42cd-8f80-8e021bf719f7" containerName="revoke-keys"
Jul 27 22:09:05.395489 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395410    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ae9078-5aac-42cd-8f80-8e021bf719f7" containerName="revoke-keys"
Jul 27 22:09:05.395489 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395425    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb87982-e8ec-4db0-9c42-85fc58232373" containerName="payload-pre-processing"
Jul 27 22:09:05.395489 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395453    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb87982-e8ec-4db0-9c42-85fc58232373" containerName="payload-pre-processing"
Jul 27 22:09:05.395489 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395464    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54a21b16-570d-44e7-ab1d-00d663b851bb" containerName="payload-processing"
Jul 27 22:09:05.395489 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395476    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="54a21b16-570d-44e7-ab1d-00d663b851bb" containerName="payload-processing"
Jul 27 22:09:05.395489 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395492    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8becc097-a902-4450-9d50-808e76765464" containerName="main"
Jul 27 22:09:05.395848 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395500    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8becc097-a902-4450-9d50-808e76765464" containerName="main"
Jul 27 22:09:05.395848 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395631    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb87982-e8ec-4db0-9c42-85fc58232373" containerName="payload-pre-processing"
Jul 27 22:09:05.395848 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395642    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="54a21b16-570d-44e7-ab1d-00d663b851bb" containerName="payload-processing"
Jul 27 22:09:05.395848 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395658    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8becc097-a902-4450-9d50-808e76765464" containerName="main"
Jul 27 22:09:05.395848 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.395667    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ae9078-5aac-42cd-8f80-8e021bf719f7" containerName="revoke-keys"
Jul 27 22:09:05.398987 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.398966    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:09:05.401738 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.401716    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-462b96-dockercfg-jscwt\""
Jul 27 22:09:05.402376 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.402358    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-462b96\""
Jul 27 22:09:05.414163 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.414135    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"]
Jul 27 22:09:05.423025 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.423000    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"]
Jul 27 22:09:05.427709 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.427690    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:09:05.439239 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.439215    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"]
Jul 27 22:09:05.513273 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.513242    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch9ts\" (UniqueName: \"kubernetes.io/projected/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-kube-api-access-ch9ts\") pod \"payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc\" (UID: \"2dd8819a-0818-49d9-ba69-b65d5a74c1e7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:09:05.513495 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.513278    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8\" (UID: \"1128a783-03bc-4c69-ad72-2ee5bbb9ab99\") " pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:09:05.513495 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.513302    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc\" (UID: \"2dd8819a-0818-49d9-ba69-b65d5a74c1e7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:09:05.513495 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.513424    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kfk4\" (UniqueName: \"kubernetes.io/projected/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-kube-api-access-9kfk4\") pod \"payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8\" (UID: \"1128a783-03bc-4c69-ad72-2ee5bbb9ab99\") " pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:09:05.614765 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.614722    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9ts\" (UniqueName: \"kubernetes.io/projected/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-kube-api-access-ch9ts\") pod \"payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc\" (UID: \"2dd8819a-0818-49d9-ba69-b65d5a74c1e7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:09:05.614765 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.614766    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8\" (UID: \"1128a783-03bc-4c69-ad72-2ee5bbb9ab99\") " pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:09:05.614992 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.614799    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc\" (UID: \"2dd8819a-0818-49d9-ba69-b65d5a74c1e7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:09:05.614992 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.614838    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kfk4\" (UniqueName: \"kubernetes.io/projected/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-kube-api-access-9kfk4\") pod \"payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8\" (UID: \"1128a783-03bc-4c69-ad72-2ee5bbb9ab99\") " pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:09:05.615490 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.615470    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8\" (UID: \"1128a783-03bc-4c69-ad72-2ee5bbb9ab99\") " pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:09:05.615578 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.615560    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc\" (UID: \"2dd8819a-0818-49d9-ba69-b65d5a74c1e7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:09:05.624053 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.624028    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch9ts\" (UniqueName: \"kubernetes.io/projected/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-kube-api-access-ch9ts\") pod \"payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc\" (UID: \"2dd8819a-0818-49d9-ba69-b65d5a74c1e7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:09:05.624853 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.624836    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kfk4\" (UniqueName: \"kubernetes.io/projected/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-kube-api-access-9kfk4\") pod \"payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8\" (UID: \"1128a783-03bc-4c69-ad72-2ee5bbb9ab99\") " pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:09:05.709095 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.708994    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:09:05.740641 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.740611    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:09:05.860384 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.860358    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"]
Jul 27 22:09:05.863289 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:09:05.863258    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd8819a_0818_49d9_ba69_b65d5a74c1e7.slice/crio-58cc97ac216669ce3f417dfcb0824cf77cc1bc56488ba6519a758eb364e1fa7f WatchSource:0}: Error finding container 58cc97ac216669ce3f417dfcb0824cf77cc1bc56488ba6519a758eb364e1fa7f: Status 404 returned error can't find the container with id 58cc97ac216669ce3f417dfcb0824cf77cc1bc56488ba6519a758eb364e1fa7f
Jul 27 22:09:05.895125 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.895099    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"]
Jul 27 22:09:05.896785 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:05.896761    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc" event={"ID":"2dd8819a-0818-49d9-ba69-b65d5a74c1e7","Type":"ContainerStarted","Data":"58cc97ac216669ce3f417dfcb0824cf77cc1bc56488ba6519a758eb364e1fa7f"}
Jul 27 22:09:05.904704 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:09:05.904675    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1128a783_03bc_4c69_ad72_2ee5bbb9ab99.slice/crio-6593baa3694b01338da53fb80729e6931e07899c27ff7993f21d4b7f265a84f3 WatchSource:0}: Error finding container 6593baa3694b01338da53fb80729e6931e07899c27ff7993f21d4b7f265a84f3: Status 404 returned error can't find the container with id 6593baa3694b01338da53fb80729e6931e07899c27ff7993f21d4b7f265a84f3
Jul 27 22:09:06.903364 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:06.903324    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8" event={"ID":"1128a783-03bc-4c69-ad72-2ee5bbb9ab99","Type":"ContainerStarted","Data":"2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de"}
Jul 27 22:09:06.903849 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:06.903402    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:09:06.903849 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:06.903429    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8" event={"ID":"1128a783-03bc-4c69-ad72-2ee5bbb9ab99","Type":"ContainerStarted","Data":"6593baa3694b01338da53fb80729e6931e07899c27ff7993f21d4b7f265a84f3"}
Jul 27 22:09:06.904815 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:06.904792    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc" event={"ID":"2dd8819a-0818-49d9-ba69-b65d5a74c1e7","Type":"ContainerStarted","Data":"f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0"}
Jul 27 22:09:06.904934 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:06.904890    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:09:06.939854 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:06.939796    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8" podStartSLOduration=1.9397817019999999 podStartE2EDuration="1.939781702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:09:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:09:06.938908527 +0000 UTC m=+2098.656315010" watchObservedRunningTime="2026-07-27 22:09:06.939781702 +0000 UTC m=+2098.657188184"
Jul 27 22:09:06.981872 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:06.981821    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc" podStartSLOduration=1.981803413 podStartE2EDuration="1.981803413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:09:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:09:06.979549211 +0000 UTC m=+2098.696955692" watchObservedRunningTime="2026-07-27 22:09:06.981803413 +0000 UTC m=+2098.699209895"
Jul 27 22:09:09.086720 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:09.086689    2554 scope.go:117] "RemoveContainer" containerID="9d2a0ea7d8e049ccf191dd179e2ccf4187fb927dd0d21dd2255e5b85ef8d350d"
Jul 27 22:09:10.403500 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:10.403370    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:09:10.421778 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:10.410742    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:09:17.913393 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:17.913366    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:09:17.913801 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:17.913448    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:09:34.520921 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.520885    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"]
Jul 27 22:09:34.524563 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.524547    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:09:34.527786 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.527761    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-d28642-dockercfg-pw2fr\""
Jul 27 22:09:34.527934 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.527867    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-d28642\""
Jul 27 22:09:34.550924 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.550890    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"]
Jul 27 22:09:34.551119 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.551084    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"]
Jul 27 22:09:34.556153 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.556127    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:09:34.565018 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.564995    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"]
Jul 27 22:09:34.596801 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.596747    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbc5c773-8d12-4e5c-9429-f8f694809455-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g\" (UID: \"cbc5c773-8d12-4e5c-9429-f8f694809455\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:09:34.596801 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.596809    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr6ft\" (UniqueName: \"kubernetes.io/projected/cbc5c773-8d12-4e5c-9429-f8f694809455-kube-api-access-kr6ft\") pod \"payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g\" (UID: \"cbc5c773-8d12-4e5c-9429-f8f694809455\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:09:34.597022 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.596904    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb6cb\" (UniqueName: \"kubernetes.io/projected/49f41e5c-631e-4759-8589-15ecedbc4c87-kube-api-access-pb6cb\") pod \"payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz\" (UID: \"49f41e5c-631e-4759-8589-15ecedbc4c87\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:09:34.597022 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.596941    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49f41e5c-631e-4759-8589-15ecedbc4c87-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz\" (UID: \"49f41e5c-631e-4759-8589-15ecedbc4c87\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:09:34.698489 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.698448    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbc5c773-8d12-4e5c-9429-f8f694809455-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g\" (UID: \"cbc5c773-8d12-4e5c-9429-f8f694809455\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:09:34.698683 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.698507    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6ft\" (UniqueName: \"kubernetes.io/projected/cbc5c773-8d12-4e5c-9429-f8f694809455-kube-api-access-kr6ft\") pod \"payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g\" (UID: \"cbc5c773-8d12-4e5c-9429-f8f694809455\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:09:34.698683 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.698561    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6cb\" (UniqueName: \"kubernetes.io/projected/49f41e5c-631e-4759-8589-15ecedbc4c87-kube-api-access-pb6cb\") pod \"payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz\" (UID: \"49f41e5c-631e-4759-8589-15ecedbc4c87\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:09:34.698683 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.698592    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49f41e5c-631e-4759-8589-15ecedbc4c87-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz\" (UID: \"49f41e5c-631e-4759-8589-15ecedbc4c87\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:09:34.699259 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.699239    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbc5c773-8d12-4e5c-9429-f8f694809455-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g\" (UID: \"cbc5c773-8d12-4e5c-9429-f8f694809455\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:09:34.699318 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.699248    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49f41e5c-631e-4759-8589-15ecedbc4c87-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz\" (UID: \"49f41e5c-631e-4759-8589-15ecedbc4c87\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:09:34.707058 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.707036    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr6ft\" (UniqueName: \"kubernetes.io/projected/cbc5c773-8d12-4e5c-9429-f8f694809455-kube-api-access-kr6ft\") pod \"payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g\" (UID: \"cbc5c773-8d12-4e5c-9429-f8f694809455\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:09:34.707160 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.707076    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb6cb\" (UniqueName: \"kubernetes.io/projected/49f41e5c-631e-4759-8589-15ecedbc4c87-kube-api-access-pb6cb\") pod \"payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz\" (UID: \"49f41e5c-631e-4759-8589-15ecedbc4c87\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:09:34.837190 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.837094    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:09:34.867835 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.867804    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:09:34.996779 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:34.996582    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"]
Jul 27 22:09:35.000152 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:09:35.000110    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f41e5c_631e_4759_8589_15ecedbc4c87.slice/crio-e72599058f47758beb60659bc20c967f48999bc4ee767465196b6c0d99d3be7b WatchSource:0}: Error finding container e72599058f47758beb60659bc20c967f48999bc4ee767465196b6c0d99d3be7b: Status 404 returned error can't find the container with id e72599058f47758beb60659bc20c967f48999bc4ee767465196b6c0d99d3be7b
Jul 27 22:09:35.025452 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:35.025412    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"]
Jul 27 22:09:35.028231 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:09:35.028194    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc5c773_8d12_4e5c_9429_f8f694809455.slice/crio-0736124659c22cbf266fe569dc03b3917fb9a5406a49a735bd5e2b04cf4fcf1a WatchSource:0}: Error finding container 0736124659c22cbf266fe569dc03b3917fb9a5406a49a735bd5e2b04cf4fcf1a: Status 404 returned error can't find the container with id 0736124659c22cbf266fe569dc03b3917fb9a5406a49a735bd5e2b04cf4fcf1a
Jul 27 22:09:35.054164 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:35.054128    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g" event={"ID":"cbc5c773-8d12-4e5c-9429-f8f694809455","Type":"ContainerStarted","Data":"0736124659c22cbf266fe569dc03b3917fb9a5406a49a735bd5e2b04cf4fcf1a"}
Jul 27 22:09:35.055524 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:35.055492    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz" event={"ID":"49f41e5c-631e-4759-8589-15ecedbc4c87","Type":"ContainerStarted","Data":"e72599058f47758beb60659bc20c967f48999bc4ee767465196b6c0d99d3be7b"}
Jul 27 22:09:36.062333 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:36.062290    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz" event={"ID":"49f41e5c-631e-4759-8589-15ecedbc4c87","Type":"ContainerStarted","Data":"aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966"}
Jul 27 22:09:36.062879 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:36.062468    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:09:36.063942 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:36.063913    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g" event={"ID":"cbc5c773-8d12-4e5c-9429-f8f694809455","Type":"ContainerStarted","Data":"526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb"}
Jul 27 22:09:36.064118 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:36.064053    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:09:36.079472 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:36.079401    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz" podStartSLOduration=2.079385874 podStartE2EDuration="2.079385874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:09:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:09:36.077824746 +0000 UTC m=+2127.795231229" watchObservedRunningTime="2026-07-27 22:09:36.079385874 +0000 UTC m=+2127.796792356"
Jul 27 22:09:47.072702 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:47.072673    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:09:47.073211 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:47.072743    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:09:47.093515 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:09:47.093448    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g" podStartSLOduration=13.093414086 podStartE2EDuration="13.093414086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:09:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:09:36.093465801 +0000 UTC m=+2127.810872282" watchObservedRunningTime="2026-07-27 22:09:47.093414086 +0000 UTC m=+2138.810820568"
Jul 27 22:11:24.739202 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:24.739164    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"]
Jul 27 22:11:24.742835 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:24.742818    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"
Jul 27 22:11:24.745749 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:24.745724    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:11:24.745880 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:24.745733    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:11:24.750517 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:24.750473    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"]
Jul 27 22:11:24.761334 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:24.761303    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a6b3719-6fc5-4182-9308-aaf3810c2980-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk\" (UID: \"9a6b3719-6fc5-4182-9308-aaf3810c2980\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"
Jul 27 22:11:24.862154 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:24.862117    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a6b3719-6fc5-4182-9308-aaf3810c2980-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk\" (UID: \"9a6b3719-6fc5-4182-9308-aaf3810c2980\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"
Jul 27 22:11:24.862825 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:24.862806    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a6b3719-6fc5-4182-9308-aaf3810c2980-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk\" (UID: \"9a6b3719-6fc5-4182-9308-aaf3810c2980\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"
Jul 27 22:11:25.055832 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:25.055724    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"
Jul 27 22:11:25.226582 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:25.226557    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"]
Jul 27 22:11:25.229128 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:11:25.229103    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6b3719_6fc5_4182_9308_aaf3810c2980.slice/crio-49f6fd2526a1e14f2c65f9c8bacb8093fa844ef6239fd01ff680a31a985f50f2 WatchSource:0}: Error finding container 49f6fd2526a1e14f2c65f9c8bacb8093fa844ef6239fd01ff680a31a985f50f2: Status 404 returned error can't find the container with id 49f6fd2526a1e14f2c65f9c8bacb8093fa844ef6239fd01ff680a31a985f50f2
Jul 27 22:11:25.634959 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:25.634909    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk" event={"ID":"9a6b3719-6fc5-4182-9308-aaf3810c2980","Type":"ContainerStarted","Data":"d9b60a85f51715b2e2c2e8aa6e395aaaf4f4153f98c72a804bfed3faab31aeba"}
Jul 27 22:11:25.635161 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:25.635007    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk" event={"ID":"9a6b3719-6fc5-4182-9308-aaf3810c2980","Type":"ContainerStarted","Data":"49f6fd2526a1e14f2c65f9c8bacb8093fa844ef6239fd01ff680a31a985f50f2"}
Jul 27 22:11:25.654171 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:25.654100    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk" podStartSLOduration=1.654079198 podStartE2EDuration="1.654079198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:11:25.652364235 +0000 UTC m=+2237.369770718" watchObservedRunningTime="2026-07-27 22:11:25.654079198 +0000 UTC m=+2237.371485681"
Jul 27 22:11:26.643378 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:26.643341    2554 generic.go:356] "Generic (PLEG): container finished" podID="9a6b3719-6fc5-4182-9308-aaf3810c2980" containerID="d9b60a85f51715b2e2c2e8aa6e395aaaf4f4153f98c72a804bfed3faab31aeba" exitCode=0
Jul 27 22:11:26.643802 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:26.643450    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk" event={"ID":"9a6b3719-6fc5-4182-9308-aaf3810c2980","Type":"ContainerDied","Data":"d9b60a85f51715b2e2c2e8aa6e395aaaf4f4153f98c72a804bfed3faab31aeba"}
Jul 27 22:11:27.793122 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:27.793096    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"
Jul 27 22:11:27.890766 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:27.890735    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a6b3719-6fc5-4182-9308-aaf3810c2980-maas-api-service-ca\") pod \"9a6b3719-6fc5-4182-9308-aaf3810c2980\" (UID: \"9a6b3719-6fc5-4182-9308-aaf3810c2980\") "
Jul 27 22:11:27.891142 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:27.891114    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a6b3719-6fc5-4182-9308-aaf3810c2980-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9a6b3719-6fc5-4182-9308-aaf3810c2980" (UID: "9a6b3719-6fc5-4182-9308-aaf3810c2980"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:11:27.991775 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:27.991744    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a6b3719-6fc5-4182-9308-aaf3810c2980-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:11:28.654381 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:28.654352    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"
Jul 27 22:11:28.654381 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:28.654363    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk" event={"ID":"9a6b3719-6fc5-4182-9308-aaf3810c2980","Type":"ContainerDied","Data":"49f6fd2526a1e14f2c65f9c8bacb8093fa844ef6239fd01ff680a31a985f50f2"}
Jul 27 22:11:28.654627 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:28.654409    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49f6fd2526a1e14f2c65f9c8bacb8093fa844ef6239fd01ff680a31a985f50f2"
Jul 27 22:11:35.172756 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.172714    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"]
Jul 27 22:11:35.173220 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.173011    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8" podUID="1128a783-03bc-4c69-ad72-2ee5bbb9ab99" containerName="payload-processing" containerID="cri-o://2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de" gracePeriod=30
Jul 27 22:11:35.188599 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.188556    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"]
Jul 27 22:11:35.189005 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.188945    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc" podUID="2dd8819a-0818-49d9-ba69-b65d5a74c1e7" containerName="payload-pre-processing" containerID="cri-o://f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0" gracePeriod=30
Jul 27 22:11:35.324595 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.324558    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"]
Jul 27 22:11:35.328934 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.328901    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-462b96-6s6fk"]
Jul 27 22:11:35.452610 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.452579    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:11:35.477185 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.477154    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:11:35.564844 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.564802    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kfk4\" (UniqueName: \"kubernetes.io/projected/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-kube-api-access-9kfk4\") pod \"1128a783-03bc-4c69-ad72-2ee5bbb9ab99\" (UID: \"1128a783-03bc-4c69-ad72-2ee5bbb9ab99\") "
Jul 27 22:11:35.564844 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.564849    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch9ts\" (UniqueName: \"kubernetes.io/projected/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-kube-api-access-ch9ts\") pod \"2dd8819a-0818-49d9-ba69-b65d5a74c1e7\" (UID: \"2dd8819a-0818-49d9-ba69-b65d5a74c1e7\") "
Jul 27 22:11:35.565047 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.564915    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-plugins-config-volume\") pod \"2dd8819a-0818-49d9-ba69-b65d5a74c1e7\" (UID: \"2dd8819a-0818-49d9-ba69-b65d5a74c1e7\") "
Jul 27 22:11:35.565130 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.565099    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-plugins-config-volume\") pod \"1128a783-03bc-4c69-ad72-2ee5bbb9ab99\" (UID: \"1128a783-03bc-4c69-ad72-2ee5bbb9ab99\") "
Jul 27 22:11:35.565492 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.565425    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2dd8819a-0818-49d9-ba69-b65d5a74c1e7" (UID: "2dd8819a-0818-49d9-ba69-b65d5a74c1e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:11:35.565672 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.565515    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1128a783-03bc-4c69-ad72-2ee5bbb9ab99" (UID: "1128a783-03bc-4c69-ad72-2ee5bbb9ab99"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:11:35.567312 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.567287    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-kube-api-access-ch9ts" (OuterVolumeSpecName: "kube-api-access-ch9ts") pod "2dd8819a-0818-49d9-ba69-b65d5a74c1e7" (UID: "2dd8819a-0818-49d9-ba69-b65d5a74c1e7"). InnerVolumeSpecName "kube-api-access-ch9ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:11:35.567402 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.567332    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-kube-api-access-9kfk4" (OuterVolumeSpecName: "kube-api-access-9kfk4") pod "1128a783-03bc-4c69-ad72-2ee5bbb9ab99" (UID: "1128a783-03bc-4c69-ad72-2ee5bbb9ab99"). InnerVolumeSpecName "kube-api-access-9kfk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:11:35.666383 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.666315    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:11:35.666383 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.666363    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kfk4\" (UniqueName: \"kubernetes.io/projected/1128a783-03bc-4c69-ad72-2ee5bbb9ab99-kube-api-access-9kfk4\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:11:35.666383 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.666373    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch9ts\" (UniqueName: \"kubernetes.io/projected/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-kube-api-access-ch9ts\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:11:35.666383 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.666382    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dd8819a-0818-49d9-ba69-b65d5a74c1e7-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:11:35.694374 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.694270    2554 generic.go:356] "Generic (PLEG): container finished" podID="1128a783-03bc-4c69-ad72-2ee5bbb9ab99" containerID="2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de" exitCode=0
Jul 27 22:11:35.694374 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.694341    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"
Jul 27 22:11:35.694623 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.694366    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8" event={"ID":"1128a783-03bc-4c69-ad72-2ee5bbb9ab99","Type":"ContainerDied","Data":"2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de"}
Jul 27 22:11:35.694623 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.694472    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8" event={"ID":"1128a783-03bc-4c69-ad72-2ee5bbb9ab99","Type":"ContainerDied","Data":"6593baa3694b01338da53fb80729e6931e07899c27ff7993f21d4b7f265a84f3"}
Jul 27 22:11:35.694623 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.694502    2554 scope.go:117] "RemoveContainer" containerID="2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de"
Jul 27 22:11:35.695837 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.695810    2554 generic.go:356] "Generic (PLEG): container finished" podID="2dd8819a-0818-49d9-ba69-b65d5a74c1e7" containerID="f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0" exitCode=0
Jul 27 22:11:35.695946 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.695862    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"
Jul 27 22:11:35.695946 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.695914    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc" event={"ID":"2dd8819a-0818-49d9-ba69-b65d5a74c1e7","Type":"ContainerDied","Data":"f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0"}
Jul 27 22:11:35.696109 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.695952    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc" event={"ID":"2dd8819a-0818-49d9-ba69-b65d5a74c1e7","Type":"ContainerDied","Data":"58cc97ac216669ce3f417dfcb0824cf77cc1bc56488ba6519a758eb364e1fa7f"}
Jul 27 22:11:35.705412 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.705394    2554 scope.go:117] "RemoveContainer" containerID="2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de"
Jul 27 22:11:35.705792 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:11:35.705771    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de\": container with ID starting with 2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de not found: ID does not exist" containerID="2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de"
Jul 27 22:11:35.705881 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.705802    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de"} err="failed to get container status \"2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de\": rpc error: code = NotFound desc = could not find container \"2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de\": container with ID starting with 2466bdfea7101e0161129d8e9febdc760a0645d095eb59ade0c2ef48e1c637de not found: ID does not exist"
Jul 27 22:11:35.705881 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.705826    2554 scope.go:117] "RemoveContainer" containerID="f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0"
Jul 27 22:11:35.714907 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.714889    2554 scope.go:117] "RemoveContainer" containerID="f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0"
Jul 27 22:11:35.715205 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:11:35.715188    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0\": container with ID starting with f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0 not found: ID does not exist" containerID="f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0"
Jul 27 22:11:35.715251 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.715214    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0"} err="failed to get container status \"f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0\": rpc error: code = NotFound desc = could not find container \"f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0\": container with ID starting with f5956a903b79a92db4a8ebbd5c4a9672dae71a7f3af9f40a19edc7ad98754ac0 not found: ID does not exist"
Jul 27 22:11:35.737076 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.737045    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"]
Jul 27 22:11:35.749771 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.749738    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-462b96-f6fc649c6-4cqzc"]
Jul 27 22:11:35.780953 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.780913    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"]
Jul 27 22:11:35.790960 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:35.790927    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-462b96-85bd696d5b-4q9h8"]
Jul 27 22:11:36.921520 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:36.921476    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1128a783-03bc-4c69-ad72-2ee5bbb9ab99" path="/var/lib/kubelet/pods/1128a783-03bc-4c69-ad72-2ee5bbb9ab99/volumes"
Jul 27 22:11:36.922008 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:36.921992    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dd8819a-0818-49d9-ba69-b65d5a74c1e7" path="/var/lib/kubelet/pods/2dd8819a-0818-49d9-ba69-b65d5a74c1e7/volumes"
Jul 27 22:11:36.922344 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:36.922323    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a6b3719-6fc5-4182-9308-aaf3810c2980" path="/var/lib/kubelet/pods/9a6b3719-6fc5-4182-9308-aaf3810c2980/volumes"
Jul 27 22:11:42.035486 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.035453    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"]
Jul 27 22:11:42.035858 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.035852    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd8819a-0818-49d9-ba69-b65d5a74c1e7" containerName="payload-pre-processing"
Jul 27 22:11:42.035900 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.035862    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd8819a-0818-49d9-ba69-b65d5a74c1e7" containerName="payload-pre-processing"
Jul 27 22:11:42.035900 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.035872    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1128a783-03bc-4c69-ad72-2ee5bbb9ab99" containerName="payload-processing"
Jul 27 22:11:42.035900 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.035877    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1128a783-03bc-4c69-ad72-2ee5bbb9ab99" containerName="payload-processing"
Jul 27 22:11:42.035900 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.035886    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6b3719-6fc5-4182-9308-aaf3810c2980" containerName="revoke-keys"
Jul 27 22:11:42.035900 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.035891    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6b3719-6fc5-4182-9308-aaf3810c2980" containerName="revoke-keys"
Jul 27 22:11:42.036068 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.035950    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd8819a-0818-49d9-ba69-b65d5a74c1e7" containerName="payload-pre-processing"
Jul 27 22:11:42.036068 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.035958    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a6b3719-6fc5-4182-9308-aaf3810c2980" containerName="revoke-keys"
Jul 27 22:11:42.036068 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.035965    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1128a783-03bc-4c69-ad72-2ee5bbb9ab99" containerName="payload-processing"
Jul 27 22:11:42.038811 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.038797    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"
Jul 27 22:11:42.041342 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.041314    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:11:42.041563 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.041546    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:11:42.046390 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.046362    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"]
Jul 27 22:11:42.132543 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.132503    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/499edc89-5d54-48f8-89d2-c48e6fc435e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8\" (UID: \"499edc89-5d54-48f8-89d2-c48e6fc435e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"
Jul 27 22:11:42.233989 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.233954    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/499edc89-5d54-48f8-89d2-c48e6fc435e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8\" (UID: \"499edc89-5d54-48f8-89d2-c48e6fc435e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"
Jul 27 22:11:42.234872 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.234846    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/499edc89-5d54-48f8-89d2-c48e6fc435e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8\" (UID: \"499edc89-5d54-48f8-89d2-c48e6fc435e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"
Jul 27 22:11:42.351541 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.351457    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"
Jul 27 22:11:42.494016 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.493987    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"]
Jul 27 22:11:42.496184 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:11:42.496156    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499edc89_5d54_48f8_89d2_c48e6fc435e6.slice/crio-21377b207b4f8faec6ecb14d218d3f168d0913a7051b65581ff88c198dc299e1 WatchSource:0}: Error finding container 21377b207b4f8faec6ecb14d218d3f168d0913a7051b65581ff88c198dc299e1: Status 404 returned error can't find the container with id 21377b207b4f8faec6ecb14d218d3f168d0913a7051b65581ff88c198dc299e1
Jul 27 22:11:42.738247 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:42.738212    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8" event={"ID":"499edc89-5d54-48f8-89d2-c48e6fc435e6","Type":"ContainerStarted","Data":"21377b207b4f8faec6ecb14d218d3f168d0913a7051b65581ff88c198dc299e1"}
Jul 27 22:11:43.744857 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:43.744824    2554 generic.go:356] "Generic (PLEG): container finished" podID="499edc89-5d54-48f8-89d2-c48e6fc435e6" containerID="21b245312a9c80742c811480f6ca88af8db7c92f57370754e3596acd8748d96f" exitCode=0
Jul 27 22:11:43.745239 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:43.744870    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8" event={"ID":"499edc89-5d54-48f8-89d2-c48e6fc435e6","Type":"ContainerDied","Data":"21b245312a9c80742c811480f6ca88af8db7c92f57370754e3596acd8748d96f"}
Jul 27 22:11:44.886894 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:44.886865    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"
Jul 27 22:11:44.960164 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:44.960133    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/499edc89-5d54-48f8-89d2-c48e6fc435e6-maas-api-service-ca\") pod \"499edc89-5d54-48f8-89d2-c48e6fc435e6\" (UID: \"499edc89-5d54-48f8-89d2-c48e6fc435e6\") "
Jul 27 22:11:44.960495 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:44.960473    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/499edc89-5d54-48f8-89d2-c48e6fc435e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "499edc89-5d54-48f8-89d2-c48e6fc435e6" (UID: "499edc89-5d54-48f8-89d2-c48e6fc435e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:11:45.060844 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:45.060757    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/499edc89-5d54-48f8-89d2-c48e6fc435e6-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:11:45.755624 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:45.755596    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"
Jul 27 22:11:45.755624 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:45.755597    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8" event={"ID":"499edc89-5d54-48f8-89d2-c48e6fc435e6","Type":"ContainerDied","Data":"21377b207b4f8faec6ecb14d218d3f168d0913a7051b65581ff88c198dc299e1"}
Jul 27 22:11:45.755832 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:45.755664    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21377b207b4f8faec6ecb14d218d3f168d0913a7051b65581ff88c198dc299e1"
Jul 27 22:11:52.481315 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.481278    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"]
Jul 27 22:11:52.481831 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.481590    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g" podUID="cbc5c773-8d12-4e5c-9429-f8f694809455" containerName="payload-processing" containerID="cri-o://526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb" gracePeriod=30
Jul 27 22:11:52.489205 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.489175    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"]
Jul 27 22:11:52.489740 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.489690    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz" podUID="49f41e5c-631e-4759-8589-15ecedbc4c87" containerName="payload-pre-processing" containerID="cri-o://aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966" gracePeriod=30
Jul 27 22:11:52.619160 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.619126    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"]
Jul 27 22:11:52.623465 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.623412    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d28642-x4dj8"]
Jul 27 22:11:52.772362 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.772277    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:11:52.788499 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.788476    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:11:52.791261 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.791228    2554 generic.go:356] "Generic (PLEG): container finished" podID="49f41e5c-631e-4759-8589-15ecedbc4c87" containerID="aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966" exitCode=0
Jul 27 22:11:52.791417 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.791270    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"
Jul 27 22:11:52.791417 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.791381    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz" event={"ID":"49f41e5c-631e-4759-8589-15ecedbc4c87","Type":"ContainerDied","Data":"aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966"}
Jul 27 22:11:52.791574 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.791425    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz" event={"ID":"49f41e5c-631e-4759-8589-15ecedbc4c87","Type":"ContainerDied","Data":"e72599058f47758beb60659bc20c967f48999bc4ee767465196b6c0d99d3be7b"}
Jul 27 22:11:52.791574 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.791489    2554 scope.go:117] "RemoveContainer" containerID="aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966"
Jul 27 22:11:52.793497 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.793461    2554 generic.go:356] "Generic (PLEG): container finished" podID="cbc5c773-8d12-4e5c-9429-f8f694809455" containerID="526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb" exitCode=0
Jul 27 22:11:52.793617 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.793578    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g" event={"ID":"cbc5c773-8d12-4e5c-9429-f8f694809455","Type":"ContainerDied","Data":"526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb"}
Jul 27 22:11:52.793677 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.793626    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g" event={"ID":"cbc5c773-8d12-4e5c-9429-f8f694809455","Type":"ContainerDied","Data":"0736124659c22cbf266fe569dc03b3917fb9a5406a49a735bd5e2b04cf4fcf1a"}
Jul 27 22:11:52.793677 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.793579    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"
Jul 27 22:11:52.801456 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.801407    2554 scope.go:117] "RemoveContainer" containerID="aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966"
Jul 27 22:11:52.801761 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:11:52.801736    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966\": container with ID starting with aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966 not found: ID does not exist" containerID="aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966"
Jul 27 22:11:52.801840 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.801772    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966"} err="failed to get container status \"aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966\": rpc error: code = NotFound desc = could not find container \"aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966\": container with ID starting with aed21188a97887bafb377f42f49c85208853a24ad1a3eb49d9f61b26cd20b966 not found: ID does not exist"
Jul 27 22:11:52.801840 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.801790    2554 scope.go:117] "RemoveContainer" containerID="526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb"
Jul 27 22:11:52.811529 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.811504    2554 scope.go:117] "RemoveContainer" containerID="526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb"
Jul 27 22:11:52.811903 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:11:52.811867    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb\": container with ID starting with 526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb not found: ID does not exist" containerID="526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb"
Jul 27 22:11:52.812023 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.811902    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb"} err="failed to get container status \"526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb\": rpc error: code = NotFound desc = could not find container \"526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb\": container with ID starting with 526e93bc964e18cc66cc5d416e4a860e406196e73586e07a5cdfd9e0fc1641bb not found: ID does not exist"
Jul 27 22:11:52.921543 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.921509    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="499edc89-5d54-48f8-89d2-c48e6fc435e6" path="/var/lib/kubelet/pods/499edc89-5d54-48f8-89d2-c48e6fc435e6/volumes"
Jul 27 22:11:52.942169 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.942124    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbc5c773-8d12-4e5c-9429-f8f694809455-plugins-config-volume\") pod \"cbc5c773-8d12-4e5c-9429-f8f694809455\" (UID: \"cbc5c773-8d12-4e5c-9429-f8f694809455\") "
Jul 27 22:11:52.942361 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.942200    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb6cb\" (UniqueName: \"kubernetes.io/projected/49f41e5c-631e-4759-8589-15ecedbc4c87-kube-api-access-pb6cb\") pod \"49f41e5c-631e-4759-8589-15ecedbc4c87\" (UID: \"49f41e5c-631e-4759-8589-15ecedbc4c87\") "
Jul 27 22:11:52.942361 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.942236    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr6ft\" (UniqueName: \"kubernetes.io/projected/cbc5c773-8d12-4e5c-9429-f8f694809455-kube-api-access-kr6ft\") pod \"cbc5c773-8d12-4e5c-9429-f8f694809455\" (UID: \"cbc5c773-8d12-4e5c-9429-f8f694809455\") "
Jul 27 22:11:52.942361 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.942270    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49f41e5c-631e-4759-8589-15ecedbc4c87-plugins-config-volume\") pod \"49f41e5c-631e-4759-8589-15ecedbc4c87\" (UID: \"49f41e5c-631e-4759-8589-15ecedbc4c87\") "
Jul 27 22:11:52.942717 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.942688    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbc5c773-8d12-4e5c-9429-f8f694809455-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cbc5c773-8d12-4e5c-9429-f8f694809455" (UID: "cbc5c773-8d12-4e5c-9429-f8f694809455"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:11:52.942717 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.942697    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49f41e5c-631e-4759-8589-15ecedbc4c87-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49f41e5c-631e-4759-8589-15ecedbc4c87" (UID: "49f41e5c-631e-4759-8589-15ecedbc4c87"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:11:52.944449 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.944415    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc5c773-8d12-4e5c-9429-f8f694809455-kube-api-access-kr6ft" (OuterVolumeSpecName: "kube-api-access-kr6ft") pod "cbc5c773-8d12-4e5c-9429-f8f694809455" (UID: "cbc5c773-8d12-4e5c-9429-f8f694809455"). InnerVolumeSpecName "kube-api-access-kr6ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:11:52.944596 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:52.944574    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49f41e5c-631e-4759-8589-15ecedbc4c87-kube-api-access-pb6cb" (OuterVolumeSpecName: "kube-api-access-pb6cb") pod "49f41e5c-631e-4759-8589-15ecedbc4c87" (UID: "49f41e5c-631e-4759-8589-15ecedbc4c87"). InnerVolumeSpecName "kube-api-access-pb6cb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:11:53.043261 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:53.043176    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbc5c773-8d12-4e5c-9429-f8f694809455-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:11:53.043261 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:53.043213    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb6cb\" (UniqueName: \"kubernetes.io/projected/49f41e5c-631e-4759-8589-15ecedbc4c87-kube-api-access-pb6cb\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:11:53.043261 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:53.043224    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr6ft\" (UniqueName: \"kubernetes.io/projected/cbc5c773-8d12-4e5c-9429-f8f694809455-kube-api-access-kr6ft\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:11:53.043261 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:53.043233    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49f41e5c-631e-4759-8589-15ecedbc4c87-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:11:53.115415 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:53.115379    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"]
Jul 27 22:11:53.121415 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:53.121383    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d28642-9dcfd7c84-62zgz"]
Jul 27 22:11:53.135738 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:53.135703    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"]
Jul 27 22:11:53.138629 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:53.138602    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d28642-5b9d94cf6d-7kg2g"]
Jul 27 22:11:54.921989 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:54.921956    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49f41e5c-631e-4759-8589-15ecedbc4c87" path="/var/lib/kubelet/pods/49f41e5c-631e-4759-8589-15ecedbc4c87/volumes"
Jul 27 22:11:54.922344 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:11:54.922298    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc5c773-8d12-4e5c-9429-f8f694809455" path="/var/lib/kubelet/pods/cbc5c773-8d12-4e5c-9429-f8f694809455/volumes"
Jul 27 22:12:04.188376 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.188341    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"]
Jul 27 22:12:04.188875 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.188798    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49f41e5c-631e-4759-8589-15ecedbc4c87" containerName="payload-pre-processing"
Jul 27 22:12:04.188875 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.188810    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="49f41e5c-631e-4759-8589-15ecedbc4c87" containerName="payload-pre-processing"
Jul 27 22:12:04.188875 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.188832    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="499edc89-5d54-48f8-89d2-c48e6fc435e6" containerName="revoke-keys"
Jul 27 22:12:04.188875 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.188837    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="499edc89-5d54-48f8-89d2-c48e6fc435e6" containerName="revoke-keys"
Jul 27 22:12:04.188875 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.188848    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc5c773-8d12-4e5c-9429-f8f694809455" containerName="payload-processing"
Jul 27 22:12:04.188875 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.188854    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc5c773-8d12-4e5c-9429-f8f694809455" containerName="payload-processing"
Jul 27 22:12:04.189065 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.188911    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbc5c773-8d12-4e5c-9429-f8f694809455" containerName="payload-processing"
Jul 27 22:12:04.189065 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.188919    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="499edc89-5d54-48f8-89d2-c48e6fc435e6" containerName="revoke-keys"
Jul 27 22:12:04.189065 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.188929    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="49f41e5c-631e-4759-8589-15ecedbc4c87" containerName="payload-pre-processing"
Jul 27 22:12:04.193206 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.193188    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:12:04.195951 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.195928    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-2f19c4\""
Jul 27 22:12:04.196101 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.195989    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-2f19c4-dockercfg-qh49b\""
Jul 27 22:12:04.201937 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.201906    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"]
Jul 27 22:12:04.212016 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.211984    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"]
Jul 27 22:12:04.215900 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.215871    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:12:04.236000 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.235972    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"]
Jul 27 22:12:04.250158 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.250122    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a551e6d6-663e-489c-a57e-b6f8cbba60f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn\" (UID: \"a551e6d6-663e-489c-a57e-b6f8cbba60f4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:12:04.250328 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.250244    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7szt\" (UniqueName: \"kubernetes.io/projected/959f15ea-440a-4a97-9716-47c410d95e39-kube-api-access-j7szt\") pod \"payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc\" (UID: \"959f15ea-440a-4a97-9716-47c410d95e39\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:12:04.250328 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.250306    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxxfh\" (UniqueName: \"kubernetes.io/projected/a551e6d6-663e-489c-a57e-b6f8cbba60f4-kube-api-access-lxxfh\") pod \"payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn\" (UID: \"a551e6d6-663e-489c-a57e-b6f8cbba60f4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:12:04.250448 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.250350    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/959f15ea-440a-4a97-9716-47c410d95e39-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc\" (UID: \"959f15ea-440a-4a97-9716-47c410d95e39\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:12:04.351184 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.351151    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7szt\" (UniqueName: \"kubernetes.io/projected/959f15ea-440a-4a97-9716-47c410d95e39-kube-api-access-j7szt\") pod \"payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc\" (UID: \"959f15ea-440a-4a97-9716-47c410d95e39\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:12:04.351376 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.351197    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxxfh\" (UniqueName: \"kubernetes.io/projected/a551e6d6-663e-489c-a57e-b6f8cbba60f4-kube-api-access-lxxfh\") pod \"payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn\" (UID: \"a551e6d6-663e-489c-a57e-b6f8cbba60f4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:12:04.351458 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.351394    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/959f15ea-440a-4a97-9716-47c410d95e39-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc\" (UID: \"959f15ea-440a-4a97-9716-47c410d95e39\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:12:04.351539 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.351524    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a551e6d6-663e-489c-a57e-b6f8cbba60f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn\" (UID: \"a551e6d6-663e-489c-a57e-b6f8cbba60f4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:12:04.352175 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.352152    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a551e6d6-663e-489c-a57e-b6f8cbba60f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn\" (UID: \"a551e6d6-663e-489c-a57e-b6f8cbba60f4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:12:04.352301 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.352277    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/959f15ea-440a-4a97-9716-47c410d95e39-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc\" (UID: \"959f15ea-440a-4a97-9716-47c410d95e39\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:12:04.363529 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.363502    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxxfh\" (UniqueName: \"kubernetes.io/projected/a551e6d6-663e-489c-a57e-b6f8cbba60f4-kube-api-access-lxxfh\") pod \"payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn\" (UID: \"a551e6d6-663e-489c-a57e-b6f8cbba60f4\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:12:04.363652 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.363614    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7szt\" (UniqueName: \"kubernetes.io/projected/959f15ea-440a-4a97-9716-47c410d95e39-kube-api-access-j7szt\") pod \"payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc\" (UID: \"959f15ea-440a-4a97-9716-47c410d95e39\") " pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:12:04.504869 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.504829    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:12:04.531256 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.531225    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:12:04.667549 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.667520    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"]
Jul 27 22:12:04.670903 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:12:04.670877    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda551e6d6_663e_489c_a57e_b6f8cbba60f4.slice/crio-c74dc91cc0746b39c40e37283f2c9c25b73bc461bd98103c3e4db6c54fa55689 WatchSource:0}: Error finding container c74dc91cc0746b39c40e37283f2c9c25b73bc461bd98103c3e4db6c54fa55689: Status 404 returned error can't find the container with id c74dc91cc0746b39c40e37283f2c9c25b73bc461bd98103c3e4db6c54fa55689
Jul 27 22:12:04.699256 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.699232    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"]
Jul 27 22:12:04.702080 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:12:04.702053    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959f15ea_440a_4a97_9716_47c410d95e39.slice/crio-f50338de6f73950dd998a716fdc155452774c1d01a59222e407e244e6e6974b9 WatchSource:0}: Error finding container f50338de6f73950dd998a716fdc155452774c1d01a59222e407e244e6e6974b9: Status 404 returned error can't find the container with id f50338de6f73950dd998a716fdc155452774c1d01a59222e407e244e6e6974b9
Jul 27 22:12:04.861096 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.861062    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc" event={"ID":"959f15ea-440a-4a97-9716-47c410d95e39","Type":"ContainerStarted","Data":"4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e"}
Jul 27 22:12:04.861346 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.861121    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc" event={"ID":"959f15ea-440a-4a97-9716-47c410d95e39","Type":"ContainerStarted","Data":"f50338de6f73950dd998a716fdc155452774c1d01a59222e407e244e6e6974b9"}
Jul 27 22:12:04.861346 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.861150    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:12:04.862839 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.862812    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn" event={"ID":"a551e6d6-663e-489c-a57e-b6f8cbba60f4","Type":"ContainerStarted","Data":"ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6"}
Jul 27 22:12:04.862981 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.862859    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn" event={"ID":"a551e6d6-663e-489c-a57e-b6f8cbba60f4","Type":"ContainerStarted","Data":"c74dc91cc0746b39c40e37283f2c9c25b73bc461bd98103c3e4db6c54fa55689"}
Jul 27 22:12:04.862981 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.862936    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:12:04.881682 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.881589    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc" podStartSLOduration=0.881564953 podStartE2EDuration="881.564953ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:12:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:12:04.880742031 +0000 UTC m=+2276.598148511" watchObservedRunningTime="2026-07-27 22:12:04.881564953 +0000 UTC m=+2276.598971439"
Jul 27 22:12:04.896201 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:04.896149    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn" podStartSLOduration=0.896132614 podStartE2EDuration="896.132614ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:12:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:12:04.895261009 +0000 UTC m=+2276.612667492" watchObservedRunningTime="2026-07-27 22:12:04.896132614 +0000 UTC m=+2276.613539095"
Jul 27 22:12:15.870485 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:15.870416    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:12:15.870914 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:15.870573    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:12:32.665425 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.665387    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"]
Jul 27 22:12:32.669372 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.669356    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:12:32.671960 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.671941    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-5e1a2f\""
Jul 27 22:12:32.678081 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.678050    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"]
Jul 27 22:12:32.714503 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.714466    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"]
Jul 27 22:12:32.718375 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.718344    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:12:32.721137 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.721108    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-5e1a2f-dockercfg-tt2v8\""
Jul 27 22:12:32.731117 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.731083    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"]
Jul 27 22:12:32.829881 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.829840    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0298e641-0e72-4eae-b6c4-5f24954365ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp\" (UID: \"0298e641-0e72-4eae-b6c4-5f24954365ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:12:32.830044 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.829976    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xk7p\" (UniqueName: \"kubernetes.io/projected/0298e641-0e72-4eae-b6c4-5f24954365ae-kube-api-access-6xk7p\") pod \"payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp\" (UID: \"0298e641-0e72-4eae-b6c4-5f24954365ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:12:32.830091 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.830038    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac5713d4-067d-4570-9474-971d5de73cce-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc\" (UID: \"ac5713d4-067d-4570-9474-971d5de73cce\") " pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:12:32.830161 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.830098    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhqvt\" (UniqueName: \"kubernetes.io/projected/ac5713d4-067d-4570-9474-971d5de73cce-kube-api-access-xhqvt\") pod \"payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc\" (UID: \"ac5713d4-067d-4570-9474-971d5de73cce\") " pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:12:32.931116 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.931014    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0298e641-0e72-4eae-b6c4-5f24954365ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp\" (UID: \"0298e641-0e72-4eae-b6c4-5f24954365ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:12:32.931116 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.931108    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xk7p\" (UniqueName: \"kubernetes.io/projected/0298e641-0e72-4eae-b6c4-5f24954365ae-kube-api-access-6xk7p\") pod \"payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp\" (UID: \"0298e641-0e72-4eae-b6c4-5f24954365ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:12:32.931358 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.931168    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac5713d4-067d-4570-9474-971d5de73cce-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc\" (UID: \"ac5713d4-067d-4570-9474-971d5de73cce\") " pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:12:32.931358 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.931229    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhqvt\" (UniqueName: \"kubernetes.io/projected/ac5713d4-067d-4570-9474-971d5de73cce-kube-api-access-xhqvt\") pod \"payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc\" (UID: \"ac5713d4-067d-4570-9474-971d5de73cce\") " pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:12:32.932026 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.932002    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0298e641-0e72-4eae-b6c4-5f24954365ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp\" (UID: \"0298e641-0e72-4eae-b6c4-5f24954365ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:12:32.932413 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.932393    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac5713d4-067d-4570-9474-971d5de73cce-plugins-config-volume\") pod \"payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc\" (UID: \"ac5713d4-067d-4570-9474-971d5de73cce\") " pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:12:32.940046 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.940007    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhqvt\" (UniqueName: \"kubernetes.io/projected/ac5713d4-067d-4570-9474-971d5de73cce-kube-api-access-xhqvt\") pod \"payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc\" (UID: \"ac5713d4-067d-4570-9474-971d5de73cce\") " pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:12:32.940175 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.940049    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xk7p\" (UniqueName: \"kubernetes.io/projected/0298e641-0e72-4eae-b6c4-5f24954365ae-kube-api-access-6xk7p\") pod \"payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp\" (UID: \"0298e641-0e72-4eae-b6c4-5f24954365ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:12:32.983688 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:32.983635    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:12:33.029794 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:33.029750    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:12:33.189499 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:33.189469    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"]
Jul 27 22:12:33.192054 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:12:33.192028    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0298e641_0e72_4eae_b6c4_5f24954365ae.slice/crio-1ca679e638a5ebbf6be1a98b0d55d8d405e9e4c6f5c4cfc1f32e5c088379089d WatchSource:0}: Error finding container 1ca679e638a5ebbf6be1a98b0d55d8d405e9e4c6f5c4cfc1f32e5c088379089d: Status 404 returned error can't find the container with id 1ca679e638a5ebbf6be1a98b0d55d8d405e9e4c6f5c4cfc1f32e5c088379089d
Jul 27 22:12:33.220619 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:33.220593    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"]
Jul 27 22:12:33.234802 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:12:33.234763    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5713d4_067d_4570_9474_971d5de73cce.slice/crio-51d3bee70423acf2daa7be797d64782d8eb331821737724814c605957db0308d WatchSource:0}: Error finding container 51d3bee70423acf2daa7be797d64782d8eb331821737724814c605957db0308d: Status 404 returned error can't find the container with id 51d3bee70423acf2daa7be797d64782d8eb331821737724814c605957db0308d
Jul 27 22:12:34.020786 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:34.020731    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp" event={"ID":"0298e641-0e72-4eae-b6c4-5f24954365ae","Type":"ContainerStarted","Data":"5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1"}
Jul 27 22:12:34.021245 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:34.020801    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:12:34.021245 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:34.020827    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp" event={"ID":"0298e641-0e72-4eae-b6c4-5f24954365ae","Type":"ContainerStarted","Data":"1ca679e638a5ebbf6be1a98b0d55d8d405e9e4c6f5c4cfc1f32e5c088379089d"}
Jul 27 22:12:34.022252 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:34.022228    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc" event={"ID":"ac5713d4-067d-4570-9474-971d5de73cce","Type":"ContainerStarted","Data":"f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca"}
Jul 27 22:12:34.022342 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:34.022282    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:12:34.022342 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:34.022307    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc" event={"ID":"ac5713d4-067d-4570-9474-971d5de73cce","Type":"ContainerStarted","Data":"51d3bee70423acf2daa7be797d64782d8eb331821737724814c605957db0308d"}
Jul 27 22:12:34.039867 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:34.039642    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp" podStartSLOduration=2.039619992 podStartE2EDuration="2.039619992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:12:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:12:34.037639802 +0000 UTC m=+2305.755046288" watchObservedRunningTime="2026-07-27 22:12:34.039619992 +0000 UTC m=+2305.757026477"
Jul 27 22:12:34.058578 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:34.058515    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc" podStartSLOduration=2.058493455 podStartE2EDuration="2.058493455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:12:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:12:34.055140604 +0000 UTC m=+2305.772547086" watchObservedRunningTime="2026-07-27 22:12:34.058493455 +0000 UTC m=+2305.775899937"
Jul 27 22:12:45.031177 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:45.031145    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:12:45.031831 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:45.031213    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:12:59.923161 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:59.923075    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"]
Jul 27 22:12:59.926720 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:59.926695    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"
Jul 27 22:12:59.929374 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:59.929350    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:12:59.929543 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:59.929392    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:12:59.934203 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:59.934147    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"]
Jul 27 22:12:59.999245 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:12:59.999198    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b89b95-628e-4dfc-a829-1356e9384407-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d\" (UID: \"76b89b95-628e-4dfc-a829-1356e9384407\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"
Jul 27 22:13:00.100494 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:00.100416    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b89b95-628e-4dfc-a829-1356e9384407-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d\" (UID: \"76b89b95-628e-4dfc-a829-1356e9384407\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"
Jul 27 22:13:00.101094 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:00.101072    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b89b95-628e-4dfc-a829-1356e9384407-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d\" (UID: \"76b89b95-628e-4dfc-a829-1356e9384407\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"
Jul 27 22:13:00.243452 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:00.243410    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"
Jul 27 22:13:00.384243 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:00.384210    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"]
Jul 27 22:13:00.387237 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:13:00.387199    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b89b95_628e_4dfc_a829_1356e9384407.slice/crio-47fb5f13f0d82efe6f4c40ff7392b4f41098974399ecce7d41bed2e4dd1f177c WatchSource:0}: Error finding container 47fb5f13f0d82efe6f4c40ff7392b4f41098974399ecce7d41bed2e4dd1f177c: Status 404 returned error can't find the container with id 47fb5f13f0d82efe6f4c40ff7392b4f41098974399ecce7d41bed2e4dd1f177c
Jul 27 22:13:01.166741 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:01.166708    2554 generic.go:356] "Generic (PLEG): container finished" podID="76b89b95-628e-4dfc-a829-1356e9384407" containerID="0c8ad9937ca9b89bc4fdf35d00797bb628cd8cca66deef06593c9a42f0a2ed72" exitCode=0
Jul 27 22:13:01.167124 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:01.166787    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d" event={"ID":"76b89b95-628e-4dfc-a829-1356e9384407","Type":"ContainerDied","Data":"0c8ad9937ca9b89bc4fdf35d00797bb628cd8cca66deef06593c9a42f0a2ed72"}
Jul 27 22:13:01.167124 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:01.166839    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d" event={"ID":"76b89b95-628e-4dfc-a829-1356e9384407","Type":"ContainerStarted","Data":"47fb5f13f0d82efe6f4c40ff7392b4f41098974399ecce7d41bed2e4dd1f177c"}
Jul 27 22:13:02.308948 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:02.308922    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"
Jul 27 22:13:02.425365 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:02.425263    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b89b95-628e-4dfc-a829-1356e9384407-maas-api-service-ca\") pod \"76b89b95-628e-4dfc-a829-1356e9384407\" (UID: \"76b89b95-628e-4dfc-a829-1356e9384407\") "
Jul 27 22:13:02.425742 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:02.425720    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76b89b95-628e-4dfc-a829-1356e9384407-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "76b89b95-628e-4dfc-a829-1356e9384407" (UID: "76b89b95-628e-4dfc-a829-1356e9384407"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:13:02.526975 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:02.526935    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b89b95-628e-4dfc-a829-1356e9384407-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:13:03.179218 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:03.179190    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"
Jul 27 22:13:03.179218 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:03.179195    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d" event={"ID":"76b89b95-628e-4dfc-a829-1356e9384407","Type":"ContainerDied","Data":"47fb5f13f0d82efe6f4c40ff7392b4f41098974399ecce7d41bed2e4dd1f177c"}
Jul 27 22:13:03.179423 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:03.179277    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47fb5f13f0d82efe6f4c40ff7392b4f41098974399ecce7d41bed2e4dd1f177c"
Jul 27 22:13:09.152820 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:09.152786    2554 scope.go:117] "RemoveContainer" containerID="277605d69cf4e49b547301b449b848ce38fd84009ea87b0673848cf93f5be664"
Jul 27 22:13:15.441891 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.441853    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"]
Jul 27 22:13:15.442349 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.442116    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc" podUID="959f15ea-440a-4a97-9716-47c410d95e39" containerName="payload-processing" containerID="cri-o://4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e" gracePeriod=30
Jul 27 22:13:15.447349 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.447318    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"]
Jul 27 22:13:15.447740 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.447699    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn" podUID="a551e6d6-663e-489c-a57e-b6f8cbba60f4" containerName="payload-pre-processing" containerID="cri-o://ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6" gracePeriod=30
Jul 27 22:13:15.635108 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.635073    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"]
Jul 27 22:13:15.643011 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.642981    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2f19c4-qst9d"]
Jul 27 22:13:15.730376 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.730351    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:13:15.734008 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.733987    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:13:15.862689 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.862650    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxxfh\" (UniqueName: \"kubernetes.io/projected/a551e6d6-663e-489c-a57e-b6f8cbba60f4-kube-api-access-lxxfh\") pod \"a551e6d6-663e-489c-a57e-b6f8cbba60f4\" (UID: \"a551e6d6-663e-489c-a57e-b6f8cbba60f4\") "
Jul 27 22:13:15.862956 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.862705    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7szt\" (UniqueName: \"kubernetes.io/projected/959f15ea-440a-4a97-9716-47c410d95e39-kube-api-access-j7szt\") pod \"959f15ea-440a-4a97-9716-47c410d95e39\" (UID: \"959f15ea-440a-4a97-9716-47c410d95e39\") "
Jul 27 22:13:15.862956 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.862845    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/959f15ea-440a-4a97-9716-47c410d95e39-plugins-config-volume\") pod \"959f15ea-440a-4a97-9716-47c410d95e39\" (UID: \"959f15ea-440a-4a97-9716-47c410d95e39\") "
Jul 27 22:13:15.862956 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.862892    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a551e6d6-663e-489c-a57e-b6f8cbba60f4-plugins-config-volume\") pod \"a551e6d6-663e-489c-a57e-b6f8cbba60f4\" (UID: \"a551e6d6-663e-489c-a57e-b6f8cbba60f4\") "
Jul 27 22:13:15.863229 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.863198    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/959f15ea-440a-4a97-9716-47c410d95e39-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "959f15ea-440a-4a97-9716-47c410d95e39" (UID: "959f15ea-440a-4a97-9716-47c410d95e39"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:13:15.863349 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.863241    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a551e6d6-663e-489c-a57e-b6f8cbba60f4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a551e6d6-663e-489c-a57e-b6f8cbba60f4" (UID: "a551e6d6-663e-489c-a57e-b6f8cbba60f4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:13:15.863349 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.863292    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/959f15ea-440a-4a97-9716-47c410d95e39-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:13:15.864897 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.864875    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a551e6d6-663e-489c-a57e-b6f8cbba60f4-kube-api-access-lxxfh" (OuterVolumeSpecName: "kube-api-access-lxxfh") pod "a551e6d6-663e-489c-a57e-b6f8cbba60f4" (UID: "a551e6d6-663e-489c-a57e-b6f8cbba60f4"). InnerVolumeSpecName "kube-api-access-lxxfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:13:15.864988 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.864968    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/959f15ea-440a-4a97-9716-47c410d95e39-kube-api-access-j7szt" (OuterVolumeSpecName: "kube-api-access-j7szt") pod "959f15ea-440a-4a97-9716-47c410d95e39" (UID: "959f15ea-440a-4a97-9716-47c410d95e39"). InnerVolumeSpecName "kube-api-access-j7szt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:13:15.964551 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.964520    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a551e6d6-663e-489c-a57e-b6f8cbba60f4-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:13:15.964551 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.964549    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxxfh\" (UniqueName: \"kubernetes.io/projected/a551e6d6-663e-489c-a57e-b6f8cbba60f4-kube-api-access-lxxfh\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:13:15.964746 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:15.964558    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7szt\" (UniqueName: \"kubernetes.io/projected/959f15ea-440a-4a97-9716-47c410d95e39-kube-api-access-j7szt\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:13:16.248841 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.248753    2554 generic.go:356] "Generic (PLEG): container finished" podID="959f15ea-440a-4a97-9716-47c410d95e39" containerID="4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e" exitCode=0
Jul 27 22:13:16.248841 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.248802    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"
Jul 27 22:13:16.248841 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.248834    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc" event={"ID":"959f15ea-440a-4a97-9716-47c410d95e39","Type":"ContainerDied","Data":"4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e"}
Jul 27 22:13:16.249107 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.248888    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc" event={"ID":"959f15ea-440a-4a97-9716-47c410d95e39","Type":"ContainerDied","Data":"f50338de6f73950dd998a716fdc155452774c1d01a59222e407e244e6e6974b9"}
Jul 27 22:13:16.249107 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.248912    2554 scope.go:117] "RemoveContainer" containerID="4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e"
Jul 27 22:13:16.250194 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.250172    2554 generic.go:356] "Generic (PLEG): container finished" podID="a551e6d6-663e-489c-a57e-b6f8cbba60f4" containerID="ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6" exitCode=0
Jul 27 22:13:16.250282 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.250198    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn" event={"ID":"a551e6d6-663e-489c-a57e-b6f8cbba60f4","Type":"ContainerDied","Data":"ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6"}
Jul 27 22:13:16.250282 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.250225    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"
Jul 27 22:13:16.250282 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.250254    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn" event={"ID":"a551e6d6-663e-489c-a57e-b6f8cbba60f4","Type":"ContainerDied","Data":"c74dc91cc0746b39c40e37283f2c9c25b73bc461bd98103c3e4db6c54fa55689"}
Jul 27 22:13:16.261258 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.261222    2554 scope.go:117] "RemoveContainer" containerID="4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e"
Jul 27 22:13:16.262346 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:13:16.262139    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e\": container with ID starting with 4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e not found: ID does not exist" containerID="4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e"
Jul 27 22:13:16.262346 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.262175    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e"} err="failed to get container status \"4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e\": rpc error: code = NotFound desc = could not find container \"4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e\": container with ID starting with 4f7cbdfb06613d455ab2eda440e892c929d278ba15ec4fd47a0f47b50fc1d61e not found: ID does not exist"
Jul 27 22:13:16.262346 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.262199    2554 scope.go:117] "RemoveContainer" containerID="ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6"
Jul 27 22:13:16.271542 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.271525    2554 scope.go:117] "RemoveContainer" containerID="ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6"
Jul 27 22:13:16.271843 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:13:16.271821    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6\": container with ID starting with ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6 not found: ID does not exist" containerID="ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6"
Jul 27 22:13:16.271909 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.271853    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6"} err="failed to get container status \"ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6\": rpc error: code = NotFound desc = could not find container \"ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6\": container with ID starting with ed27b8bfbf76acebc6e32618c8f97cd5d5fc0f754cd311684dc70f92629e78b6 not found: ID does not exist"
Jul 27 22:13:16.279792 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.279763    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"]
Jul 27 22:13:16.284148 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.284115    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2f19c4-cf5d5d4b4-gb5tn"]
Jul 27 22:13:16.308208 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.308171    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"]
Jul 27 22:13:16.317552 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.317519    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2f19c4-7b588bcd94-tnpjc"]
Jul 27 22:13:16.921338 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.921305    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76b89b95-628e-4dfc-a829-1356e9384407" path="/var/lib/kubelet/pods/76b89b95-628e-4dfc-a829-1356e9384407/volumes"
Jul 27 22:13:16.921733 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.921704    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="959f15ea-440a-4a97-9716-47c410d95e39" path="/var/lib/kubelet/pods/959f15ea-440a-4a97-9716-47c410d95e39/volumes"
Jul 27 22:13:16.922036 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:16.922024    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a551e6d6-663e-489c-a57e-b6f8cbba60f4" path="/var/lib/kubelet/pods/a551e6d6-663e-489c-a57e-b6f8cbba60f4/volumes"
Jul 27 22:13:22.587555 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.587522    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"]
Jul 27 22:13:22.587983 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.587967    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76b89b95-628e-4dfc-a829-1356e9384407" containerName="revoke-keys"
Jul 27 22:13:22.587983 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.587984    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="76b89b95-628e-4dfc-a829-1356e9384407" containerName="revoke-keys"
Jul 27 22:13:22.588070 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.588001    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a551e6d6-663e-489c-a57e-b6f8cbba60f4" containerName="payload-pre-processing"
Jul 27 22:13:22.588070 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.588007    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a551e6d6-663e-489c-a57e-b6f8cbba60f4" containerName="payload-pre-processing"
Jul 27 22:13:22.588070 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.588014    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="959f15ea-440a-4a97-9716-47c410d95e39" containerName="payload-processing"
Jul 27 22:13:22.588070 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.588020    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="959f15ea-440a-4a97-9716-47c410d95e39" containerName="payload-processing"
Jul 27 22:13:22.588201 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.588094    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="76b89b95-628e-4dfc-a829-1356e9384407" containerName="revoke-keys"
Jul 27 22:13:22.588201 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.588102    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a551e6d6-663e-489c-a57e-b6f8cbba60f4" containerName="payload-pre-processing"
Jul 27 22:13:22.588201 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.588109    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="959f15ea-440a-4a97-9716-47c410d95e39" containerName="payload-processing"
Jul 27 22:13:22.592594 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.592571    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"
Jul 27 22:13:22.601008 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.600988    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:13:22.607921 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.607894    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:13:22.610220 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.610192    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"]
Jul 27 22:13:22.629224 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.629193    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/949ad971-add5-4539-a08c-71fcb7e09c5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2\" (UID: \"949ad971-add5-4539-a08c-71fcb7e09c5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"
Jul 27 22:13:22.730895 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.730848    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/949ad971-add5-4539-a08c-71fcb7e09c5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2\" (UID: \"949ad971-add5-4539-a08c-71fcb7e09c5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"
Jul 27 22:13:22.731501 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.731482    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/949ad971-add5-4539-a08c-71fcb7e09c5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2\" (UID: \"949ad971-add5-4539-a08c-71fcb7e09c5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"
Jul 27 22:13:22.902739 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:22.902650    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"
Jul 27 22:13:23.050079 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:23.050048    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"]
Jul 27 22:13:23.050801 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:13:23.050780    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949ad971_add5_4539_a08c_71fcb7e09c5e.slice/crio-528a1cefb2da7e784535dc4815712d5b84c84d84de261fdf500ac305c30fd6f6 WatchSource:0}: Error finding container 528a1cefb2da7e784535dc4815712d5b84c84d84de261fdf500ac305c30fd6f6: Status 404 returned error can't find the container with id 528a1cefb2da7e784535dc4815712d5b84c84d84de261fdf500ac305c30fd6f6
Jul 27 22:13:23.294341 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:23.294305    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2" event={"ID":"949ad971-add5-4539-a08c-71fcb7e09c5e","Type":"ContainerStarted","Data":"1b4a0b1a41ca4b73011b697548d9bdda957e36beaa9bbb092b4ec9ca2e989e75"}
Jul 27 22:13:23.294519 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:23.294395    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2" event={"ID":"949ad971-add5-4539-a08c-71fcb7e09c5e","Type":"ContainerStarted","Data":"528a1cefb2da7e784535dc4815712d5b84c84d84de261fdf500ac305c30fd6f6"}
Jul 27 22:13:23.322829 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:23.322778    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2" podStartSLOduration=1.322763856 podStartE2EDuration="1.322763856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:13:23.321857167 +0000 UTC m=+2355.039263648" watchObservedRunningTime="2026-07-27 22:13:23.322763856 +0000 UTC m=+2355.040170338"
Jul 27 22:13:24.302092 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:24.302058    2554 generic.go:356] "Generic (PLEG): container finished" podID="949ad971-add5-4539-a08c-71fcb7e09c5e" containerID="1b4a0b1a41ca4b73011b697548d9bdda957e36beaa9bbb092b4ec9ca2e989e75" exitCode=0
Jul 27 22:13:24.302516 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:24.302103    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2" event={"ID":"949ad971-add5-4539-a08c-71fcb7e09c5e","Type":"ContainerDied","Data":"1b4a0b1a41ca4b73011b697548d9bdda957e36beaa9bbb092b4ec9ca2e989e75"}
Jul 27 22:13:25.465980 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:25.465950    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"
Jul 27 22:13:25.559629 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:25.559539    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/949ad971-add5-4539-a08c-71fcb7e09c5e-maas-api-service-ca\") pod \"949ad971-add5-4539-a08c-71fcb7e09c5e\" (UID: \"949ad971-add5-4539-a08c-71fcb7e09c5e\") "
Jul 27 22:13:25.559924 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:25.559900    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/949ad971-add5-4539-a08c-71fcb7e09c5e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "949ad971-add5-4539-a08c-71fcb7e09c5e" (UID: "949ad971-add5-4539-a08c-71fcb7e09c5e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:13:25.661246 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:25.661212    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/949ad971-add5-4539-a08c-71fcb7e09c5e-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:13:26.315677 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:26.315651    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"
Jul 27 22:13:26.315677 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:26.315657    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2" event={"ID":"949ad971-add5-4539-a08c-71fcb7e09c5e","Type":"ContainerDied","Data":"528a1cefb2da7e784535dc4815712d5b84c84d84de261fdf500ac305c30fd6f6"}
Jul 27 22:13:26.315936 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:26.315700    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="528a1cefb2da7e784535dc4815712d5b84c84d84de261fdf500ac305c30fd6f6"
Jul 27 22:13:31.292463 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.292412    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"]
Jul 27 22:13:31.292939 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.292702    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc" podUID="ac5713d4-067d-4570-9474-971d5de73cce" containerName="payload-processing" containerID="cri-o://f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca" gracePeriod=30
Jul 27 22:13:31.304267 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.303969    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"]
Jul 27 22:13:31.304267 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.304230    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp" podUID="0298e641-0e72-4eae-b6c4-5f24954365ae" containerName="payload-pre-processing" containerID="cri-o://5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1" gracePeriod=30
Jul 27 22:13:31.444216 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.444153    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"]
Jul 27 22:13:31.449000 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.448971    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5e1a2f-bssh2"]
Jul 27 22:13:31.561570 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.561541    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:13:31.588392 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.588361    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:13:31.614420 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.614220    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhqvt\" (UniqueName: \"kubernetes.io/projected/ac5713d4-067d-4570-9474-971d5de73cce-kube-api-access-xhqvt\") pod \"ac5713d4-067d-4570-9474-971d5de73cce\" (UID: \"ac5713d4-067d-4570-9474-971d5de73cce\") "
Jul 27 22:13:31.614420 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.614391    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac5713d4-067d-4570-9474-971d5de73cce-plugins-config-volume\") pod \"ac5713d4-067d-4570-9474-971d5de73cce\" (UID: \"ac5713d4-067d-4570-9474-971d5de73cce\") "
Jul 27 22:13:31.614846 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.614816    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac5713d4-067d-4570-9474-971d5de73cce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac5713d4-067d-4570-9474-971d5de73cce" (UID: "ac5713d4-067d-4570-9474-971d5de73cce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:13:31.615168 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.615141    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac5713d4-067d-4570-9474-971d5de73cce-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:13:31.616815 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.616782    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac5713d4-067d-4570-9474-971d5de73cce-kube-api-access-xhqvt" (OuterVolumeSpecName: "kube-api-access-xhqvt") pod "ac5713d4-067d-4570-9474-971d5de73cce" (UID: "ac5713d4-067d-4570-9474-971d5de73cce"). InnerVolumeSpecName "kube-api-access-xhqvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:13:31.715532 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.715489    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xk7p\" (UniqueName: \"kubernetes.io/projected/0298e641-0e72-4eae-b6c4-5f24954365ae-kube-api-access-6xk7p\") pod \"0298e641-0e72-4eae-b6c4-5f24954365ae\" (UID: \"0298e641-0e72-4eae-b6c4-5f24954365ae\") "
Jul 27 22:13:31.715532 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.715543    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0298e641-0e72-4eae-b6c4-5f24954365ae-plugins-config-volume\") pod \"0298e641-0e72-4eae-b6c4-5f24954365ae\" (UID: \"0298e641-0e72-4eae-b6c4-5f24954365ae\") "
Jul 27 22:13:31.715805 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.715758    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhqvt\" (UniqueName: \"kubernetes.io/projected/ac5713d4-067d-4570-9474-971d5de73cce-kube-api-access-xhqvt\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:13:31.715990 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.715962    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0298e641-0e72-4eae-b6c4-5f24954365ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0298e641-0e72-4eae-b6c4-5f24954365ae" (UID: "0298e641-0e72-4eae-b6c4-5f24954365ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:13:31.717734 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.717711    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0298e641-0e72-4eae-b6c4-5f24954365ae-kube-api-access-6xk7p" (OuterVolumeSpecName: "kube-api-access-6xk7p") pod "0298e641-0e72-4eae-b6c4-5f24954365ae" (UID: "0298e641-0e72-4eae-b6c4-5f24954365ae"). InnerVolumeSpecName "kube-api-access-6xk7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:13:31.816665 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.816572    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xk7p\" (UniqueName: \"kubernetes.io/projected/0298e641-0e72-4eae-b6c4-5f24954365ae-kube-api-access-6xk7p\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:13:31.816665 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:31.816605    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0298e641-0e72-4eae-b6c4-5f24954365ae-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:13:32.346965 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.346926    2554 generic.go:356] "Generic (PLEG): container finished" podID="0298e641-0e72-4eae-b6c4-5f24954365ae" containerID="5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1" exitCode=0
Jul 27 22:13:32.347421 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.346974    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"
Jul 27 22:13:32.347421 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.347005    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp" event={"ID":"0298e641-0e72-4eae-b6c4-5f24954365ae","Type":"ContainerDied","Data":"5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1"}
Jul 27 22:13:32.347421 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.347057    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp" event={"ID":"0298e641-0e72-4eae-b6c4-5f24954365ae","Type":"ContainerDied","Data":"1ca679e638a5ebbf6be1a98b0d55d8d405e9e4c6f5c4cfc1f32e5c088379089d"}
Jul 27 22:13:32.347421 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.347081    2554 scope.go:117] "RemoveContainer" containerID="5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1"
Jul 27 22:13:32.348419 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.348387    2554 generic.go:356] "Generic (PLEG): container finished" podID="ac5713d4-067d-4570-9474-971d5de73cce" containerID="f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca" exitCode=0
Jul 27 22:13:32.348500 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.348427    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc" event={"ID":"ac5713d4-067d-4570-9474-971d5de73cce","Type":"ContainerDied","Data":"f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca"}
Jul 27 22:13:32.348500 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.348465    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"
Jul 27 22:13:32.348500 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.348485    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc" event={"ID":"ac5713d4-067d-4570-9474-971d5de73cce","Type":"ContainerDied","Data":"51d3bee70423acf2daa7be797d64782d8eb331821737724814c605957db0308d"}
Jul 27 22:13:32.356214 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.356194    2554 scope.go:117] "RemoveContainer" containerID="5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1"
Jul 27 22:13:32.356512 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:13:32.356484    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1\": container with ID starting with 5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1 not found: ID does not exist" containerID="5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1"
Jul 27 22:13:32.356594 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.356523    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1"} err="failed to get container status \"5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1\": rpc error: code = NotFound desc = could not find container \"5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1\": container with ID starting with 5c9769ae4fb9ca7824ff627fa2aefb509e09958eb1105822936216598ec178c1 not found: ID does not exist"
Jul 27 22:13:32.356594 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.356542    2554 scope.go:117] "RemoveContainer" containerID="f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca"
Jul 27 22:13:32.367365 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.367346    2554 scope.go:117] "RemoveContainer" containerID="f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca"
Jul 27 22:13:32.367710 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:13:32.367689    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca\": container with ID starting with f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca not found: ID does not exist" containerID="f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca"
Jul 27 22:13:32.367768 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.367718    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca"} err="failed to get container status \"f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca\": rpc error: code = NotFound desc = could not find container \"f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca\": container with ID starting with f4549f83c252a81c6808f0d630f1e5b9b9e5b4b02ce9c675ded9c074b78f39ca not found: ID does not exist"
Jul 27 22:13:32.374943 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.374918    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"]
Jul 27 22:13:32.379871 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.379839    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5e1a2f-58b5d6fdfb-bpbfp"]
Jul 27 22:13:32.396967 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.396935    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"]
Jul 27 22:13:32.402144 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.402117    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-5e1a2f-5455778dbb-kphzc"]
Jul 27 22:13:32.921123 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.921086    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0298e641-0e72-4eae-b6c4-5f24954365ae" path="/var/lib/kubelet/pods/0298e641-0e72-4eae-b6c4-5f24954365ae/volumes"
Jul 27 22:13:32.921425 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.921412    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="949ad971-add5-4539-a08c-71fcb7e09c5e" path="/var/lib/kubelet/pods/949ad971-add5-4539-a08c-71fcb7e09c5e/volumes"
Jul 27 22:13:32.921760 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:32.921747    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac5713d4-067d-4570-9474-971d5de73cce" path="/var/lib/kubelet/pods/ac5713d4-067d-4570-9474-971d5de73cce/volumes"
Jul 27 22:13:43.045781 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.045748    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"]
Jul 27 22:13:43.046147 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.046118    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0298e641-0e72-4eae-b6c4-5f24954365ae" containerName="payload-pre-processing"
Jul 27 22:13:43.046147 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.046128    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0298e641-0e72-4eae-b6c4-5f24954365ae" containerName="payload-pre-processing"
Jul 27 22:13:43.046147 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.046137    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5713d4-067d-4570-9474-971d5de73cce" containerName="payload-processing"
Jul 27 22:13:43.046147 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.046142    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5713d4-067d-4570-9474-971d5de73cce" containerName="payload-processing"
Jul 27 22:13:43.046283 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.046161    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="949ad971-add5-4539-a08c-71fcb7e09c5e" containerName="revoke-keys"
Jul 27 22:13:43.046283 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.046166    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="949ad971-add5-4539-a08c-71fcb7e09c5e" containerName="revoke-keys"
Jul 27 22:13:43.046283 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.046231    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="949ad971-add5-4539-a08c-71fcb7e09c5e" containerName="revoke-keys"
Jul 27 22:13:43.046283 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.046238    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac5713d4-067d-4570-9474-971d5de73cce" containerName="payload-processing"
Jul 27 22:13:43.046283 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.046246    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0298e641-0e72-4eae-b6c4-5f24954365ae" containerName="payload-pre-processing"
Jul 27 22:13:43.051261 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.051243    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:13:43.054465 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.054425    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-94450e\""
Jul 27 22:13:43.064575 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.064547    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"]
Jul 27 22:13:43.098544 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.098506    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"]
Jul 27 22:13:43.102163 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.102147    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:13:43.105887 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.105865    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-94450e-dockercfg-22g4v\""
Jul 27 22:13:43.112585 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.112558    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"]
Jul 27 22:13:43.129683 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.129651    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts4fm\" (UniqueName: \"kubernetes.io/projected/86456d2a-fd90-4c1c-90a9-85ee18b21838-kube-api-access-ts4fm\") pod \"payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h\" (UID: \"86456d2a-fd90-4c1c-90a9-85ee18b21838\") " pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:13:43.129870 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.129740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86456d2a-fd90-4c1c-90a9-85ee18b21838-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h\" (UID: \"86456d2a-fd90-4c1c-90a9-85ee18b21838\") " pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:13:43.231205 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.231160    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts4fm\" (UniqueName: \"kubernetes.io/projected/86456d2a-fd90-4c1c-90a9-85ee18b21838-kube-api-access-ts4fm\") pod \"payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h\" (UID: \"86456d2a-fd90-4c1c-90a9-85ee18b21838\") " pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:13:43.231381 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.231270    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86456d2a-fd90-4c1c-90a9-85ee18b21838-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h\" (UID: \"86456d2a-fd90-4c1c-90a9-85ee18b21838\") " pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:13:43.231381 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.231305    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3578d558-b13a-4b1f-8912-f7897c040a41-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk\" (UID: \"3578d558-b13a-4b1f-8912-f7897c040a41\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:13:43.231542 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.231451    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gj6k\" (UniqueName: \"kubernetes.io/projected/3578d558-b13a-4b1f-8912-f7897c040a41-kube-api-access-7gj6k\") pod \"payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk\" (UID: \"3578d558-b13a-4b1f-8912-f7897c040a41\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:13:43.232008 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.231989    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86456d2a-fd90-4c1c-90a9-85ee18b21838-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h\" (UID: \"86456d2a-fd90-4c1c-90a9-85ee18b21838\") " pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:13:43.241377 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.241341    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts4fm\" (UniqueName: \"kubernetes.io/projected/86456d2a-fd90-4c1c-90a9-85ee18b21838-kube-api-access-ts4fm\") pod \"payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h\" (UID: \"86456d2a-fd90-4c1c-90a9-85ee18b21838\") " pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:13:43.332904 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.332814    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3578d558-b13a-4b1f-8912-f7897c040a41-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk\" (UID: \"3578d558-b13a-4b1f-8912-f7897c040a41\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:13:43.332904 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.332863    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gj6k\" (UniqueName: \"kubernetes.io/projected/3578d558-b13a-4b1f-8912-f7897c040a41-kube-api-access-7gj6k\") pod \"payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk\" (UID: \"3578d558-b13a-4b1f-8912-f7897c040a41\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:13:43.333552 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.333533    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3578d558-b13a-4b1f-8912-f7897c040a41-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk\" (UID: \"3578d558-b13a-4b1f-8912-f7897c040a41\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:13:43.342823 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.342790    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gj6k\" (UniqueName: \"kubernetes.io/projected/3578d558-b13a-4b1f-8912-f7897c040a41-kube-api-access-7gj6k\") pod \"payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk\" (UID: \"3578d558-b13a-4b1f-8912-f7897c040a41\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:13:43.361200 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.361161    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:13:43.414839 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.413874    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:13:43.518631 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.518601    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"]
Jul 27 22:13:43.521093 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:13:43.521060    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86456d2a_fd90_4c1c_90a9_85ee18b21838.slice/crio-eba8bded1a16c98738621d31030f0dfb407b9bf9a68018c17f1246f248525141 WatchSource:0}: Error finding container eba8bded1a16c98738621d31030f0dfb407b9bf9a68018c17f1246f248525141: Status 404 returned error can't find the container with id eba8bded1a16c98738621d31030f0dfb407b9bf9a68018c17f1246f248525141
Jul 27 22:13:43.579555 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:43.579528    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"]
Jul 27 22:13:43.583459 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:13:43.583384    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3578d558_b13a_4b1f_8912_f7897c040a41.slice/crio-b3e4a71a8b7805e412e28afe6b837e5f9b9ac7672eb836ff02df5949bd429e7c WatchSource:0}: Error finding container b3e4a71a8b7805e412e28afe6b837e5f9b9ac7672eb836ff02df5949bd429e7c: Status 404 returned error can't find the container with id b3e4a71a8b7805e412e28afe6b837e5f9b9ac7672eb836ff02df5949bd429e7c
Jul 27 22:13:44.417585 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:44.417546    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h" event={"ID":"86456d2a-fd90-4c1c-90a9-85ee18b21838","Type":"ContainerStarted","Data":"f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527"}
Jul 27 22:13:44.418077 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:44.417649    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h" event={"ID":"86456d2a-fd90-4c1c-90a9-85ee18b21838","Type":"ContainerStarted","Data":"eba8bded1a16c98738621d31030f0dfb407b9bf9a68018c17f1246f248525141"}
Jul 27 22:13:44.418077 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:44.417733    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:13:44.419429 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:44.419402    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk" event={"ID":"3578d558-b13a-4b1f-8912-f7897c040a41","Type":"ContainerStarted","Data":"740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93"}
Jul 27 22:13:44.419559 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:44.419471    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk" event={"ID":"3578d558-b13a-4b1f-8912-f7897c040a41","Type":"ContainerStarted","Data":"b3e4a71a8b7805e412e28afe6b837e5f9b9ac7672eb836ff02df5949bd429e7c"}
Jul 27 22:13:44.419559 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:44.419512    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:13:44.438983 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:44.438919    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h" podStartSLOduration=1.438886916 podStartE2EDuration="1.438886916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:13:44.43788565 +0000 UTC m=+2376.155292133" watchObservedRunningTime="2026-07-27 22:13:44.438886916 +0000 UTC m=+2376.156293400"
Jul 27 22:13:44.457214 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:44.457159    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk" podStartSLOduration=1.457142862 podStartE2EDuration="1.457142862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:13:44.456186174 +0000 UTC m=+2376.173592657" watchObservedRunningTime="2026-07-27 22:13:44.457142862 +0000 UTC m=+2376.174549344"
Jul 27 22:13:55.427611 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:55.427574    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:13:55.428132 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:13:55.427734    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:14:10.436921 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:10.436808    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:14:10.446000 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:10.445080    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:14:13.560689 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.560653    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"]
Jul 27 22:14:13.564297 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.564277    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:14:13.567161 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.567139    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-0cb892\""
Jul 27 22:14:13.583247 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.583217    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"]
Jul 27 22:14:13.603793 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.603758    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"]
Jul 27 22:14:13.607513 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.607488    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:14:13.608786 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.608757    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jszbz\" (UniqueName: \"kubernetes.io/projected/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-kube-api-access-jszbz\") pod \"payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg\" (UID: \"6ef42c5a-4b53-4cbb-b774-e94fabc02be6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:14:13.608914 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.608877    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg\" (UID: \"6ef42c5a-4b53-4cbb-b774-e94fabc02be6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:14:13.610296 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.610275    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-0cb892-dockercfg-jqlfh\""
Jul 27 22:14:13.622923 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.622886    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"]
Jul 27 22:14:13.710379 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.710336    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg\" (UID: \"6ef42c5a-4b53-4cbb-b774-e94fabc02be6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:14:13.710583 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.710463    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88g88\" (UniqueName: \"kubernetes.io/projected/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-kube-api-access-88g88\") pod \"payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z\" (UID: \"1d5e6177-65fb-41e2-aa4f-e7361b2f442d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:14:13.710583 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.710503    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jszbz\" (UniqueName: \"kubernetes.io/projected/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-kube-api-access-jszbz\") pod \"payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg\" (UID: \"6ef42c5a-4b53-4cbb-b774-e94fabc02be6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:14:13.710718 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.710593    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z\" (UID: \"1d5e6177-65fb-41e2-aa4f-e7361b2f442d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:14:13.711139 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.711116    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg\" (UID: \"6ef42c5a-4b53-4cbb-b774-e94fabc02be6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:14:13.719755 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.719729    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jszbz\" (UniqueName: \"kubernetes.io/projected/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-kube-api-access-jszbz\") pod \"payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg\" (UID: \"6ef42c5a-4b53-4cbb-b774-e94fabc02be6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:14:13.811492 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.811381    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88g88\" (UniqueName: \"kubernetes.io/projected/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-kube-api-access-88g88\") pod \"payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z\" (UID: \"1d5e6177-65fb-41e2-aa4f-e7361b2f442d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:14:13.811492 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.811480    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z\" (UID: \"1d5e6177-65fb-41e2-aa4f-e7361b2f442d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:14:13.812108 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.812090    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z\" (UID: \"1d5e6177-65fb-41e2-aa4f-e7361b2f442d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:14:13.820241 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.820207    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88g88\" (UniqueName: \"kubernetes.io/projected/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-kube-api-access-88g88\") pod \"payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z\" (UID: \"1d5e6177-65fb-41e2-aa4f-e7361b2f442d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:14:13.875111 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.875071    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:14:13.917281 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:13.917249    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:14:14.082864 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:14:14.082779    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef42c5a_4b53_4cbb_b774_e94fabc02be6.slice/crio-c5803af1a791345be27f0f118239d9628862424e362861067cf4935620df3fe5 WatchSource:0}: Error finding container c5803af1a791345be27f0f118239d9628862424e362861067cf4935620df3fe5: Status 404 returned error can't find the container with id c5803af1a791345be27f0f118239d9628862424e362861067cf4935620df3fe5
Jul 27 22:14:14.083890 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:14.083869    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"]
Jul 27 22:14:14.108075 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:14.108053    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"]
Jul 27 22:14:14.120622 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:14:14.120587    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5e6177_65fb_41e2_aa4f_e7361b2f442d.slice/crio-8ea3050df60ebf4d899da5689609c5c78f8ec5bf76df95b27c791dcd1400c817 WatchSource:0}: Error finding container 8ea3050df60ebf4d899da5689609c5c78f8ec5bf76df95b27c791dcd1400c817: Status 404 returned error can't find the container with id 8ea3050df60ebf4d899da5689609c5c78f8ec5bf76df95b27c791dcd1400c817
Jul 27 22:14:14.580095 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:14.580061    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg" event={"ID":"6ef42c5a-4b53-4cbb-b774-e94fabc02be6","Type":"ContainerStarted","Data":"fde935198f8c72d87287b17ca7e4dda07afa629517e9741cbae162b482880e8a"}
Jul 27 22:14:14.580565 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:14.580118    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg" event={"ID":"6ef42c5a-4b53-4cbb-b774-e94fabc02be6","Type":"ContainerStarted","Data":"c5803af1a791345be27f0f118239d9628862424e362861067cf4935620df3fe5"}
Jul 27 22:14:14.580565 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:14.580251    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:14:14.581656 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:14.581638    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z" event={"ID":"1d5e6177-65fb-41e2-aa4f-e7361b2f442d","Type":"ContainerStarted","Data":"5184e4755643014984a4515a5ceef84a8d2b4e77017bd7246ef21f24934659f3"}
Jul 27 22:14:14.581750 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:14.581671    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z" event={"ID":"1d5e6177-65fb-41e2-aa4f-e7361b2f442d","Type":"ContainerStarted","Data":"8ea3050df60ebf4d899da5689609c5c78f8ec5bf76df95b27c791dcd1400c817"}
Jul 27 22:14:14.581809 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:14.581780    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:14:14.610817 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:14.610767    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg" podStartSLOduration=1.6107503109999999 podStartE2EDuration="1.610750311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:14:14.607422422 +0000 UTC m=+2406.324828906" watchObservedRunningTime="2026-07-27 22:14:14.610750311 +0000 UTC m=+2406.328156793"
Jul 27 22:14:14.651838 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:14.651782    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z" podStartSLOduration=1.6517625169999999 podStartE2EDuration="1.651762517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:14:14.649918563 +0000 UTC m=+2406.367325046" watchObservedRunningTime="2026-07-27 22:14:14.651762517 +0000 UTC m=+2406.369169000"
Jul 27 22:14:25.590008 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:25.589971    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:14:25.590517 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:25.590044    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:14:58.879324 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.879282    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"]
Jul 27 22:14:58.882941 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.882924    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:58.886972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.886945    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"default-dockercfg-2vssw\""
Jul 27 22:14:58.886972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.886965    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"kube-root-ca.crt\""
Jul 27 22:14:58.887182 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.887068    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"openshift-service-ca.crt\""
Jul 27 22:14:58.887182 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.887042    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"auth-test-model-0cb892-kserve-self-signed-certs\""
Jul 27 22:14:58.893264 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.893243    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"]
Jul 27 22:14:58.961445 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.961408    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-dshm\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:58.961697 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.961479    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tls-certs\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:58.961697 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.961520    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vh97\" (UniqueName: \"kubernetes.io/projected/a5ff305f-56bd-4940-807c-847a7f2b3cf1-kube-api-access-7vh97\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:58.961697 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.961550    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tmp-dir\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:58.961697 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.961569    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-home\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:58.961697 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:58.961622    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-model-cache\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.062922 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.062863    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-dshm\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.062922 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.062916    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tls-certs\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.063199 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.062969    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vh97\" (UniqueName: \"kubernetes.io/projected/a5ff305f-56bd-4940-807c-847a7f2b3cf1-kube-api-access-7vh97\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.063199 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.063013    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tmp-dir\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.063199 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.063037    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-home\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.063199 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.063083    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-model-cache\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.063517 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.063423    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tmp-dir\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.063582 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.063512    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-model-cache\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.063582 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.063535    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-home\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.065322 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.065301    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-dshm\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.065825 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.065803    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tls-certs\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.075178 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.075147    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vh97\" (UniqueName: \"kubernetes.io/projected/a5ff305f-56bd-4940-807c-847a7f2b3cf1-kube-api-access-7vh97\") pod \"auth-test-model-0cb892-kserve-867676b77f-rfjg4\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") " pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.194170 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.194081    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:14:59.341534 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.341506    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"]
Jul 27 22:14:59.343914 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:14:59.343885    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5ff305f_56bd_4940_807c_847a7f2b3cf1.slice/crio-b08b08403c53384fa1f70390b20b87da111f41a67c861738f038f82913b81731 WatchSource:0}: Error finding container b08b08403c53384fa1f70390b20b87da111f41a67c861738f038f82913b81731: Status 404 returned error can't find the container with id b08b08403c53384fa1f70390b20b87da111f41a67c861738f038f82913b81731
Jul 27 22:14:59.833757 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.833716    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4" event={"ID":"a5ff305f-56bd-4940-807c-847a7f2b3cf1","Type":"ContainerStarted","Data":"faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4"}
Jul 27 22:14:59.833945 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.833767    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4" event={"ID":"a5ff305f-56bd-4940-807c-847a7f2b3cf1","Type":"ContainerStarted","Data":"b08b08403c53384fa1f70390b20b87da111f41a67c861738f038f82913b81731"}
Jul 27 22:14:59.855384 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:14:59.855334    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4" podStartSLOduration=1.855317475 podStartE2EDuration="1.855317475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:14:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:14:59.853786688 +0000 UTC m=+2451.571193171" watchObservedRunningTime="2026-07-27 22:14:59.855317475 +0000 UTC m=+2451.572723956"
Jul 27 22:15:00.146293 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.146209    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv"]
Jul 27 22:15:00.150121 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.150089    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv"
Jul 27 22:15:00.151177 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.151149    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st"]
Jul 27 22:15:00.153269 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.153251    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:15:00.154546 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.154527    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf"]
Jul 27 22:15:00.154667 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.154639    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st"
Jul 27 22:15:00.158356 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.157960    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf"
Jul 27 22:15:00.161182 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.161157    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv"]
Jul 27 22:15:00.162930 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.162897    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv"
Jul 27 22:15:00.167314 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.167293    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st"]
Jul 27 22:15:00.170422 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.170400    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf"]
Jul 27 22:15:00.174258 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.174235    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st"
Jul 27 22:15:00.215571 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.215528    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf"
Jul 27 22:15:00.364729 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.364684    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st"]
Jul 27 22:15:00.435708 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.429778    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf"]
Jul 27 22:15:00.603958 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.603934    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv"]
Jul 27 22:15:00.607215 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:15:00.607186    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652c2502_3dc3_4dad_983a_2376df97d22d.slice/crio-5bdbdebb4c8b569aff08340694c62f7a5e911b5b1448dd55908ed72e1d9ca646 WatchSource:0}: Error finding container 5bdbdebb4c8b569aff08340694c62f7a5e911b5b1448dd55908ed72e1d9ca646: Status 404 returned error can't find the container with id 5bdbdebb4c8b569aff08340694c62f7a5e911b5b1448dd55908ed72e1d9ca646
Jul 27 22:15:00.841888 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.841856    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf" event={"ID":"2693c67e-a006-406a-a5f8-66209e753c4c","Type":"ContainerStarted","Data":"c21cc8078fbc49ff30439ec9d5b494ad0af26ecd4bb5fb895c7ba77ba3e6795f"}
Jul 27 22:15:00.842133 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.841916    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf" event={"ID":"2693c67e-a006-406a-a5f8-66209e753c4c","Type":"ContainerStarted","Data":"1bbe31a6ad1abba49e06d4119a9fc3896d00efc015a4956b56e631ff4f9830fa"}
Jul 27 22:15:00.843100 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.843073    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv" event={"ID":"652c2502-3dc3-4dad-983a-2376df97d22d","Type":"ContainerStarted","Data":"5bdbdebb4c8b569aff08340694c62f7a5e911b5b1448dd55908ed72e1d9ca646"}
Jul 27 22:15:00.844570 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.844542    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st" event={"ID":"15f43ce9-b27b-4050-9ff8-da89b4eb4ecc","Type":"ContainerStarted","Data":"77b73fe5586712deffe685fefc05ebe257ef979f3587e396e324d3e7749b26f0"}
Jul 27 22:15:00.844673 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.844593    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st" event={"ID":"15f43ce9-b27b-4050-9ff8-da89b4eb4ecc","Type":"ContainerStarted","Data":"46cc0df22d57ef42aff1a59c90d2f3b013e13b7bacb4e152492f9bae22ee81da"}
Jul 27 22:15:00.857673 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.857627    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf" podStartSLOduration=0.85760857 podStartE2EDuration="857.60857ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:15:00.856554432 +0000 UTC m=+2452.573960925" watchObservedRunningTime="2026-07-27 22:15:00.85760857 +0000 UTC m=+2452.575015053"
Jul 27 22:15:00.872417 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:00.872362    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st" podStartSLOduration=0.872340598 podStartE2EDuration="872.340598ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:15:00.870706158 +0000 UTC m=+2452.588112640" watchObservedRunningTime="2026-07-27 22:15:00.872340598 +0000 UTC m=+2452.589747079"
Jul 27 22:15:01.851467 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:01.851397    2554 generic.go:356] "Generic (PLEG): container finished" podID="15f43ce9-b27b-4050-9ff8-da89b4eb4ecc" containerID="77b73fe5586712deffe685fefc05ebe257ef979f3587e396e324d3e7749b26f0" exitCode=0
Jul 27 22:15:01.851876 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:01.851494    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st" event={"ID":"15f43ce9-b27b-4050-9ff8-da89b4eb4ecc","Type":"ContainerDied","Data":"77b73fe5586712deffe685fefc05ebe257ef979f3587e396e324d3e7749b26f0"}
Jul 27 22:15:01.853016 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:01.852995    2554 generic.go:356] "Generic (PLEG): container finished" podID="2693c67e-a006-406a-a5f8-66209e753c4c" containerID="c21cc8078fbc49ff30439ec9d5b494ad0af26ecd4bb5fb895c7ba77ba3e6795f" exitCode=0
Jul 27 22:15:01.853126 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:01.853068    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf" event={"ID":"2693c67e-a006-406a-a5f8-66209e753c4c","Type":"ContainerDied","Data":"c21cc8078fbc49ff30439ec9d5b494ad0af26ecd4bb5fb895c7ba77ba3e6795f"}
Jul 27 22:15:01.854487 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:01.854468    2554 generic.go:356] "Generic (PLEG): container finished" podID="652c2502-3dc3-4dad-983a-2376df97d22d" containerID="befcc966f84c0f7a46c62cd24e0bd16db2c1a66676c4d7082b06ca69e9dc6755" exitCode=0
Jul 27 22:15:01.854575 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:01.854544    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv" event={"ID":"652c2502-3dc3-4dad-983a-2376df97d22d","Type":"ContainerDied","Data":"befcc966f84c0f7a46c62cd24e0bd16db2c1a66676c4d7082b06ca69e9dc6755"}
Jul 27 22:15:03.008800 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.008770    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv"
Jul 27 22:15:03.056047 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.056017    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st"
Jul 27 22:15:03.059546 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.059525    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf"
Jul 27 22:15:03.867217 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.867178    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf" event={"ID":"2693c67e-a006-406a-a5f8-66209e753c4c","Type":"ContainerDied","Data":"1bbe31a6ad1abba49e06d4119a9fc3896d00efc015a4956b56e631ff4f9830fa"}
Jul 27 22:15:03.867426 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.867270    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bbe31a6ad1abba49e06d4119a9fc3896d00efc015a4956b56e631ff4f9830fa"
Jul 27 22:15:03.867426 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.867189    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753175-92ttf"
Jul 27 22:15:03.868602 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.868577    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv"
Jul 27 22:15:03.868738 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.868619    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv" event={"ID":"652c2502-3dc3-4dad-983a-2376df97d22d","Type":"ContainerDied","Data":"5bdbdebb4c8b569aff08340694c62f7a5e911b5b1448dd55908ed72e1d9ca646"}
Jul 27 22:15:03.868738 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.868671    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bdbdebb4c8b569aff08340694c62f7a5e911b5b1448dd55908ed72e1d9ca646"
Jul 27 22:15:03.869965 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.869948    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st"
Jul 27 22:15:03.869965 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.869951    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st" event={"ID":"15f43ce9-b27b-4050-9ff8-da89b4eb4ecc","Type":"ContainerDied","Data":"46cc0df22d57ef42aff1a59c90d2f3b013e13b7bacb4e152492f9bae22ee81da"}
Jul 27 22:15:03.870151 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:03.869987    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46cc0df22d57ef42aff1a59c90d2f3b013e13b7bacb4e152492f9bae22ee81da"
Jul 27 22:15:09.194930 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:09.194883    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:15:09.195425 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:09.194954    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:15:09.208870 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:09.208844    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:15:09.917768 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:15:09.917730    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:18:09.231209 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:18:09.231174    2554 scope.go:117] "RemoveContainer" containerID="21b245312a9c80742c811480f6ca88af8db7c92f57370754e3596acd8748d96f"
Jul 27 22:18:09.240942 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:18:09.240910    2554 scope.go:117] "RemoveContainer" containerID="d9b60a85f51715b2e2c2e8aa6e395aaaf4f4153f98c72a804bfed3faab31aeba"
Jul 27 22:19:09.268078 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:09.268046    2554 scope.go:117] "RemoveContainer" containerID="0c8ad9937ca9b89bc4fdf35d00797bb628cd8cca66deef06593c9a42f0a2ed72"
Jul 27 22:19:10.469637 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:10.469606    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:19:10.479234 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:10.479213    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:19:40.384069 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:40.384026    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"]
Jul 27 22:19:55.403502 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.403457    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4" podUID="a5ff305f-56bd-4940-807c-847a7f2b3cf1" containerName="main" containerID="cri-o://faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4" gracePeriod=45
Jul 27 22:19:55.669938 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.669879    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:19:55.796286 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796245    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tmp-dir\") pod \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") "
Jul 27 22:19:55.796517 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796315    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-model-cache\") pod \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") "
Jul 27 22:19:55.796517 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796363    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vh97\" (UniqueName: \"kubernetes.io/projected/a5ff305f-56bd-4940-807c-847a7f2b3cf1-kube-api-access-7vh97\") pod \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") "
Jul 27 22:19:55.796517 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796390    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-dshm\") pod \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") "
Jul 27 22:19:55.796517 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796478    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-home\") pod \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") "
Jul 27 22:19:55.796773 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796539    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tls-certs\") pod \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\" (UID: \"a5ff305f-56bd-4940-807c-847a7f2b3cf1\") "
Jul 27 22:19:55.796773 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796631    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5ff305f-56bd-4940-807c-847a7f2b3cf1" (UID: "a5ff305f-56bd-4940-807c-847a7f2b3cf1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:19:55.796773 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796662    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5ff305f-56bd-4940-807c-847a7f2b3cf1" (UID: "a5ff305f-56bd-4940-807c-847a7f2b3cf1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:19:55.796773 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796754    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-home" (OuterVolumeSpecName: "home") pod "a5ff305f-56bd-4940-807c-847a7f2b3cf1" (UID: "a5ff305f-56bd-4940-807c-847a7f2b3cf1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:19:55.796972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796892    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tmp-dir\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:19:55.796972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796908    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-model-cache\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:19:55.796972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.796916    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-home\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:19:55.798858 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.798829    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-dshm" (OuterVolumeSpecName: "dshm") pod "a5ff305f-56bd-4940-807c-847a7f2b3cf1" (UID: "a5ff305f-56bd-4940-807c-847a7f2b3cf1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:19:55.798986 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.798855    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5ff305f-56bd-4940-807c-847a7f2b3cf1-kube-api-access-7vh97" (OuterVolumeSpecName: "kube-api-access-7vh97") pod "a5ff305f-56bd-4940-807c-847a7f2b3cf1" (UID: "a5ff305f-56bd-4940-807c-847a7f2b3cf1"). InnerVolumeSpecName "kube-api-access-7vh97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:19:55.798986 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.798876    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5ff305f-56bd-4940-807c-847a7f2b3cf1" (UID: "a5ff305f-56bd-4940-807c-847a7f2b3cf1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:19:55.897728 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.897685    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ff305f-56bd-4940-807c-847a7f2b3cf1-tls-certs\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:19:55.897728 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.897723    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vh97\" (UniqueName: \"kubernetes.io/projected/a5ff305f-56bd-4940-807c-847a7f2b3cf1-kube-api-access-7vh97\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:19:55.897728 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:55.897734    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5ff305f-56bd-4940-807c-847a7f2b3cf1-dshm\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:19:56.485280 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:56.485245    2554 generic.go:356] "Generic (PLEG): container finished" podID="a5ff305f-56bd-4940-807c-847a7f2b3cf1" containerID="faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4" exitCode=0
Jul 27 22:19:56.485794 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:56.485290    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"
Jul 27 22:19:56.485794 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:56.485342    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4" event={"ID":"a5ff305f-56bd-4940-807c-847a7f2b3cf1","Type":"ContainerDied","Data":"faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4"}
Jul 27 22:19:56.485794 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:56.485390    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4" event={"ID":"a5ff305f-56bd-4940-807c-847a7f2b3cf1","Type":"ContainerDied","Data":"b08b08403c53384fa1f70390b20b87da111f41a67c861738f038f82913b81731"}
Jul 27 22:19:56.485794 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:56.485425    2554 scope.go:117] "RemoveContainer" containerID="faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4"
Jul 27 22:19:56.501778 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:56.501756    2554 scope.go:117] "RemoveContainer" containerID="faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4"
Jul 27 22:19:56.502060 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:19:56.502040    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4\": container with ID starting with faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4 not found: ID does not exist" containerID="faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4"
Jul 27 22:19:56.502127 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:56.502066    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4"} err="failed to get container status \"faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4\": rpc error: code = NotFound desc = could not find container \"faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4\": container with ID starting with faa0ee47089a8b26f8e12cad4d1a2fba6b1533d04baa4d9d77a9131c359023d4 not found: ID does not exist"
Jul 27 22:19:56.516934 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:56.516884    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"]
Jul 27 22:19:56.524230 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:56.524197    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/auth-test-model-0cb892-kserve-867676b77f-rfjg4"]
Jul 27 22:19:56.921655 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:19:56.921573    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5ff305f-56bd-4940-807c-847a7f2b3cf1" path="/var/lib/kubelet/pods/a5ff305f-56bd-4940-807c-847a7f2b3cf1/volumes"
Jul 27 22:20:06.467858 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.467827    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"]
Jul 27 22:20:06.468267 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468254    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ff305f-56bd-4940-807c-847a7f2b3cf1" containerName="main"
Jul 27 22:20:06.468267 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468267    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ff305f-56bd-4940-807c-847a7f2b3cf1" containerName="main"
Jul 27 22:20:06.468342 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468278    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2693c67e-a006-406a-a5f8-66209e753c4c" containerName="cleanup"
Jul 27 22:20:06.468342 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468284    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2693c67e-a006-406a-a5f8-66209e753c4c" containerName="cleanup"
Jul 27 22:20:06.468342 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468298    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15f43ce9-b27b-4050-9ff8-da89b4eb4ecc" containerName="cleanup"
Jul 27 22:20:06.468342 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468304    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="15f43ce9-b27b-4050-9ff8-da89b4eb4ecc" containerName="cleanup"
Jul 27 22:20:06.468342 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468321    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="652c2502-3dc3-4dad-983a-2376df97d22d" containerName="cleanup"
Jul 27 22:20:06.468342 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468328    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="652c2502-3dc3-4dad-983a-2376df97d22d" containerName="cleanup"
Jul 27 22:20:06.468566 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468386    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5ff305f-56bd-4940-807c-847a7f2b3cf1" containerName="main"
Jul 27 22:20:06.468566 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468394    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="652c2502-3dc3-4dad-983a-2376df97d22d" containerName="cleanup"
Jul 27 22:20:06.468566 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468400    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2693c67e-a006-406a-a5f8-66209e753c4c" containerName="cleanup"
Jul 27 22:20:06.468566 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.468406    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="15f43ce9-b27b-4050-9ff8-da89b4eb4ecc" containerName="cleanup"
Jul 27 22:20:06.473078 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.473060    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.475666 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.475646    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"kube-root-ca.crt\""
Jul 27 22:20:06.476796 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.476772    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"openshift-service-ca.crt\""
Jul 27 22:20:06.476978 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.476927    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"sub-test-model-0cb892-kserve-self-signed-certs\""
Jul 27 22:20:06.477524 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.477197    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"default-dockercfg-2vssw\""
Jul 27 22:20:06.480670 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.480644    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"]
Jul 27 22:20:06.610960 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.610916    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-home\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.611153 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.610971    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn7cx\" (UniqueName: \"kubernetes.io/projected/77f803c1-4efd-4a6b-9b86-38a9018133ad-kube-api-access-vn7cx\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.611153 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.611001    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f803c1-4efd-4a6b-9b86-38a9018133ad-tls-certs\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.611153 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.611060    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-tmp-dir\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.611153 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.611138    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-model-cache\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.611333 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.611208    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-dshm\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.712065 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.712011    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-home\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.712278 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.712078    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn7cx\" (UniqueName: \"kubernetes.io/projected/77f803c1-4efd-4a6b-9b86-38a9018133ad-kube-api-access-vn7cx\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.712278 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.712107    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f803c1-4efd-4a6b-9b86-38a9018133ad-tls-certs\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.712278 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.712171    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-tmp-dir\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.712278 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.712223    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-model-cache\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.712545 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.712296    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-dshm\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.712545 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.712532    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-home\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.712663 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.712560    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-tmp-dir\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.712712 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.712674    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-model-cache\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.714646 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.714627    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-dshm\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.714775 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.714759    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f803c1-4efd-4a6b-9b86-38a9018133ad-tls-certs\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.720554 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.720503    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn7cx\" (UniqueName: \"kubernetes.io/projected/77f803c1-4efd-4a6b-9b86-38a9018133ad-kube-api-access-vn7cx\") pod \"sub-test-model-0cb892-kserve-6d5f767dcf-5p65q\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") " pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.785650 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.785610    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:06.931278 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:06.931253    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"]
Jul 27 22:20:06.934558 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:20:06.934527    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77f803c1_4efd_4a6b_9b86_38a9018133ad.slice/crio-479f7c4bc5199b89190053ce9878cc22c3f3d929863d33ab4f2253f978ca2f26 WatchSource:0}: Error finding container 479f7c4bc5199b89190053ce9878cc22c3f3d929863d33ab4f2253f978ca2f26: Status 404 returned error can't find the container with id 479f7c4bc5199b89190053ce9878cc22c3f3d929863d33ab4f2253f978ca2f26
Jul 27 22:20:07.551961 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:07.551919    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q" event={"ID":"77f803c1-4efd-4a6b-9b86-38a9018133ad","Type":"ContainerStarted","Data":"1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f"}
Jul 27 22:20:07.551961 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:07.551965    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q" event={"ID":"77f803c1-4efd-4a6b-9b86-38a9018133ad","Type":"ContainerStarted","Data":"479f7c4bc5199b89190053ce9878cc22c3f3d929863d33ab4f2253f978ca2f26"}
Jul 27 22:20:07.571865 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:07.571806    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q" podStartSLOduration=1.5717897939999999 podStartE2EDuration="1.571789794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:20:07.570191305 +0000 UTC m=+2759.287597788" watchObservedRunningTime="2026-07-27 22:20:07.571789794 +0000 UTC m=+2759.289196276"
Jul 27 22:20:09.288444 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:09.288408    2554 scope.go:117] "RemoveContainer" containerID="1b4a0b1a41ca4b73011b697548d9bdda957e36beaa9bbb092b4ec9ca2e989e75"
Jul 27 22:20:16.786720 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:16.786681    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:16.786720 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:16.786730    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:16.799587 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:16.799560    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:20:17.617539 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:20:17.617504    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:21:29.709059 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:29.709021    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"]
Jul 27 22:21:44.729377 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:44.729336    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q" podUID="77f803c1-4efd-4a6b-9b86-38a9018133ad" containerName="main" containerID="cri-o://1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f" gracePeriod=45
Jul 27 22:21:44.995152 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:44.995085    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:21:45.067138 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.067102    2554 generic.go:356] "Generic (PLEG): container finished" podID="77f803c1-4efd-4a6b-9b86-38a9018133ad" containerID="1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f" exitCode=0
Jul 27 22:21:45.067138 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.067142    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"
Jul 27 22:21:45.067377 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.067158    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q" event={"ID":"77f803c1-4efd-4a6b-9b86-38a9018133ad","Type":"ContainerDied","Data":"1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f"}
Jul 27 22:21:45.067377 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.067196    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q" event={"ID":"77f803c1-4efd-4a6b-9b86-38a9018133ad","Type":"ContainerDied","Data":"479f7c4bc5199b89190053ce9878cc22c3f3d929863d33ab4f2253f978ca2f26"}
Jul 27 22:21:45.067377 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.067218    2554 scope.go:117] "RemoveContainer" containerID="1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f"
Jul 27 22:21:45.078110 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.078080    2554 scope.go:117] "RemoveContainer" containerID="1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f"
Jul 27 22:21:45.078400 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:21:45.078375    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f\": container with ID starting with 1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f not found: ID does not exist" containerID="1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f"
Jul 27 22:21:45.078542 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.078409    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f"} err="failed to get container status \"1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f\": rpc error: code = NotFound desc = could not find container \"1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f\": container with ID starting with 1adce24950146cceff617fcbca50d032d3586fe45e195d609b86db49ac04633f not found: ID does not exist"
Jul 27 22:21:45.109952 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.109923    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn7cx\" (UniqueName: \"kubernetes.io/projected/77f803c1-4efd-4a6b-9b86-38a9018133ad-kube-api-access-vn7cx\") pod \"77f803c1-4efd-4a6b-9b86-38a9018133ad\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") "
Jul 27 22:21:45.110095 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.109970    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f803c1-4efd-4a6b-9b86-38a9018133ad-tls-certs\") pod \"77f803c1-4efd-4a6b-9b86-38a9018133ad\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") "
Jul 27 22:21:45.110095 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.109989    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-model-cache\") pod \"77f803c1-4efd-4a6b-9b86-38a9018133ad\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") "
Jul 27 22:21:45.110095 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.110024    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-dshm\") pod \"77f803c1-4efd-4a6b-9b86-38a9018133ad\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") "
Jul 27 22:21:45.110218 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.110102    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-tmp-dir\") pod \"77f803c1-4efd-4a6b-9b86-38a9018133ad\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") "
Jul 27 22:21:45.110218 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.110129    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-home\") pod \"77f803c1-4efd-4a6b-9b86-38a9018133ad\" (UID: \"77f803c1-4efd-4a6b-9b86-38a9018133ad\") "
Jul 27 22:21:45.110344 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.110293    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "77f803c1-4efd-4a6b-9b86-38a9018133ad" (UID: "77f803c1-4efd-4a6b-9b86-38a9018133ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:21:45.110412 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.110373    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "77f803c1-4efd-4a6b-9b86-38a9018133ad" (UID: "77f803c1-4efd-4a6b-9b86-38a9018133ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:21:45.110518 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.110495    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-home" (OuterVolumeSpecName: "home") pod "77f803c1-4efd-4a6b-9b86-38a9018133ad" (UID: "77f803c1-4efd-4a6b-9b86-38a9018133ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:21:45.110567 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.110522    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-model-cache\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:21:45.110567 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.110554    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-tmp-dir\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:21:45.112180 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.112160    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f803c1-4efd-4a6b-9b86-38a9018133ad-kube-api-access-vn7cx" (OuterVolumeSpecName: "kube-api-access-vn7cx") pod "77f803c1-4efd-4a6b-9b86-38a9018133ad" (UID: "77f803c1-4efd-4a6b-9b86-38a9018133ad"). InnerVolumeSpecName "kube-api-access-vn7cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:21:45.112713 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.112687    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-dshm" (OuterVolumeSpecName: "dshm") pod "77f803c1-4efd-4a6b-9b86-38a9018133ad" (UID: "77f803c1-4efd-4a6b-9b86-38a9018133ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:21:45.112713 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.112700    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f803c1-4efd-4a6b-9b86-38a9018133ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "77f803c1-4efd-4a6b-9b86-38a9018133ad" (UID: "77f803c1-4efd-4a6b-9b86-38a9018133ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:21:45.211042 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.211009    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn7cx\" (UniqueName: \"kubernetes.io/projected/77f803c1-4efd-4a6b-9b86-38a9018133ad-kube-api-access-vn7cx\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:21:45.211042 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.211036    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77f803c1-4efd-4a6b-9b86-38a9018133ad-tls-certs\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:21:45.211042 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.211045    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-dshm\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:21:45.211281 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.211055    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77f803c1-4efd-4a6b-9b86-38a9018133ad-home\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:21:45.388380 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.388348    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"]
Jul 27 22:21:45.392697 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:45.392669    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/sub-test-model-0cb892-kserve-6d5f767dcf-5p65q"]
Jul 27 22:21:46.920867 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:21:46.920834    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77f803c1-4efd-4a6b-9b86-38a9018133ad" path="/var/lib/kubelet/pods/77f803c1-4efd-4a6b-9b86-38a9018133ad/volumes"
Jul 27 22:22:15.290989 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.290951    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"]
Jul 27 22:22:15.291600 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.291580    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f803c1-4efd-4a6b-9b86-38a9018133ad" containerName="main"
Jul 27 22:22:15.291692 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.291602    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f803c1-4efd-4a6b-9b86-38a9018133ad" containerName="main"
Jul 27 22:22:15.291747 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.291717    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f803c1-4efd-4a6b-9b86-38a9018133ad" containerName="main"
Jul 27 22:22:15.296024 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.296001    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.300025 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.300000    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"openshift-service-ca.crt\""
Jul 27 22:22:15.300141 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.300046    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"default-dockercfg-2vssw\""
Jul 27 22:22:15.300141 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.300001    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"kube-root-ca.crt\""
Jul 27 22:22:15.300141 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.300000    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0cb892\"/\"rate-test-model-0cb892-kserve-self-signed-certs\""
Jul 27 22:22:15.310547 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.310518    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"]
Jul 27 22:22:15.405807 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.405776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-home\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.405807 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.405809    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-dshm\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.406070 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.405916    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-model-cache\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.406070 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.405999    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-tmp-dir\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.406070 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.406047    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6b5b162-3ef9-49e7-9e84-83981cc97516-tls-certs\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.406240 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.406071    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkc6s\" (UniqueName: \"kubernetes.io/projected/d6b5b162-3ef9-49e7-9e84-83981cc97516-kube-api-access-tkc6s\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.506749 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.506713    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6b5b162-3ef9-49e7-9e84-83981cc97516-tls-certs\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.506749 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.506756    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkc6s\" (UniqueName: \"kubernetes.io/projected/d6b5b162-3ef9-49e7-9e84-83981cc97516-kube-api-access-tkc6s\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.506972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.506783    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-home\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.506972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.506900    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-dshm\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.507068 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.506991    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-model-cache\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.507123 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.507102    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-tmp-dir\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.507377 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.507342    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-home\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.507377 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.507359    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-model-cache\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.507605 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.507464    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-tmp-dir\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.509390 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.509371    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-dshm\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.509585 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.509566    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6b5b162-3ef9-49e7-9e84-83981cc97516-tls-certs\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.518172 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.518150    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkc6s\" (UniqueName: \"kubernetes.io/projected/d6b5b162-3ef9-49e7-9e84-83981cc97516-kube-api-access-tkc6s\") pod \"rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") " pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.605018 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.604945    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:15.765693 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:22:15.765654    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6b5b162_3ef9_49e7_9e84_83981cc97516.slice/crio-96d593fff3f121d683bb03086cbb529ed3c16167a607beb9bb9c05191865d268 WatchSource:0}: Error finding container 96d593fff3f121d683bb03086cbb529ed3c16167a607beb9bb9c05191865d268: Status 404 returned error can't find the container with id 96d593fff3f121d683bb03086cbb529ed3c16167a607beb9bb9c05191865d268
Jul 27 22:22:15.765921 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:15.765894    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"]
Jul 27 22:22:16.234138 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:16.234098    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh" event={"ID":"d6b5b162-3ef9-49e7-9e84-83981cc97516","Type":"ContainerStarted","Data":"be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10"}
Jul 27 22:22:16.234354 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:16.234153    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh" event={"ID":"d6b5b162-3ef9-49e7-9e84-83981cc97516","Type":"ContainerStarted","Data":"96d593fff3f121d683bb03086cbb529ed3c16167a607beb9bb9c05191865d268"}
Jul 27 22:22:16.257191 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:16.257137    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh" podStartSLOduration=1.257119788 podStartE2EDuration="1.257119788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:22:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:22:16.254535973 +0000 UTC m=+2887.971942455" watchObservedRunningTime="2026-07-27 22:22:16.257119788 +0000 UTC m=+2887.974526269"
Jul 27 22:22:25.605312 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:25.605270    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:25.605312 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:25.605320    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:25.617943 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:25.617911    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:22:26.296293 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:22:26.296262    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:23:26.662289 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:26.662256    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"]
Jul 27 22:23:41.681202 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:41.681101    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh" podUID="d6b5b162-3ef9-49e7-9e84-83981cc97516" containerName="main" containerID="cri-o://be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10" gracePeriod=45
Jul 27 22:23:41.935161 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:41.935086    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:23:42.069880 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.069847    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-dshm\") pod \"d6b5b162-3ef9-49e7-9e84-83981cc97516\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") "
Jul 27 22:23:42.070095 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.069890    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-home\") pod \"d6b5b162-3ef9-49e7-9e84-83981cc97516\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") "
Jul 27 22:23:42.070095 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.069919    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-tmp-dir\") pod \"d6b5b162-3ef9-49e7-9e84-83981cc97516\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") "
Jul 27 22:23:42.070095 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.069972    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-model-cache\") pod \"d6b5b162-3ef9-49e7-9e84-83981cc97516\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") "
Jul 27 22:23:42.070095 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.070015    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6b5b162-3ef9-49e7-9e84-83981cc97516-tls-certs\") pod \"d6b5b162-3ef9-49e7-9e84-83981cc97516\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") "
Jul 27 22:23:42.070095 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.070065    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkc6s\" (UniqueName: \"kubernetes.io/projected/d6b5b162-3ef9-49e7-9e84-83981cc97516-kube-api-access-tkc6s\") pod \"d6b5b162-3ef9-49e7-9e84-83981cc97516\" (UID: \"d6b5b162-3ef9-49e7-9e84-83981cc97516\") "
Jul 27 22:23:42.070337 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.070213    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d6b5b162-3ef9-49e7-9e84-83981cc97516" (UID: "d6b5b162-3ef9-49e7-9e84-83981cc97516"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:23:42.070337 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.070222    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-home" (OuterVolumeSpecName: "home") pod "d6b5b162-3ef9-49e7-9e84-83981cc97516" (UID: "d6b5b162-3ef9-49e7-9e84-83981cc97516"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:23:42.070701 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.070674    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-model-cache" (OuterVolumeSpecName: "model-cache") pod "d6b5b162-3ef9-49e7-9e84-83981cc97516" (UID: "d6b5b162-3ef9-49e7-9e84-83981cc97516"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:23:42.071375 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.071289    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-home\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:23:42.071375 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.071315    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-tmp-dir\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:23:42.071375 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.071331    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-model-cache\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:23:42.072446 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.072410    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b5b162-3ef9-49e7-9e84-83981cc97516-kube-api-access-tkc6s" (OuterVolumeSpecName: "kube-api-access-tkc6s") pod "d6b5b162-3ef9-49e7-9e84-83981cc97516" (UID: "d6b5b162-3ef9-49e7-9e84-83981cc97516"). InnerVolumeSpecName "kube-api-access-tkc6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:23:42.072534 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.072480    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-dshm" (OuterVolumeSpecName: "dshm") pod "d6b5b162-3ef9-49e7-9e84-83981cc97516" (UID: "d6b5b162-3ef9-49e7-9e84-83981cc97516"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 22:23:42.072585 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.072534    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b5b162-3ef9-49e7-9e84-83981cc97516-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d6b5b162-3ef9-49e7-9e84-83981cc97516" (UID: "d6b5b162-3ef9-49e7-9e84-83981cc97516"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 22:23:42.172612 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.172577    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6b5b162-3ef9-49e7-9e84-83981cc97516-dshm\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:23:42.172612 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.172607    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6b5b162-3ef9-49e7-9e84-83981cc97516-tls-certs\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:23:42.172612 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.172620    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkc6s\" (UniqueName: \"kubernetes.io/projected/d6b5b162-3ef9-49e7-9e84-83981cc97516-kube-api-access-tkc6s\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:23:42.683797 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.683761    2554 generic.go:356] "Generic (PLEG): container finished" podID="d6b5b162-3ef9-49e7-9e84-83981cc97516" containerID="be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10" exitCode=0
Jul 27 22:23:42.684251 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.683805    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"
Jul 27 22:23:42.684251 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.683823    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh" event={"ID":"d6b5b162-3ef9-49e7-9e84-83981cc97516","Type":"ContainerDied","Data":"be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10"}
Jul 27 22:23:42.684251 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.683862    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh" event={"ID":"d6b5b162-3ef9-49e7-9e84-83981cc97516","Type":"ContainerDied","Data":"96d593fff3f121d683bb03086cbb529ed3c16167a607beb9bb9c05191865d268"}
Jul 27 22:23:42.684251 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.683883    2554 scope.go:117] "RemoveContainer" containerID="be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10"
Jul 27 22:23:42.693193 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.693176    2554 scope.go:117] "RemoveContainer" containerID="be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10"
Jul 27 22:23:42.693490 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:23:42.693472    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10\": container with ID starting with be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10 not found: ID does not exist" containerID="be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10"
Jul 27 22:23:42.693545 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.693498    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10"} err="failed to get container status \"be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10\": rpc error: code = NotFound desc = could not find container \"be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10\": container with ID starting with be48e8be0ce2481aebc23b25306c6a2e23c5b4892eda42773ee503fa3f5f3c10 not found: ID does not exist"
Jul 27 22:23:42.707215 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.707188    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"]
Jul 27 22:23:42.710296 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.710273    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0cb892/rate-test-model-0cb892-kserve-9cc5d65d7-dsfxh"]
Jul 27 22:23:42.921733 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:42.921699    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b5b162-3ef9-49e7-9e84-83981cc97516" path="/var/lib/kubelet/pods/d6b5b162-3ef9-49e7-9e84-83981cc97516/volumes"
Jul 27 22:23:51.009267 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.009228    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"]
Jul 27 22:23:51.009872 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.009852    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b5b162-3ef9-49e7-9e84-83981cc97516" containerName="main"
Jul 27 22:23:51.009958 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.009874    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b5b162-3ef9-49e7-9e84-83981cc97516" containerName="main"
Jul 27 22:23:51.010015 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.010003    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b5b162-3ef9-49e7-9e84-83981cc97516" containerName="main"
Jul 27 22:23:51.012900 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.012880    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:23:51.015904 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.015879    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-dd2178\""
Jul 27 22:23:51.016062 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.016036    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-dd2178-dockercfg-f2w5k\""
Jul 27 22:23:51.023762 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.023727    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"]
Jul 27 22:23:51.079395 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.079365    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"]
Jul 27 22:23:51.083104 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.083082    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:23:51.093633 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.093607    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"]
Jul 27 22:23:51.160235 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.160199    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwzc4\" (UniqueName: \"kubernetes.io/projected/c7ac3bc7-170d-46c9-ad38-a7ed18472380-kube-api-access-wwzc4\") pod \"payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx\" (UID: \"c7ac3bc7-170d-46c9-ad38-a7ed18472380\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:23:51.160235 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.160239    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ac3bc7-170d-46c9-ad38-a7ed18472380-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx\" (UID: \"c7ac3bc7-170d-46c9-ad38-a7ed18472380\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:23:51.261592 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.261506    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwzc4\" (UniqueName: \"kubernetes.io/projected/c7ac3bc7-170d-46c9-ad38-a7ed18472380-kube-api-access-wwzc4\") pod \"payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx\" (UID: \"c7ac3bc7-170d-46c9-ad38-a7ed18472380\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:23:51.261592 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.261546    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ac3bc7-170d-46c9-ad38-a7ed18472380-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx\" (UID: \"c7ac3bc7-170d-46c9-ad38-a7ed18472380\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:23:51.261592 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.261576    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86875\" (UniqueName: \"kubernetes.io/projected/d03a6721-9024-484c-82cf-04ae67213198-kube-api-access-86875\") pod \"payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq\" (UID: \"d03a6721-9024-484c-82cf-04ae67213198\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:23:51.261844 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.261607    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d03a6721-9024-484c-82cf-04ae67213198-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq\" (UID: \"d03a6721-9024-484c-82cf-04ae67213198\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:23:51.262290 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.262270    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ac3bc7-170d-46c9-ad38-a7ed18472380-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx\" (UID: \"c7ac3bc7-170d-46c9-ad38-a7ed18472380\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:23:51.271072 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.271047    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwzc4\" (UniqueName: \"kubernetes.io/projected/c7ac3bc7-170d-46c9-ad38-a7ed18472380-kube-api-access-wwzc4\") pod \"payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx\" (UID: \"c7ac3bc7-170d-46c9-ad38-a7ed18472380\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:23:51.325043 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.325010    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:23:51.362714 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.362677    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86875\" (UniqueName: \"kubernetes.io/projected/d03a6721-9024-484c-82cf-04ae67213198-kube-api-access-86875\") pod \"payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq\" (UID: \"d03a6721-9024-484c-82cf-04ae67213198\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:23:51.362714 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.362719    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d03a6721-9024-484c-82cf-04ae67213198-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq\" (UID: \"d03a6721-9024-484c-82cf-04ae67213198\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:23:51.363415 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.363397    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d03a6721-9024-484c-82cf-04ae67213198-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq\" (UID: \"d03a6721-9024-484c-82cf-04ae67213198\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:23:51.372134 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.371521    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86875\" (UniqueName: \"kubernetes.io/projected/d03a6721-9024-484c-82cf-04ae67213198-kube-api-access-86875\") pod \"payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq\" (UID: \"d03a6721-9024-484c-82cf-04ae67213198\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:23:51.394379 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.394346    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:23:51.488257 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.488226    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"]
Jul 27 22:23:51.490184 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:23:51.490148    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ac3bc7_170d_46c9_ad38_a7ed18472380.slice/crio-4caa38de60b976c5eb3ec868ef18ea8cdfc95bed1e8f3f38368d741c7d58e2d0 WatchSource:0}: Error finding container 4caa38de60b976c5eb3ec868ef18ea8cdfc95bed1e8f3f38368d741c7d58e2d0: Status 404 returned error can't find the container with id 4caa38de60b976c5eb3ec868ef18ea8cdfc95bed1e8f3f38368d741c7d58e2d0
Jul 27 22:23:51.554496 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.554461    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"]
Jul 27 22:23:51.555945 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:23:51.555911    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd03a6721_9024_484c_82cf_04ae67213198.slice/crio-90086c86d4c8e934a505f9ab45aef3c565cadcb7210c8d15b0724adb717b694f WatchSource:0}: Error finding container 90086c86d4c8e934a505f9ab45aef3c565cadcb7210c8d15b0724adb717b694f: Status 404 returned error can't find the container with id 90086c86d4c8e934a505f9ab45aef3c565cadcb7210c8d15b0724adb717b694f
Jul 27 22:23:51.735858 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.735799    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq" event={"ID":"d03a6721-9024-484c-82cf-04ae67213198","Type":"ContainerStarted","Data":"dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d"}
Jul 27 22:23:51.736053 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.735871    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:23:51.736053 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.735895    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq" event={"ID":"d03a6721-9024-484c-82cf-04ae67213198","Type":"ContainerStarted","Data":"90086c86d4c8e934a505f9ab45aef3c565cadcb7210c8d15b0724adb717b694f"}
Jul 27 22:23:51.737797 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.737763    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx" event={"ID":"c7ac3bc7-170d-46c9-ad38-a7ed18472380","Type":"ContainerStarted","Data":"bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e"}
Jul 27 22:23:51.737916 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.737819    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx" event={"ID":"c7ac3bc7-170d-46c9-ad38-a7ed18472380","Type":"ContainerStarted","Data":"4caa38de60b976c5eb3ec868ef18ea8cdfc95bed1e8f3f38368d741c7d58e2d0"}
Jul 27 22:23:51.737984 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.737928    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:23:51.764505 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:23:51.764454    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq" podStartSLOduration=0.76442153 podStartE2EDuration="764.42153ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:23:51.762081828 +0000 UTC m=+2983.479488312" watchObservedRunningTime="2026-07-27 22:23:51.76442153 +0000 UTC m=+2983.481828011"
Jul 27 22:24:02.746808 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:02.746774    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:24:02.747366 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:02.746993    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:24:02.767138 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:02.767090    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx" podStartSLOduration=12.767075808 podStartE2EDuration="12.767075808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:23:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:23:51.799087737 +0000 UTC m=+2983.516494221" watchObservedRunningTime="2026-07-27 22:24:02.767075808 +0000 UTC m=+2994.484482293"
Jul 27 22:24:10.510713 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:10.510604    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:24:10.523285 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:10.523264    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:24:11.236521 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.236474    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"]
Jul 27 22:24:11.240832 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.240809    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:24:11.243745 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.243721    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-54963f\""
Jul 27 22:24:11.243888 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.243730    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-54963f-dockercfg-mrnsb\""
Jul 27 22:24:11.252011 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.251982    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"]
Jul 27 22:24:11.265980 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.265950    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"]
Jul 27 22:24:11.269668 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.269645    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:24:11.282476 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.282427    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"]
Jul 27 22:24:11.375076 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.375038    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dt2v\" (UniqueName: \"kubernetes.io/projected/51c8ead6-bc4d-49f0-aa56-07659a9a3750-kube-api-access-8dt2v\") pod \"payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t\" (UID: \"51c8ead6-bc4d-49f0-aa56-07659a9a3750\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:24:11.375266 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.375107    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc7x9\" (UniqueName: \"kubernetes.io/projected/9edaf225-4345-45b9-8ef8-393d98cf59c1-kube-api-access-qc7x9\") pod \"payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj\" (UID: \"9edaf225-4345-45b9-8ef8-393d98cf59c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:24:11.375266 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.375153    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9edaf225-4345-45b9-8ef8-393d98cf59c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj\" (UID: \"9edaf225-4345-45b9-8ef8-393d98cf59c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:24:11.375266 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.375177    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51c8ead6-bc4d-49f0-aa56-07659a9a3750-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t\" (UID: \"51c8ead6-bc4d-49f0-aa56-07659a9a3750\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:24:11.475832 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.475794    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9edaf225-4345-45b9-8ef8-393d98cf59c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj\" (UID: \"9edaf225-4345-45b9-8ef8-393d98cf59c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:24:11.475832 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.475837    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51c8ead6-bc4d-49f0-aa56-07659a9a3750-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t\" (UID: \"51c8ead6-bc4d-49f0-aa56-07659a9a3750\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:24:11.476071 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.475915    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dt2v\" (UniqueName: \"kubernetes.io/projected/51c8ead6-bc4d-49f0-aa56-07659a9a3750-kube-api-access-8dt2v\") pod \"payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t\" (UID: \"51c8ead6-bc4d-49f0-aa56-07659a9a3750\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:24:11.476071 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.475975    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc7x9\" (UniqueName: \"kubernetes.io/projected/9edaf225-4345-45b9-8ef8-393d98cf59c1-kube-api-access-qc7x9\") pod \"payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj\" (UID: \"9edaf225-4345-45b9-8ef8-393d98cf59c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:24:11.476648 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.476630    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9edaf225-4345-45b9-8ef8-393d98cf59c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj\" (UID: \"9edaf225-4345-45b9-8ef8-393d98cf59c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:24:11.476713 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.476696    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51c8ead6-bc4d-49f0-aa56-07659a9a3750-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t\" (UID: \"51c8ead6-bc4d-49f0-aa56-07659a9a3750\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:24:11.484725 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.484690    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dt2v\" (UniqueName: \"kubernetes.io/projected/51c8ead6-bc4d-49f0-aa56-07659a9a3750-kube-api-access-8dt2v\") pod \"payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t\" (UID: \"51c8ead6-bc4d-49f0-aa56-07659a9a3750\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:24:11.484725 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.484700    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc7x9\" (UniqueName: \"kubernetes.io/projected/9edaf225-4345-45b9-8ef8-393d98cf59c1-kube-api-access-qc7x9\") pod \"payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj\" (UID: \"9edaf225-4345-45b9-8ef8-393d98cf59c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:24:11.552725 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.552629    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:24:11.581309 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.581280    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:24:11.714074 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.714019    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"]
Jul 27 22:24:11.717994 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:24:11.717960    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9edaf225_4345_45b9_8ef8_393d98cf59c1.slice/crio-8fa3638fcfbf74108c1e6fa50ae4bed3b2112d2b8c436e1e7534421e70517e61 WatchSource:0}: Error finding container 8fa3638fcfbf74108c1e6fa50ae4bed3b2112d2b8c436e1e7534421e70517e61: Status 404 returned error can't find the container with id 8fa3638fcfbf74108c1e6fa50ae4bed3b2112d2b8c436e1e7534421e70517e61
Jul 27 22:24:11.752239 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.752213    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"]
Jul 27 22:24:11.757736 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:24:11.757709    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c8ead6_bc4d_49f0_aa56_07659a9a3750.slice/crio-fc549322efd7992a7d466444c62c410cc26a53a3edcc74094bba752403ab002b WatchSource:0}: Error finding container fc549322efd7992a7d466444c62c410cc26a53a3edcc74094bba752403ab002b: Status 404 returned error can't find the container with id fc549322efd7992a7d466444c62c410cc26a53a3edcc74094bba752403ab002b
Jul 27 22:24:11.851791 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.851690    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t" event={"ID":"51c8ead6-bc4d-49f0-aa56-07659a9a3750","Type":"ContainerStarted","Data":"76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489"}
Jul 27 22:24:11.851791 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.851753    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t" event={"ID":"51c8ead6-bc4d-49f0-aa56-07659a9a3750","Type":"ContainerStarted","Data":"fc549322efd7992a7d466444c62c410cc26a53a3edcc74094bba752403ab002b"}
Jul 27 22:24:11.852046 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.851882    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:24:11.853323 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.853299    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj" event={"ID":"9edaf225-4345-45b9-8ef8-393d98cf59c1","Type":"ContainerStarted","Data":"1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c"}
Jul 27 22:24:11.853470 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.853341    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj" event={"ID":"9edaf225-4345-45b9-8ef8-393d98cf59c1","Type":"ContainerStarted","Data":"8fa3638fcfbf74108c1e6fa50ae4bed3b2112d2b8c436e1e7534421e70517e61"}
Jul 27 22:24:11.853470 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.853370    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:24:11.877111 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.877053    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t" podStartSLOduration=0.877032925 podStartE2EDuration="877.032925ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:24:11.872938517 +0000 UTC m=+3003.590344998" watchObservedRunningTime="2026-07-27 22:24:11.877032925 +0000 UTC m=+3003.594439410"
Jul 27 22:24:11.891082 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:11.891019    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj" podStartSLOduration=0.891002387 podStartE2EDuration="891.002387ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:24:11.89081098 +0000 UTC m=+3003.608217464" watchObservedRunningTime="2026-07-27 22:24:11.891002387 +0000 UTC m=+3003.608408868"
Jul 27 22:24:22.861360 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:22.861329    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:24:22.861796 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:22.861414    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:24:30.558984 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:24:30.558938    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t_51c8ead6-bc4d-49f0-aa56-07659a9a3750/payload-processing/0.log"
Jul 27 22:25:27.211558 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:27.211518    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r9559"]
Jul 27 22:25:27.215455 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:27.215418    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r9559"
Jul 27 22:25:27.218252 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:27.218231    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6mjdg\""
Jul 27 22:25:27.224988 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:27.224959    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r9559"]
Jul 27 22:25:27.340562 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:27.340522    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz2pm\" (UniqueName: \"kubernetes.io/projected/4a90c133-408a-4498-93df-282e2f209e8a-kube-api-access-xz2pm\") pod \"kuadrant-operator-catalog-r9559\" (UID: \"4a90c133-408a-4498-93df-282e2f209e8a\") " pod="kuadrant-system/kuadrant-operator-catalog-r9559"
Jul 27 22:25:27.442015 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:27.441980    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz2pm\" (UniqueName: \"kubernetes.io/projected/4a90c133-408a-4498-93df-282e2f209e8a-kube-api-access-xz2pm\") pod \"kuadrant-operator-catalog-r9559\" (UID: \"4a90c133-408a-4498-93df-282e2f209e8a\") " pod="kuadrant-system/kuadrant-operator-catalog-r9559"
Jul 27 22:25:27.454256 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:27.454229    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz2pm\" (UniqueName: \"kubernetes.io/projected/4a90c133-408a-4498-93df-282e2f209e8a-kube-api-access-xz2pm\") pod \"kuadrant-operator-catalog-r9559\" (UID: \"4a90c133-408a-4498-93df-282e2f209e8a\") " pod="kuadrant-system/kuadrant-operator-catalog-r9559"
Jul 27 22:25:27.526128 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:27.526028    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r9559"
Jul 27 22:25:27.679976 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:27.679953    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r9559"]
Jul 27 22:25:27.682002 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:25:27.681977    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a90c133_408a_4498_93df_282e2f209e8a.slice/crio-a590336b980af82349d75da8002626c440d799364e9da7e0ac2fade32d8c108e WatchSource:0}: Error finding container a590336b980af82349d75da8002626c440d799364e9da7e0ac2fade32d8c108e: Status 404 returned error can't find the container with id a590336b980af82349d75da8002626c440d799364e9da7e0ac2fade32d8c108e
Jul 27 22:25:27.683483 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:27.683466    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 22:25:28.268796 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:28.268760    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r9559" event={"ID":"4a90c133-408a-4498-93df-282e2f209e8a","Type":"ContainerStarted","Data":"a590336b980af82349d75da8002626c440d799364e9da7e0ac2fade32d8c108e"}
Jul 27 22:25:30.283757 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:30.283719    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r9559" event={"ID":"4a90c133-408a-4498-93df-282e2f209e8a","Type":"ContainerStarted","Data":"6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44"}
Jul 27 22:25:30.312295 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:30.312231    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r9559" podStartSLOduration=1.446483102 podStartE2EDuration="3.312211819s" totalImagesPullingTime="1.865728717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:25:30.31075524 +0000 UTC m=+3082.028161721" watchObservedRunningTime="2026-07-27 22:25:30.312211819 +0000 UTC m=+3082.029618302"
Jul 27 22:25:37.526617 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:37.526583    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-r9559"
Jul 27 22:25:37.527020 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:37.526691    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-r9559"
Jul 27 22:25:37.551545 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:37.551518    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-r9559"
Jul 27 22:25:38.348289 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:38.348257    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-r9559"
Jul 27 22:25:38.448264 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:38.448228    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r9559"]
Jul 27 22:25:40.338286 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:40.338224    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-r9559" podUID="4a90c133-408a-4498-93df-282e2f209e8a" containerName="registry-server" containerID="cri-o://6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44" gracePeriod=2
Jul 27 22:25:40.604698 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:40.604635    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r9559"
Jul 27 22:25:40.676713 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:40.676681    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz2pm\" (UniqueName: \"kubernetes.io/projected/4a90c133-408a-4498-93df-282e2f209e8a-kube-api-access-xz2pm\") pod \"4a90c133-408a-4498-93df-282e2f209e8a\" (UID: \"4a90c133-408a-4498-93df-282e2f209e8a\") "
Jul 27 22:25:40.678815 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:40.678790    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a90c133-408a-4498-93df-282e2f209e8a-kube-api-access-xz2pm" (OuterVolumeSpecName: "kube-api-access-xz2pm") pod "4a90c133-408a-4498-93df-282e2f209e8a" (UID: "4a90c133-408a-4498-93df-282e2f209e8a"). InnerVolumeSpecName "kube-api-access-xz2pm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:25:40.777687 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:40.777647    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz2pm\" (UniqueName: \"kubernetes.io/projected/4a90c133-408a-4498-93df-282e2f209e8a-kube-api-access-xz2pm\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:25:41.345542 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:41.345497    2554 generic.go:356] "Generic (PLEG): container finished" podID="4a90c133-408a-4498-93df-282e2f209e8a" containerID="6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44" exitCode=0
Jul 27 22:25:41.345542 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:41.345545    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r9559"
Jul 27 22:25:41.346021 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:41.345587    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r9559" event={"ID":"4a90c133-408a-4498-93df-282e2f209e8a","Type":"ContainerDied","Data":"6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44"}
Jul 27 22:25:41.346021 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:41.345640    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r9559" event={"ID":"4a90c133-408a-4498-93df-282e2f209e8a","Type":"ContainerDied","Data":"a590336b980af82349d75da8002626c440d799364e9da7e0ac2fade32d8c108e"}
Jul 27 22:25:41.346021 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:41.345663    2554 scope.go:117] "RemoveContainer" containerID="6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44"
Jul 27 22:25:41.355878 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:41.355861    2554 scope.go:117] "RemoveContainer" containerID="6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44"
Jul 27 22:25:41.356122 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:25:41.356103    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44\": container with ID starting with 6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44 not found: ID does not exist" containerID="6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44"
Jul 27 22:25:41.356180 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:41.356131    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44"} err="failed to get container status \"6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44\": rpc error: code = NotFound desc = could not find container \"6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44\": container with ID starting with 6333cfbd84a9e0f029e308f2650450bd89237a4e61eeadb724196064b7d68b44 not found: ID does not exist"
Jul 27 22:25:41.366229 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:41.366199    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r9559"]
Jul 27 22:25:41.369161 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:41.369137    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r9559"]
Jul 27 22:25:42.921860 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:42.921825    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a90c133-408a-4498-93df-282e2f209e8a" path="/var/lib/kubelet/pods/4a90c133-408a-4498-93df-282e2f209e8a/volumes"
Jul 27 22:25:53.530524 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:53.530495    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq_d03a6721-9024-484c-82cf-04ae67213198/payload-processing/0.log"
Jul 27 22:25:53.784325 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:25:53.784242    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t_51c8ead6-bc4d-49f0-aa56-07659a9a3750/payload-processing/0.log"
Jul 27 22:26:01.744946 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.744268    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"]
Jul 27 22:26:01.745466 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.744998    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a90c133-408a-4498-93df-282e2f209e8a" containerName="registry-server"
Jul 27 22:26:01.745466 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.745015    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a90c133-408a-4498-93df-282e2f209e8a" containerName="registry-server"
Jul 27 22:26:01.745466 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.745105    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a90c133-408a-4498-93df-282e2f209e8a" containerName="registry-server"
Jul 27 22:26:01.748009 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.747994    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:01.751123 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.751106    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-eab778-dockercfg-t2v2w\""
Jul 27 22:26:01.751399 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.751384    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-eab778\""
Jul 27 22:26:01.760083 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.760059    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"]
Jul 27 22:26:01.775717 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.775686    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"]
Jul 27 22:26:01.780209 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.780187    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:01.794485 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.794427    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"]
Jul 27 22:26:01.879485 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.879420    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cjdh\" (UniqueName: \"kubernetes.io/projected/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-kube-api-access-6cjdh\") pod \"payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd\" (UID: \"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:01.879659 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.879510    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd\" (UID: \"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:01.879659 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.879538    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5rj6\" (UniqueName: \"kubernetes.io/projected/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-kube-api-access-g5rj6\") pod \"payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd\" (UID: \"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:01.879659 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.879623    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd\" (UID: \"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:01.981161 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.981124    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd\" (UID: \"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:01.981358 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.981231    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cjdh\" (UniqueName: \"kubernetes.io/projected/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-kube-api-access-6cjdh\") pod \"payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd\" (UID: \"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:01.981358 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.981257    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd\" (UID: \"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:01.981358 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.981278    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5rj6\" (UniqueName: \"kubernetes.io/projected/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-kube-api-access-g5rj6\") pod \"payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd\" (UID: \"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:01.982006 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.981984    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd\" (UID: \"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:01.982048 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.981988    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd\" (UID: \"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:01.990227 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.990203    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cjdh\" (UniqueName: \"kubernetes.io/projected/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-kube-api-access-6cjdh\") pod \"payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd\" (UID: \"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:01.990501 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:01.990478    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5rj6\" (UniqueName: \"kubernetes.io/projected/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-kube-api-access-g5rj6\") pod \"payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd\" (UID: \"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:02.059122 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.059044    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:02.091766 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.091726    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:02.225659 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.225624    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"]
Jul 27 22:26:02.227521 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:26:02.227491    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a3d679_ab7c_49bb_b9ce_d97d8a259d9d.slice/crio-6b77332fee88d36cd207b7bb792393346c6358761ced27fcf08a8c696fb7e1ba WatchSource:0}: Error finding container 6b77332fee88d36cd207b7bb792393346c6358761ced27fcf08a8c696fb7e1ba: Status 404 returned error can't find the container with id 6b77332fee88d36cd207b7bb792393346c6358761ced27fcf08a8c696fb7e1ba
Jul 27 22:26:02.259110 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.259084    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"]
Jul 27 22:26:02.262684 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:26:02.262657    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb6e1c6_4f7c_48ce_a0e4_7d09d61e1cc2.slice/crio-43ad5984a341dccac4b9ebd8a78269aec0a2dffd2e9b87317dbe6b3ca9bbb624 WatchSource:0}: Error finding container 43ad5984a341dccac4b9ebd8a78269aec0a2dffd2e9b87317dbe6b3ca9bbb624: Status 404 returned error can't find the container with id 43ad5984a341dccac4b9ebd8a78269aec0a2dffd2e9b87317dbe6b3ca9bbb624
Jul 27 22:26:02.475246 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.475204    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd" event={"ID":"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d","Type":"ContainerStarted","Data":"d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0"}
Jul 27 22:26:02.475489 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.475427    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:02.475560 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.475508    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd" event={"ID":"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d","Type":"ContainerStarted","Data":"6b77332fee88d36cd207b7bb792393346c6358761ced27fcf08a8c696fb7e1ba"}
Jul 27 22:26:02.477175 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.477146    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd" event={"ID":"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2","Type":"ContainerStarted","Data":"f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269"}
Jul 27 22:26:02.477307 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.477198    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd" event={"ID":"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2","Type":"ContainerStarted","Data":"43ad5984a341dccac4b9ebd8a78269aec0a2dffd2e9b87317dbe6b3ca9bbb624"}
Jul 27 22:26:02.477307 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.477293    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:02.498519 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.498461    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd" podStartSLOduration=1.498428659 podStartE2EDuration="1.498428659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:26:02.496864563 +0000 UTC m=+3114.214271043" watchObservedRunningTime="2026-07-27 22:26:02.498428659 +0000 UTC m=+3114.215835140"
Jul 27 22:26:02.538827 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:02.538749    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd" podStartSLOduration=1.538728082 podStartE2EDuration="1.538728082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:26:02.534032505 +0000 UTC m=+3114.251438988" watchObservedRunningTime="2026-07-27 22:26:02.538728082 +0000 UTC m=+3114.256134574"
Jul 27 22:26:13.485233 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:13.485198    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:13.485731 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:13.485499    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:18.403319 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:18.403282    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"]
Jul 27 22:26:18.406373 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:18.406354    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"
Jul 27 22:26:18.409309 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:18.409275    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:26:18.409603 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:18.409584    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:26:18.419259 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:18.419234    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"]
Jul 27 22:26:18.548914 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:18.548873    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35fcf8ae-dcbf-4efa-b291-c1c26b1291dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz\" (UID: \"35fcf8ae-dcbf-4efa-b291-c1c26b1291dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"
Jul 27 22:26:18.650037 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:18.649987    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35fcf8ae-dcbf-4efa-b291-c1c26b1291dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz\" (UID: \"35fcf8ae-dcbf-4efa-b291-c1c26b1291dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"
Jul 27 22:26:18.650730 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:18.650706    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35fcf8ae-dcbf-4efa-b291-c1c26b1291dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz\" (UID: \"35fcf8ae-dcbf-4efa-b291-c1c26b1291dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"
Jul 27 22:26:18.718479 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:18.718445    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"
Jul 27 22:26:18.869914 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:18.869878    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"]
Jul 27 22:26:18.870065 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:26:18.870042    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35fcf8ae_dcbf_4efa_b291_c1c26b1291dd.slice/crio-430de578a7dfa9dab01d45460e77dae13292564695e30d6538dc474712e584a9 WatchSource:0}: Error finding container 430de578a7dfa9dab01d45460e77dae13292564695e30d6538dc474712e584a9: Status 404 returned error can't find the container with id 430de578a7dfa9dab01d45460e77dae13292564695e30d6538dc474712e584a9
Jul 27 22:26:19.573743 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:19.573707    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz" event={"ID":"35fcf8ae-dcbf-4efa-b291-c1c26b1291dd","Type":"ContainerStarted","Data":"906cd4799d09bd2b309260c200da077eb1bc405bc830f24761ceec448897ca7b"}
Jul 27 22:26:19.574134 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:19.573763    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz" event={"ID":"35fcf8ae-dcbf-4efa-b291-c1c26b1291dd","Type":"ContainerStarted","Data":"430de578a7dfa9dab01d45460e77dae13292564695e30d6538dc474712e584a9"}
Jul 27 22:26:19.592282 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:19.592229    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz" podStartSLOduration=1.592212347 podStartE2EDuration="1.592212347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:26:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:26:19.590709076 +0000 UTC m=+3131.308115559" watchObservedRunningTime="2026-07-27 22:26:19.592212347 +0000 UTC m=+3131.309618829"
Jul 27 22:26:20.581042 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:20.581001    2554 generic.go:356] "Generic (PLEG): container finished" podID="35fcf8ae-dcbf-4efa-b291-c1c26b1291dd" containerID="906cd4799d09bd2b309260c200da077eb1bc405bc830f24761ceec448897ca7b" exitCode=0
Jul 27 22:26:20.581580 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:20.581048    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz" event={"ID":"35fcf8ae-dcbf-4efa-b291-c1c26b1291dd","Type":"ContainerDied","Data":"906cd4799d09bd2b309260c200da077eb1bc405bc830f24761ceec448897ca7b"}
Jul 27 22:26:21.734040 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:21.734010    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"
Jul 27 22:26:21.780287 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:21.780248    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35fcf8ae-dcbf-4efa-b291-c1c26b1291dd-maas-api-service-ca\") pod \"35fcf8ae-dcbf-4efa-b291-c1c26b1291dd\" (UID: \"35fcf8ae-dcbf-4efa-b291-c1c26b1291dd\") "
Jul 27 22:26:21.780826 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:21.780795    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35fcf8ae-dcbf-4efa-b291-c1c26b1291dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "35fcf8ae-dcbf-4efa-b291-c1c26b1291dd" (UID: "35fcf8ae-dcbf-4efa-b291-c1c26b1291dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:26:21.881923 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:21.881829    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35fcf8ae-dcbf-4efa-b291-c1c26b1291dd-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:26:22.593656 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:22.593627    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"
Jul 27 22:26:22.593829 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:22.593673    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz" event={"ID":"35fcf8ae-dcbf-4efa-b291-c1c26b1291dd","Type":"ContainerDied","Data":"430de578a7dfa9dab01d45460e77dae13292564695e30d6538dc474712e584a9"}
Jul 27 22:26:22.593829 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:22.593721    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="430de578a7dfa9dab01d45460e77dae13292564695e30d6538dc474712e584a9"
Jul 27 22:26:30.616668 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.616594    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"]
Jul 27 22:26:30.617196 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.616836    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd" podUID="20a3d679-ab7c-49bb-b9ce-d97d8a259d9d" containerName="payload-processing" containerID="cri-o://d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0" gracePeriod=30
Jul 27 22:26:30.630882 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.630852    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"]
Jul 27 22:26:30.631225 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.631192    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd" podUID="1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2" containerName="payload-pre-processing" containerID="cri-o://f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269" gracePeriod=30
Jul 27 22:26:30.906867 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.906840    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:30.927518 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.927490    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"]
Jul 27 22:26:30.933870 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.933849    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:30.935405 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.935384    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-eab778-82bgz"]
Jul 27 22:26:30.975992 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.975959    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-plugins-config-volume\") pod \"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2\" (UID: \"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2\") "
Jul 27 22:26:30.976198 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.976028    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-plugins-config-volume\") pod \"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d\" (UID: \"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d\") "
Jul 27 22:26:30.976269 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.976210    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cjdh\" (UniqueName: \"kubernetes.io/projected/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-kube-api-access-6cjdh\") pod \"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2\" (UID: \"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2\") "
Jul 27 22:26:30.976339 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.976308    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5rj6\" (UniqueName: \"kubernetes.io/projected/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-kube-api-access-g5rj6\") pod \"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d\" (UID: \"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d\") "
Jul 27 22:26:30.976480 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.976419    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2" (UID: "1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:26:30.976566 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.976417    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "20a3d679-ab7c-49bb-b9ce-d97d8a259d9d" (UID: "20a3d679-ab7c-49bb-b9ce-d97d8a259d9d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:26:30.976776 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.976752    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:26:30.976897 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.976791    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:26:30.978490 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.978467    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-kube-api-access-6cjdh" (OuterVolumeSpecName: "kube-api-access-6cjdh") pod "1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2" (UID: "1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2"). InnerVolumeSpecName "kube-api-access-6cjdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:26:30.978817 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:30.978793    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-kube-api-access-g5rj6" (OuterVolumeSpecName: "kube-api-access-g5rj6") pod "20a3d679-ab7c-49bb-b9ce-d97d8a259d9d" (UID: "20a3d679-ab7c-49bb-b9ce-d97d8a259d9d"). InnerVolumeSpecName "kube-api-access-g5rj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:26:31.077354 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.077316    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5rj6\" (UniqueName: \"kubernetes.io/projected/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d-kube-api-access-g5rj6\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:26:31.077354 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.077348    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cjdh\" (UniqueName: \"kubernetes.io/projected/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2-kube-api-access-6cjdh\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:26:31.650632 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.650597    2554 generic.go:356] "Generic (PLEG): container finished" podID="1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2" containerID="f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269" exitCode=0
Jul 27 22:26:31.651089 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.650643    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"
Jul 27 22:26:31.651089 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.650685    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd" event={"ID":"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2","Type":"ContainerDied","Data":"f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269"}
Jul 27 22:26:31.651089 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.650745    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd" event={"ID":"1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2","Type":"ContainerDied","Data":"43ad5984a341dccac4b9ebd8a78269aec0a2dffd2e9b87317dbe6b3ca9bbb624"}
Jul 27 22:26:31.651089 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.650762    2554 scope.go:117] "RemoveContainer" containerID="f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269"
Jul 27 22:26:31.652158 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.652136    2554 generic.go:356] "Generic (PLEG): container finished" podID="20a3d679-ab7c-49bb-b9ce-d97d8a259d9d" containerID="d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0" exitCode=0
Jul 27 22:26:31.652225 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.652175    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"
Jul 27 22:26:31.652225 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.652203    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd" event={"ID":"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d","Type":"ContainerDied","Data":"d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0"}
Jul 27 22:26:31.652308 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.652231    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd" event={"ID":"20a3d679-ab7c-49bb-b9ce-d97d8a259d9d","Type":"ContainerDied","Data":"6b77332fee88d36cd207b7bb792393346c6358761ced27fcf08a8c696fb7e1ba"}
Jul 27 22:26:31.661357 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.661327    2554 scope.go:117] "RemoveContainer" containerID="f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269"
Jul 27 22:26:31.661705 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:26:31.661683    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269\": container with ID starting with f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269 not found: ID does not exist" containerID="f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269"
Jul 27 22:26:31.661786 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.661713    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269"} err="failed to get container status \"f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269\": rpc error: code = NotFound desc = could not find container \"f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269\": container with ID starting with f0db759ec4ac2d529be4ae2faa9515410b5869d835385a0af3b5aadeba6a3269 not found: ID does not exist"
Jul 27 22:26:31.661786 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.661732    2554 scope.go:117] "RemoveContainer" containerID="d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0"
Jul 27 22:26:31.670602 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.670582    2554 scope.go:117] "RemoveContainer" containerID="d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0"
Jul 27 22:26:31.670850 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:26:31.670833    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0\": container with ID starting with d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0 not found: ID does not exist" containerID="d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0"
Jul 27 22:26:31.670906 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.670855    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0"} err="failed to get container status \"d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0\": rpc error: code = NotFound desc = could not find container \"d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0\": container with ID starting with d51331b1af488ff0e9c37661ec737f0f0d4ebd8f0afd8c450b7165bc32a83dd0 not found: ID does not exist"
Jul 27 22:26:31.678314 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.678295    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"]
Jul 27 22:26:31.683047 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.683019    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eab778-76cf8486c6-7kpnd"]
Jul 27 22:26:31.702038 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.702011    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"]
Jul 27 22:26:31.712989 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:31.712964    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eab778-5bc5467748-74xtd"]
Jul 27 22:26:32.921019 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:32.920986    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2" path="/var/lib/kubelet/pods/1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2/volumes"
Jul 27 22:26:32.921504 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:32.921488    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20a3d679-ab7c-49bb-b9ce-d97d8a259d9d" path="/var/lib/kubelet/pods/20a3d679-ab7c-49bb-b9ce-d97d8a259d9d/volumes"
Jul 27 22:26:32.921803 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:32.921790    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35fcf8ae-dcbf-4efa-b291-c1c26b1291dd" path="/var/lib/kubelet/pods/35fcf8ae-dcbf-4efa-b291-c1c26b1291dd/volumes"
Jul 27 22:26:42.189574 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.189534    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"]
Jul 27 22:26:42.190036 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.189973    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35fcf8ae-dcbf-4efa-b291-c1c26b1291dd" containerName="revoke-keys"
Jul 27 22:26:42.190036 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.189984    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="35fcf8ae-dcbf-4efa-b291-c1c26b1291dd" containerName="revoke-keys"
Jul 27 22:26:42.190036 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.189994    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2" containerName="payload-pre-processing"
Jul 27 22:26:42.190036 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.190000    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2" containerName="payload-pre-processing"
Jul 27 22:26:42.190036 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.190017    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20a3d679-ab7c-49bb-b9ce-d97d8a259d9d" containerName="payload-processing"
Jul 27 22:26:42.190036 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.190022    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="20a3d679-ab7c-49bb-b9ce-d97d8a259d9d" containerName="payload-processing"
Jul 27 22:26:42.190228 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.190087    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="35fcf8ae-dcbf-4efa-b291-c1c26b1291dd" containerName="revoke-keys"
Jul 27 22:26:42.190228 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.190099    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb6e1c6-4f7c-48ce-a0e4-7d09d61e1cc2" containerName="payload-pre-processing"
Jul 27 22:26:42.190228 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.190108    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="20a3d679-ab7c-49bb-b9ce-d97d8a259d9d" containerName="payload-processing"
Jul 27 22:26:42.193366 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.193350    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"
Jul 27 22:26:42.196396 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.196371    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:26:42.196587 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.196375    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:26:42.201017 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.200989    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"]
Jul 27 22:26:42.292026 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.291982    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3612f15-a8c6-45f5-adc4-3d6a510d36b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s\" (UID: \"b3612f15-a8c6-45f5-adc4-3d6a510d36b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"
Jul 27 22:26:42.392837 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.392797    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3612f15-a8c6-45f5-adc4-3d6a510d36b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s\" (UID: \"b3612f15-a8c6-45f5-adc4-3d6a510d36b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"
Jul 27 22:26:42.393414 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.393393    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3612f15-a8c6-45f5-adc4-3d6a510d36b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s\" (UID: \"b3612f15-a8c6-45f5-adc4-3d6a510d36b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"
Jul 27 22:26:42.506064 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.506030    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"
Jul 27 22:26:42.657177 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.657155    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"]
Jul 27 22:26:42.659559 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:26:42.659533    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3612f15_a8c6_45f5_adc4_3d6a510d36b7.slice/crio-243cc76574c28852a0a2fec459c57df2f29515c1af5fed4a840873b6c052019e WatchSource:0}: Error finding container 243cc76574c28852a0a2fec459c57df2f29515c1af5fed4a840873b6c052019e: Status 404 returned error can't find the container with id 243cc76574c28852a0a2fec459c57df2f29515c1af5fed4a840873b6c052019e
Jul 27 22:26:42.716610 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:42.716574    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s" event={"ID":"b3612f15-a8c6-45f5-adc4-3d6a510d36b7","Type":"ContainerStarted","Data":"243cc76574c28852a0a2fec459c57df2f29515c1af5fed4a840873b6c052019e"}
Jul 27 22:26:43.728283 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:43.728245    2554 generic.go:356] "Generic (PLEG): container finished" podID="b3612f15-a8c6-45f5-adc4-3d6a510d36b7" containerID="030203ede658ccafd780e26ded129b34e00de1e3ec57a626d3d1f9d284b4ae61" exitCode=0
Jul 27 22:26:43.728723 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:43.728332    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s" event={"ID":"b3612f15-a8c6-45f5-adc4-3d6a510d36b7","Type":"ContainerDied","Data":"030203ede658ccafd780e26ded129b34e00de1e3ec57a626d3d1f9d284b4ae61"}
Jul 27 22:26:44.875625 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:44.875597    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"
Jul 27 22:26:45.017989 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:45.017895    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3612f15-a8c6-45f5-adc4-3d6a510d36b7-maas-api-service-ca\") pod \"b3612f15-a8c6-45f5-adc4-3d6a510d36b7\" (UID: \"b3612f15-a8c6-45f5-adc4-3d6a510d36b7\") "
Jul 27 22:26:45.018288 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:45.018264    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3612f15-a8c6-45f5-adc4-3d6a510d36b7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b3612f15-a8c6-45f5-adc4-3d6a510d36b7" (UID: "b3612f15-a8c6-45f5-adc4-3d6a510d36b7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:26:45.018369 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:45.018357    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3612f15-a8c6-45f5-adc4-3d6a510d36b7-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:26:45.741125 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:45.741089    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"
Jul 27 22:26:45.741125 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:45.741115    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s" event={"ID":"b3612f15-a8c6-45f5-adc4-3d6a510d36b7","Type":"ContainerDied","Data":"243cc76574c28852a0a2fec459c57df2f29515c1af5fed4a840873b6c052019e"}
Jul 27 22:26:45.741355 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:45.741202    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="243cc76574c28852a0a2fec459c57df2f29515c1af5fed4a840873b6c052019e"
Jul 27 22:26:57.326221 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.326185    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"]
Jul 27 22:26:57.326724 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.326457    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq" podUID="d03a6721-9024-484c-82cf-04ae67213198" containerName="payload-processing" containerID="cri-o://dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d" gracePeriod=30
Jul 27 22:26:57.342075 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.342038    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"]
Jul 27 22:26:57.342648 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.342587    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx" podUID="c7ac3bc7-170d-46c9-ad38-a7ed18472380" containerName="payload-pre-processing" containerID="cri-o://bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e" gracePeriod=30
Jul 27 22:26:57.511535 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.511491    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"]
Jul 27 22:26:57.515670 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.515640    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-dd2178-zpb4s"]
Jul 27 22:26:57.650741 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.650713    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:26:57.654673 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.654642    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:26:57.752963 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.752926    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d03a6721-9024-484c-82cf-04ae67213198-plugins-config-volume\") pod \"d03a6721-9024-484c-82cf-04ae67213198\" (UID: \"d03a6721-9024-484c-82cf-04ae67213198\") "
Jul 27 22:26:57.753160 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.753051    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ac3bc7-170d-46c9-ad38-a7ed18472380-plugins-config-volume\") pod \"c7ac3bc7-170d-46c9-ad38-a7ed18472380\" (UID: \"c7ac3bc7-170d-46c9-ad38-a7ed18472380\") "
Jul 27 22:26:57.753160 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.753105    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86875\" (UniqueName: \"kubernetes.io/projected/d03a6721-9024-484c-82cf-04ae67213198-kube-api-access-86875\") pod \"d03a6721-9024-484c-82cf-04ae67213198\" (UID: \"d03a6721-9024-484c-82cf-04ae67213198\") "
Jul 27 22:26:57.753160 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.753130    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwzc4\" (UniqueName: \"kubernetes.io/projected/c7ac3bc7-170d-46c9-ad38-a7ed18472380-kube-api-access-wwzc4\") pod \"c7ac3bc7-170d-46c9-ad38-a7ed18472380\" (UID: \"c7ac3bc7-170d-46c9-ad38-a7ed18472380\") "
Jul 27 22:26:57.753388 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.753352    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d03a6721-9024-484c-82cf-04ae67213198-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d03a6721-9024-484c-82cf-04ae67213198" (UID: "d03a6721-9024-484c-82cf-04ae67213198"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:26:57.753464 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.753394    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ac3bc7-170d-46c9-ad38-a7ed18472380-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c7ac3bc7-170d-46c9-ad38-a7ed18472380" (UID: "c7ac3bc7-170d-46c9-ad38-a7ed18472380"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:26:57.755488 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.755430    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d03a6721-9024-484c-82cf-04ae67213198-kube-api-access-86875" (OuterVolumeSpecName: "kube-api-access-86875") pod "d03a6721-9024-484c-82cf-04ae67213198" (UID: "d03a6721-9024-484c-82cf-04ae67213198"). InnerVolumeSpecName "kube-api-access-86875". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:26:57.755603 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.755492    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ac3bc7-170d-46c9-ad38-a7ed18472380-kube-api-access-wwzc4" (OuterVolumeSpecName: "kube-api-access-wwzc4") pod "c7ac3bc7-170d-46c9-ad38-a7ed18472380" (UID: "c7ac3bc7-170d-46c9-ad38-a7ed18472380"). InnerVolumeSpecName "kube-api-access-wwzc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:26:57.812121 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.812080    2554 generic.go:356] "Generic (PLEG): container finished" podID="c7ac3bc7-170d-46c9-ad38-a7ed18472380" containerID="bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e" exitCode=0
Jul 27 22:26:57.812281 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.812125    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"
Jul 27 22:26:57.812281 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.812168    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx" event={"ID":"c7ac3bc7-170d-46c9-ad38-a7ed18472380","Type":"ContainerDied","Data":"bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e"}
Jul 27 22:26:57.812281 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.812217    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx" event={"ID":"c7ac3bc7-170d-46c9-ad38-a7ed18472380","Type":"ContainerDied","Data":"4caa38de60b976c5eb3ec868ef18ea8cdfc95bed1e8f3f38368d741c7d58e2d0"}
Jul 27 22:26:57.812281 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.812245    2554 scope.go:117] "RemoveContainer" containerID="bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e"
Jul 27 22:26:57.813852 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.813827    2554 generic.go:356] "Generic (PLEG): container finished" podID="d03a6721-9024-484c-82cf-04ae67213198" containerID="dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d" exitCode=0
Jul 27 22:26:57.813983 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.813858    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq" event={"ID":"d03a6721-9024-484c-82cf-04ae67213198","Type":"ContainerDied","Data":"dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d"}
Jul 27 22:26:57.813983 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.813880    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"
Jul 27 22:26:57.813983 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.813905    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq" event={"ID":"d03a6721-9024-484c-82cf-04ae67213198","Type":"ContainerDied","Data":"90086c86d4c8e934a505f9ab45aef3c565cadcb7210c8d15b0724adb717b694f"}
Jul 27 22:26:57.822554 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.822521    2554 scope.go:117] "RemoveContainer" containerID="bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e"
Jul 27 22:26:57.822815 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:26:57.822797    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e\": container with ID starting with bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e not found: ID does not exist" containerID="bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e"
Jul 27 22:26:57.822895 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.822827    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e"} err="failed to get container status \"bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e\": rpc error: code = NotFound desc = could not find container \"bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e\": container with ID starting with bde451ada161299ec77639d12080afbf492073076979ddaac0a605357fd7ed7e not found: ID does not exist"
Jul 27 22:26:57.822895 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.822851    2554 scope.go:117] "RemoveContainer" containerID="dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d"
Jul 27 22:26:57.831495 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.831472    2554 scope.go:117] "RemoveContainer" containerID="dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d"
Jul 27 22:26:57.831834 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:26:57.831815    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d\": container with ID starting with dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d not found: ID does not exist" containerID="dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d"
Jul 27 22:26:57.831898 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.831842    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d"} err="failed to get container status \"dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d\": rpc error: code = NotFound desc = could not find container \"dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d\": container with ID starting with dde56521dcf1a300385bb3e33d5be34d67138c1c96cc6c0f2a331bee1e51920d not found: ID does not exist"
Jul 27 22:26:57.846967 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.846930    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"]
Jul 27 22:26:57.849068 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.849046    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-dd2178-f6f7f6754-262pq"]
Jul 27 22:26:57.854280 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.854256    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ac3bc7-170d-46c9-ad38-a7ed18472380-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:26:57.854354 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.854285    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86875\" (UniqueName: \"kubernetes.io/projected/d03a6721-9024-484c-82cf-04ae67213198-kube-api-access-86875\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:26:57.854354 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.854301    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwzc4\" (UniqueName: \"kubernetes.io/projected/c7ac3bc7-170d-46c9-ad38-a7ed18472380-kube-api-access-wwzc4\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:26:57.854354 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.854314    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d03a6721-9024-484c-82cf-04ae67213198-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:26:57.861605 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.861580    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"]
Jul 27 22:26:57.865736 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:57.865705    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-dd2178-6f47ff5c88-c5xcx"]
Jul 27 22:26:58.921732 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:58.921700    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3612f15-a8c6-45f5-adc4-3d6a510d36b7" path="/var/lib/kubelet/pods/b3612f15-a8c6-45f5-adc4-3d6a510d36b7/volumes"
Jul 27 22:26:58.922104 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:58.922078    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ac3bc7-170d-46c9-ad38-a7ed18472380" path="/var/lib/kubelet/pods/c7ac3bc7-170d-46c9-ad38-a7ed18472380/volumes"
Jul 27 22:26:58.922390 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:26:58.922376    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d03a6721-9024-484c-82cf-04ae67213198" path="/var/lib/kubelet/pods/d03a6721-9024-484c-82cf-04ae67213198/volumes"
Jul 27 22:28:05.061518 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.061423    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"]
Jul 27 22:28:05.061972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.061883    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3612f15-a8c6-45f5-adc4-3d6a510d36b7" containerName="revoke-keys"
Jul 27 22:28:05.061972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.061896    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3612f15-a8c6-45f5-adc4-3d6a510d36b7" containerName="revoke-keys"
Jul 27 22:28:05.061972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.061908    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ac3bc7-170d-46c9-ad38-a7ed18472380" containerName="payload-pre-processing"
Jul 27 22:28:05.061972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.061914    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ac3bc7-170d-46c9-ad38-a7ed18472380" containerName="payload-pre-processing"
Jul 27 22:28:05.061972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.061945    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d03a6721-9024-484c-82cf-04ae67213198" containerName="payload-processing"
Jul 27 22:28:05.061972 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.061952    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d03a6721-9024-484c-82cf-04ae67213198" containerName="payload-processing"
Jul 27 22:28:05.062167 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.062018    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d03a6721-9024-484c-82cf-04ae67213198" containerName="payload-processing"
Jul 27 22:28:05.062167 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.062030    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3612f15-a8c6-45f5-adc4-3d6a510d36b7" containerName="revoke-keys"
Jul 27 22:28:05.062167 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.062041    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ac3bc7-170d-46c9-ad38-a7ed18472380" containerName="payload-pre-processing"
Jul 27 22:28:05.065403 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.065387    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"
Jul 27 22:28:05.070747 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.070722    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:28:05.070900 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.070728    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:28:05.080319 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.080290    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"]
Jul 27 22:28:05.129022 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.128992    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a8442e-7ef0-4f1d-a27e-5a61fd512a39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq\" (UID: \"d6a8442e-7ef0-4f1d-a27e-5a61fd512a39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"
Jul 27 22:28:05.230482 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.230425    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a8442e-7ef0-4f1d-a27e-5a61fd512a39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq\" (UID: \"d6a8442e-7ef0-4f1d-a27e-5a61fd512a39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"
Jul 27 22:28:05.231073 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.231053    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a8442e-7ef0-4f1d-a27e-5a61fd512a39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq\" (UID: \"d6a8442e-7ef0-4f1d-a27e-5a61fd512a39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"
Jul 27 22:28:05.375864 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.375777    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"
Jul 27 22:28:05.519840 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:05.519814    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"]
Jul 27 22:28:05.522427 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:28:05.522403    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a8442e_7ef0_4f1d_a27e_5a61fd512a39.slice/crio-ec3d89db9d69ace3b2ab89c79b1e8ac5273128f7a1254e2058f235f40ad56e93 WatchSource:0}: Error finding container ec3d89db9d69ace3b2ab89c79b1e8ac5273128f7a1254e2058f235f40ad56e93: Status 404 returned error can't find the container with id ec3d89db9d69ace3b2ab89c79b1e8ac5273128f7a1254e2058f235f40ad56e93
Jul 27 22:28:06.201791 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:06.201699    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq" event={"ID":"d6a8442e-7ef0-4f1d-a27e-5a61fd512a39","Type":"ContainerStarted","Data":"f313b3798f1ea7221cf8425e790ab770574e843c8b1dc7111665b013c28e6893"}
Jul 27 22:28:06.201791 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:06.201767    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq" event={"ID":"d6a8442e-7ef0-4f1d-a27e-5a61fd512a39","Type":"ContainerStarted","Data":"ec3d89db9d69ace3b2ab89c79b1e8ac5273128f7a1254e2058f235f40ad56e93"}
Jul 27 22:28:06.219716 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:06.219666    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq" podStartSLOduration=1.219650466 podStartE2EDuration="1.219650466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:28:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:28:06.218696107 +0000 UTC m=+3237.936102588" watchObservedRunningTime="2026-07-27 22:28:06.219650466 +0000 UTC m=+3237.937056987"
Jul 27 22:28:07.207881 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:07.207844    2554 generic.go:356] "Generic (PLEG): container finished" podID="d6a8442e-7ef0-4f1d-a27e-5a61fd512a39" containerID="f313b3798f1ea7221cf8425e790ab770574e843c8b1dc7111665b013c28e6893" exitCode=0
Jul 27 22:28:07.208284 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:07.207896    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq" event={"ID":"d6a8442e-7ef0-4f1d-a27e-5a61fd512a39","Type":"ContainerDied","Data":"f313b3798f1ea7221cf8425e790ab770574e843c8b1dc7111665b013c28e6893"}
Jul 27 22:28:08.356875 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:08.356849    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"
Jul 27 22:28:08.462939 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:08.462910    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a8442e-7ef0-4f1d-a27e-5a61fd512a39-maas-api-service-ca\") pod \"d6a8442e-7ef0-4f1d-a27e-5a61fd512a39\" (UID: \"d6a8442e-7ef0-4f1d-a27e-5a61fd512a39\") "
Jul 27 22:28:08.463288 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:08.463265    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a8442e-7ef0-4f1d-a27e-5a61fd512a39-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d6a8442e-7ef0-4f1d-a27e-5a61fd512a39" (UID: "d6a8442e-7ef0-4f1d-a27e-5a61fd512a39"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:28:08.563724 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:08.563639    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a8442e-7ef0-4f1d-a27e-5a61fd512a39-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:09.219900 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:09.219866    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"
Jul 27 22:28:09.220070 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:09.219868    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq" event={"ID":"d6a8442e-7ef0-4f1d-a27e-5a61fd512a39","Type":"ContainerDied","Data":"ec3d89db9d69ace3b2ab89c79b1e8ac5273128f7a1254e2058f235f40ad56e93"}
Jul 27 22:28:09.220070 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:09.219993    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec3d89db9d69ace3b2ab89c79b1e8ac5273128f7a1254e2058f235f40ad56e93"
Jul 27 22:28:12.718285 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:12.718254    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"]
Jul 27 22:28:12.718843 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:12.718541    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t" podUID="51c8ead6-bc4d-49f0-aa56-07659a9a3750" containerName="payload-processing" containerID="cri-o://76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489" gracePeriod=30
Jul 27 22:28:12.727204 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:12.727176    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"]
Jul 27 22:28:12.727572 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:12.727544    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj" podUID="9edaf225-4345-45b9-8ef8-393d98cf59c1" containerName="payload-pre-processing" containerID="cri-o://1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c" gracePeriod=30
Jul 27 22:28:12.860743 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:12.860703    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj" podUID="9edaf225-4345-45b9-8ef8-393d98cf59c1" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.81:9004: connect: connection refused"
Jul 27 22:28:12.860917 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:12.860703    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t" podUID="51c8ead6-bc4d-49f0-aa56-07659a9a3750" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.82:9004: connect: connection refused"
Jul 27 22:28:13.002031 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.002005    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:28:13.029054 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.029025    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:28:13.103733 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.103699    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc7x9\" (UniqueName: \"kubernetes.io/projected/9edaf225-4345-45b9-8ef8-393d98cf59c1-kube-api-access-qc7x9\") pod \"9edaf225-4345-45b9-8ef8-393d98cf59c1\" (UID: \"9edaf225-4345-45b9-8ef8-393d98cf59c1\") "
Jul 27 22:28:13.103909 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.103760    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9edaf225-4345-45b9-8ef8-393d98cf59c1-plugins-config-volume\") pod \"9edaf225-4345-45b9-8ef8-393d98cf59c1\" (UID: \"9edaf225-4345-45b9-8ef8-393d98cf59c1\") "
Jul 27 22:28:13.103909 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.103813    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51c8ead6-bc4d-49f0-aa56-07659a9a3750-plugins-config-volume\") pod \"51c8ead6-bc4d-49f0-aa56-07659a9a3750\" (UID: \"51c8ead6-bc4d-49f0-aa56-07659a9a3750\") "
Jul 27 22:28:13.103909 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.103883    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dt2v\" (UniqueName: \"kubernetes.io/projected/51c8ead6-bc4d-49f0-aa56-07659a9a3750-kube-api-access-8dt2v\") pod \"51c8ead6-bc4d-49f0-aa56-07659a9a3750\" (UID: \"51c8ead6-bc4d-49f0-aa56-07659a9a3750\") "
Jul 27 22:28:13.104226 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.104189    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9edaf225-4345-45b9-8ef8-393d98cf59c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9edaf225-4345-45b9-8ef8-393d98cf59c1" (UID: "9edaf225-4345-45b9-8ef8-393d98cf59c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:28:13.104355 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.104227    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51c8ead6-bc4d-49f0-aa56-07659a9a3750-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "51c8ead6-bc4d-49f0-aa56-07659a9a3750" (UID: "51c8ead6-bc4d-49f0-aa56-07659a9a3750"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:28:13.105897 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.105874    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9edaf225-4345-45b9-8ef8-393d98cf59c1-kube-api-access-qc7x9" (OuterVolumeSpecName: "kube-api-access-qc7x9") pod "9edaf225-4345-45b9-8ef8-393d98cf59c1" (UID: "9edaf225-4345-45b9-8ef8-393d98cf59c1"). InnerVolumeSpecName "kube-api-access-qc7x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:28:13.106053 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.106034    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c8ead6-bc4d-49f0-aa56-07659a9a3750-kube-api-access-8dt2v" (OuterVolumeSpecName: "kube-api-access-8dt2v") pod "51c8ead6-bc4d-49f0-aa56-07659a9a3750" (UID: "51c8ead6-bc4d-49f0-aa56-07659a9a3750"). InnerVolumeSpecName "kube-api-access-8dt2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:28:13.127953 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.127924    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"]
Jul 27 22:28:13.135269 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.135242    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-54963f-d6nxq"]
Jul 27 22:28:13.205427 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.205393    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dt2v\" (UniqueName: \"kubernetes.io/projected/51c8ead6-bc4d-49f0-aa56-07659a9a3750-kube-api-access-8dt2v\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:13.205427 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.205422    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc7x9\" (UniqueName: \"kubernetes.io/projected/9edaf225-4345-45b9-8ef8-393d98cf59c1-kube-api-access-qc7x9\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:13.205645 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.205456    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9edaf225-4345-45b9-8ef8-393d98cf59c1-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:13.205645 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.205465    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51c8ead6-bc4d-49f0-aa56-07659a9a3750-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:13.242121 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.242033    2554 generic.go:356] "Generic (PLEG): container finished" podID="51c8ead6-bc4d-49f0-aa56-07659a9a3750" containerID="76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489" exitCode=0
Jul 27 22:28:13.242121 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.242078    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"
Jul 27 22:28:13.242332 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.242135    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t" event={"ID":"51c8ead6-bc4d-49f0-aa56-07659a9a3750","Type":"ContainerDied","Data":"76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489"}
Jul 27 22:28:13.242332 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.242200    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t" event={"ID":"51c8ead6-bc4d-49f0-aa56-07659a9a3750","Type":"ContainerDied","Data":"fc549322efd7992a7d466444c62c410cc26a53a3edcc74094bba752403ab002b"}
Jul 27 22:28:13.242332 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.242233    2554 scope.go:117] "RemoveContainer" containerID="76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489"
Jul 27 22:28:13.243609 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.243588    2554 generic.go:356] "Generic (PLEG): container finished" podID="9edaf225-4345-45b9-8ef8-393d98cf59c1" containerID="1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c" exitCode=0
Jul 27 22:28:13.243765 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.243636    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"
Jul 27 22:28:13.243765 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.243657    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj" event={"ID":"9edaf225-4345-45b9-8ef8-393d98cf59c1","Type":"ContainerDied","Data":"1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c"}
Jul 27 22:28:13.243765 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.243712    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj" event={"ID":"9edaf225-4345-45b9-8ef8-393d98cf59c1","Type":"ContainerDied","Data":"8fa3638fcfbf74108c1e6fa50ae4bed3b2112d2b8c436e1e7534421e70517e61"}
Jul 27 22:28:13.252989 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.252966    2554 scope.go:117] "RemoveContainer" containerID="76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489"
Jul 27 22:28:13.253279 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:28:13.253261    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489\": container with ID starting with 76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489 not found: ID does not exist" containerID="76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489"
Jul 27 22:28:13.253347 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.253287    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489"} err="failed to get container status \"76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489\": rpc error: code = NotFound desc = could not find container \"76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489\": container with ID starting with 76080eddaf066f930a06da69fb00a45174b2e6e5107b545fbc439004bf330489 not found: ID does not exist"
Jul 27 22:28:13.253347 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.253305    2554 scope.go:117] "RemoveContainer" containerID="1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c"
Jul 27 22:28:13.261793 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.261776    2554 scope.go:117] "RemoveContainer" containerID="1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c"
Jul 27 22:28:13.262026 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:28:13.262012    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c\": container with ID starting with 1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c not found: ID does not exist" containerID="1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c"
Jul 27 22:28:13.262072 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.262040    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c"} err="failed to get container status \"1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c\": rpc error: code = NotFound desc = could not find container \"1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c\": container with ID starting with 1177e597f209369410120b6cb10712fe73a820c7c526ceee1b25cc3d7e40448c not found: ID does not exist"
Jul 27 22:28:13.275152 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.275123    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"]
Jul 27 22:28:13.277097 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.277078    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-54963f-66bdbcdb96-xvjtj"]
Jul 27 22:28:13.290915 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.290888    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"]
Jul 27 22:28:13.293258 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:13.293235    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-54963f-c77d54486-q9f4t"]
Jul 27 22:28:14.925351 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:14.925313    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51c8ead6-bc4d-49f0-aa56-07659a9a3750" path="/var/lib/kubelet/pods/51c8ead6-bc4d-49f0-aa56-07659a9a3750/volumes"
Jul 27 22:28:14.925739 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:14.925694    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9edaf225-4345-45b9-8ef8-393d98cf59c1" path="/var/lib/kubelet/pods/9edaf225-4345-45b9-8ef8-393d98cf59c1/volumes"
Jul 27 22:28:14.925996 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:14.925983    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a8442e-7ef0-4f1d-a27e-5a61fd512a39" path="/var/lib/kubelet/pods/d6a8442e-7ef0-4f1d-a27e-5a61fd512a39/volumes"
Jul 27 22:28:21.391031 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.390974    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"]
Jul 27 22:28:21.391658 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.391636    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9edaf225-4345-45b9-8ef8-393d98cf59c1" containerName="payload-pre-processing"
Jul 27 22:28:21.391658 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.391660    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9edaf225-4345-45b9-8ef8-393d98cf59c1" containerName="payload-pre-processing"
Jul 27 22:28:21.391871 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.391680    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c8ead6-bc4d-49f0-aa56-07659a9a3750" containerName="payload-processing"
Jul 27 22:28:21.391871 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.391690    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c8ead6-bc4d-49f0-aa56-07659a9a3750" containerName="payload-processing"
Jul 27 22:28:21.391871 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.391701    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a8442e-7ef0-4f1d-a27e-5a61fd512a39" containerName="revoke-keys"
Jul 27 22:28:21.391871 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.391713    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a8442e-7ef0-4f1d-a27e-5a61fd512a39" containerName="revoke-keys"
Jul 27 22:28:21.391871 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.391842    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="51c8ead6-bc4d-49f0-aa56-07659a9a3750" containerName="payload-processing"
Jul 27 22:28:21.391871 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.391856    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9edaf225-4345-45b9-8ef8-393d98cf59c1" containerName="payload-pre-processing"
Jul 27 22:28:21.391871 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.391869    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a8442e-7ef0-4f1d-a27e-5a61fd512a39" containerName="revoke-keys"
Jul 27 22:28:21.399201 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.396460    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"
Jul 27 22:28:21.399682 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.399652    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:28:21.399845 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.399676    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:28:21.404160 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.404139    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"]
Jul 27 22:28:21.487766 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.487727    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4111aa51-e387-41b1-958c-bc1329cdea18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn\" (UID: \"4111aa51-e387-41b1-958c-bc1329cdea18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"
Jul 27 22:28:21.588864 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.588832    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4111aa51-e387-41b1-958c-bc1329cdea18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn\" (UID: \"4111aa51-e387-41b1-958c-bc1329cdea18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"
Jul 27 22:28:21.589484 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.589430    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4111aa51-e387-41b1-958c-bc1329cdea18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn\" (UID: \"4111aa51-e387-41b1-958c-bc1329cdea18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"
Jul 27 22:28:21.710227 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.710136    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"
Jul 27 22:28:21.857504 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:21.857480    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"]
Jul 27 22:28:21.859926 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:28:21.859894    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4111aa51_e387_41b1_958c_bc1329cdea18.slice/crio-dd152b51509e91c9bf8259856a3e885955823b9c86bb66a13cc6eb43c867269f WatchSource:0}: Error finding container dd152b51509e91c9bf8259856a3e885955823b9c86bb66a13cc6eb43c867269f: Status 404 returned error can't find the container with id dd152b51509e91c9bf8259856a3e885955823b9c86bb66a13cc6eb43c867269f
Jul 27 22:28:22.300600 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:22.300565    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn" event={"ID":"4111aa51-e387-41b1-958c-bc1329cdea18","Type":"ContainerStarted","Data":"fee3f898d6f8e8b7cc140ad5b91150ca2c3f99c5ca27f2e00a7d95b189f75d2a"}
Jul 27 22:28:22.300783 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:22.300620    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn" event={"ID":"4111aa51-e387-41b1-958c-bc1329cdea18","Type":"ContainerStarted","Data":"dd152b51509e91c9bf8259856a3e885955823b9c86bb66a13cc6eb43c867269f"}
Jul 27 22:28:22.322678 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:22.322630    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn" podStartSLOduration=1.322614555 podStartE2EDuration="1.322614555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:28:22.321822578 +0000 UTC m=+3254.039229059" watchObservedRunningTime="2026-07-27 22:28:22.322614555 +0000 UTC m=+3254.040021078"
Jul 27 22:28:23.307828 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:23.307788    2554 generic.go:356] "Generic (PLEG): container finished" podID="4111aa51-e387-41b1-958c-bc1329cdea18" containerID="fee3f898d6f8e8b7cc140ad5b91150ca2c3f99c5ca27f2e00a7d95b189f75d2a" exitCode=0
Jul 27 22:28:23.308310 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:23.307885    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn" event={"ID":"4111aa51-e387-41b1-958c-bc1329cdea18","Type":"ContainerDied","Data":"fee3f898d6f8e8b7cc140ad5b91150ca2c3f99c5ca27f2e00a7d95b189f75d2a"}
Jul 27 22:28:24.456995 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:24.456967    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"
Jul 27 22:28:24.621064 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:24.620985    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4111aa51-e387-41b1-958c-bc1329cdea18-maas-api-service-ca\") pod \"4111aa51-e387-41b1-958c-bc1329cdea18\" (UID: \"4111aa51-e387-41b1-958c-bc1329cdea18\") "
Jul 27 22:28:24.621369 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:24.621350    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4111aa51-e387-41b1-958c-bc1329cdea18-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4111aa51-e387-41b1-958c-bc1329cdea18" (UID: "4111aa51-e387-41b1-958c-bc1329cdea18"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:28:24.722662 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:24.722622    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4111aa51-e387-41b1-958c-bc1329cdea18-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:25.320104 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:25.320062    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"
Jul 27 22:28:25.320104 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:25.320094    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn" event={"ID":"4111aa51-e387-41b1-958c-bc1329cdea18","Type":"ContainerDied","Data":"dd152b51509e91c9bf8259856a3e885955823b9c86bb66a13cc6eb43c867269f"}
Jul 27 22:28:25.320359 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:25.320139    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd152b51509e91c9bf8259856a3e885955823b9c86bb66a13cc6eb43c867269f"
Jul 27 22:28:27.712456 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:27.712397    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv"]
Jul 27 22:28:27.715068 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:27.715039    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-94450e-29753175-rmjrv"]
Jul 27 22:28:27.750190 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:27.750151    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"]
Jul 27 22:28:27.750501 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:27.750464    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h" podUID="86456d2a-fd90-4c1c-90a9-85ee18b21838" containerName="payload-processing" containerID="cri-o://f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527" gracePeriod=30
Jul 27 22:28:27.763262 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:27.763235    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"]
Jul 27 22:28:27.763531 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:27.763479    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk" podUID="3578d558-b13a-4b1f-8912-f7897c040a41" containerName="payload-pre-processing" containerID="cri-o://740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93" gracePeriod=30
Jul 27 22:28:27.998362 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:27.998332    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"]
Jul 27 22:28:28.002115 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.002090    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-94450e-5x9gn"]
Jul 27 22:28:28.028616 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.028590    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:28:28.055095 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.055067    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:28:28.155417 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.155384    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gj6k\" (UniqueName: \"kubernetes.io/projected/3578d558-b13a-4b1f-8912-f7897c040a41-kube-api-access-7gj6k\") pod \"3578d558-b13a-4b1f-8912-f7897c040a41\" (UID: \"3578d558-b13a-4b1f-8912-f7897c040a41\") "
Jul 27 22:28:28.155417 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.155419    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86456d2a-fd90-4c1c-90a9-85ee18b21838-plugins-config-volume\") pod \"86456d2a-fd90-4c1c-90a9-85ee18b21838\" (UID: \"86456d2a-fd90-4c1c-90a9-85ee18b21838\") "
Jul 27 22:28:28.155712 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.155482    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts4fm\" (UniqueName: \"kubernetes.io/projected/86456d2a-fd90-4c1c-90a9-85ee18b21838-kube-api-access-ts4fm\") pod \"86456d2a-fd90-4c1c-90a9-85ee18b21838\" (UID: \"86456d2a-fd90-4c1c-90a9-85ee18b21838\") "
Jul 27 22:28:28.155712 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.155512    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3578d558-b13a-4b1f-8912-f7897c040a41-plugins-config-volume\") pod \"3578d558-b13a-4b1f-8912-f7897c040a41\" (UID: \"3578d558-b13a-4b1f-8912-f7897c040a41\") "
Jul 27 22:28:28.155898 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.155875    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86456d2a-fd90-4c1c-90a9-85ee18b21838-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86456d2a-fd90-4c1c-90a9-85ee18b21838" (UID: "86456d2a-fd90-4c1c-90a9-85ee18b21838"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:28:28.155963 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.155878    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3578d558-b13a-4b1f-8912-f7897c040a41-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3578d558-b13a-4b1f-8912-f7897c040a41" (UID: "3578d558-b13a-4b1f-8912-f7897c040a41"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:28:28.157714 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.157690    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3578d558-b13a-4b1f-8912-f7897c040a41-kube-api-access-7gj6k" (OuterVolumeSpecName: "kube-api-access-7gj6k") pod "3578d558-b13a-4b1f-8912-f7897c040a41" (UID: "3578d558-b13a-4b1f-8912-f7897c040a41"). InnerVolumeSpecName "kube-api-access-7gj6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:28:28.157803 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.157720    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86456d2a-fd90-4c1c-90a9-85ee18b21838-kube-api-access-ts4fm" (OuterVolumeSpecName: "kube-api-access-ts4fm") pod "86456d2a-fd90-4c1c-90a9-85ee18b21838" (UID: "86456d2a-fd90-4c1c-90a9-85ee18b21838"). InnerVolumeSpecName "kube-api-access-ts4fm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:28:28.257034 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.256950    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gj6k\" (UniqueName: \"kubernetes.io/projected/3578d558-b13a-4b1f-8912-f7897c040a41-kube-api-access-7gj6k\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:28.257034 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.256982    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86456d2a-fd90-4c1c-90a9-85ee18b21838-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:28.257034 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.256991    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts4fm\" (UniqueName: \"kubernetes.io/projected/86456d2a-fd90-4c1c-90a9-85ee18b21838-kube-api-access-ts4fm\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:28.257034 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.256999    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3578d558-b13a-4b1f-8912-f7897c040a41-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:28.337527 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.337493    2554 generic.go:356] "Generic (PLEG): container finished" podID="86456d2a-fd90-4c1c-90a9-85ee18b21838" containerID="f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527" exitCode=0
Jul 27 22:28:28.337690 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.337551    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"
Jul 27 22:28:28.337690 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.337583    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h" event={"ID":"86456d2a-fd90-4c1c-90a9-85ee18b21838","Type":"ContainerDied","Data":"f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527"}
Jul 27 22:28:28.337690 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.337636    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h" event={"ID":"86456d2a-fd90-4c1c-90a9-85ee18b21838","Type":"ContainerDied","Data":"eba8bded1a16c98738621d31030f0dfb407b9bf9a68018c17f1246f248525141"}
Jul 27 22:28:28.337690 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.337668    2554 scope.go:117] "RemoveContainer" containerID="f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527"
Jul 27 22:28:28.339675 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.339647    2554 generic.go:356] "Generic (PLEG): container finished" podID="3578d558-b13a-4b1f-8912-f7897c040a41" containerID="740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93" exitCode=0
Jul 27 22:28:28.339787 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.339700    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"
Jul 27 22:28:28.339787 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.339712    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk" event={"ID":"3578d558-b13a-4b1f-8912-f7897c040a41","Type":"ContainerDied","Data":"740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93"}
Jul 27 22:28:28.339787 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.339758    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk" event={"ID":"3578d558-b13a-4b1f-8912-f7897c040a41","Type":"ContainerDied","Data":"b3e4a71a8b7805e412e28afe6b837e5f9b9ac7672eb836ff02df5949bd429e7c"}
Jul 27 22:28:28.346901 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.346882    2554 scope.go:117] "RemoveContainer" containerID="f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527"
Jul 27 22:28:28.347261 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:28:28.347240    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527\": container with ID starting with f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527 not found: ID does not exist" containerID="f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527"
Jul 27 22:28:28.347364 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.347270    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527"} err="failed to get container status \"f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527\": rpc error: code = NotFound desc = could not find container \"f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527\": container with ID starting with f7bc95018ff0987534d9a5ce6d324c533543dd4b8c6f1e18affb14aa7cc67527 not found: ID does not exist"
Jul 27 22:28:28.347364 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.347288    2554 scope.go:117] "RemoveContainer" containerID="740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93"
Jul 27 22:28:28.356643 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.356625    2554 scope.go:117] "RemoveContainer" containerID="740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93"
Jul 27 22:28:28.356892 ip-10-0-136-223 kubenswrapper[2554]: E0727 22:28:28.356877    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93\": container with ID starting with 740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93 not found: ID does not exist" containerID="740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93"
Jul 27 22:28:28.356930 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.356900    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93"} err="failed to get container status \"740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93\": rpc error: code = NotFound desc = could not find container \"740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93\": container with ID starting with 740280ee3fc890c8227f92deb646381284c258c3226b6e53115d3ae6d57bde93 not found: ID does not exist"
Jul 27 22:28:28.369039 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.369017    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"]
Jul 27 22:28:28.372192 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.372172    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-94450e-748bf89976-nhhmk"]
Jul 27 22:28:28.399018 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.398972    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"]
Jul 27 22:28:28.407448 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.407410    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-94450e-7cdb9d7ddb-8zp8h"]
Jul 27 22:28:28.921508 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.921473    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3578d558-b13a-4b1f-8912-f7897c040a41" path="/var/lib/kubelet/pods/3578d558-b13a-4b1f-8912-f7897c040a41/volumes"
Jul 27 22:28:28.921847 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.921831    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4111aa51-e387-41b1-958c-bc1329cdea18" path="/var/lib/kubelet/pods/4111aa51-e387-41b1-958c-bc1329cdea18/volumes"
Jul 27 22:28:28.922064 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.922051    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="652c2502-3dc3-4dad-983a-2376df97d22d" path="/var/lib/kubelet/pods/652c2502-3dc3-4dad-983a-2376df97d22d/volumes"
Jul 27 22:28:28.922336 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:28.922325    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86456d2a-fd90-4c1c-90a9-85ee18b21838" path="/var/lib/kubelet/pods/86456d2a-fd90-4c1c-90a9-85ee18b21838/volumes"
Jul 27 22:28:35.964086 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.964039    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"]
Jul 27 22:28:35.964533 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.964519    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4111aa51-e387-41b1-958c-bc1329cdea18" containerName="revoke-keys"
Jul 27 22:28:35.964592 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.964535    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4111aa51-e387-41b1-958c-bc1329cdea18" containerName="revoke-keys"
Jul 27 22:28:35.964592 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.964548    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3578d558-b13a-4b1f-8912-f7897c040a41" containerName="payload-pre-processing"
Jul 27 22:28:35.964592 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.964554    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3578d558-b13a-4b1f-8912-f7897c040a41" containerName="payload-pre-processing"
Jul 27 22:28:35.964592 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.964564    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86456d2a-fd90-4c1c-90a9-85ee18b21838" containerName="payload-processing"
Jul 27 22:28:35.964592 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.964570    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="86456d2a-fd90-4c1c-90a9-85ee18b21838" containerName="payload-processing"
Jul 27 22:28:35.964737 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.964642    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="86456d2a-fd90-4c1c-90a9-85ee18b21838" containerName="payload-processing"
Jul 27 22:28:35.964737 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.964653    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4111aa51-e387-41b1-958c-bc1329cdea18" containerName="revoke-keys"
Jul 27 22:28:35.964737 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.964662    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3578d558-b13a-4b1f-8912-f7897c040a41" containerName="payload-pre-processing"
Jul 27 22:28:35.969162 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.969142    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"
Jul 27 22:28:35.977622 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.977605    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 22:28:35.977723 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.977605    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hxwpp\""
Jul 27 22:28:35.993799 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:35.993770    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"]
Jul 27 22:28:36.031048 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:36.031007    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca449516-2e0b-4af3-bf92-ae1840c59e47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6\" (UID: \"ca449516-2e0b-4af3-bf92-ae1840c59e47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"
Jul 27 22:28:36.131817 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:36.131780    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca449516-2e0b-4af3-bf92-ae1840c59e47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6\" (UID: \"ca449516-2e0b-4af3-bf92-ae1840c59e47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"
Jul 27 22:28:36.132460 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:36.132410    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca449516-2e0b-4af3-bf92-ae1840c59e47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6\" (UID: \"ca449516-2e0b-4af3-bf92-ae1840c59e47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"
Jul 27 22:28:36.279576 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:36.279490    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"
Jul 27 22:28:36.427341 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:36.427314    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"]
Jul 27 22:28:36.428732 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:28:36.428709    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca449516_2e0b_4af3_bf92_ae1840c59e47.slice/crio-055cbfe6243e22af9f75645a9629a40d2f2f400ca703c69d30fd5f6cc1dda093 WatchSource:0}: Error finding container 055cbfe6243e22af9f75645a9629a40d2f2f400ca703c69d30fd5f6cc1dda093: Status 404 returned error can't find the container with id 055cbfe6243e22af9f75645a9629a40d2f2f400ca703c69d30fd5f6cc1dda093
Jul 27 22:28:37.398777 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:37.398737    2554 generic.go:356] "Generic (PLEG): container finished" podID="ca449516-2e0b-4af3-bf92-ae1840c59e47" containerID="d0d803825a63c8d5f892e9bc788c87dbab77d949d67daa77556febcefb4a5cb4" exitCode=0
Jul 27 22:28:37.399184 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:37.398824    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6" event={"ID":"ca449516-2e0b-4af3-bf92-ae1840c59e47","Type":"ContainerDied","Data":"d0d803825a63c8d5f892e9bc788c87dbab77d949d67daa77556febcefb4a5cb4"}
Jul 27 22:28:37.399184 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:37.398882    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6" event={"ID":"ca449516-2e0b-4af3-bf92-ae1840c59e47","Type":"ContainerStarted","Data":"055cbfe6243e22af9f75645a9629a40d2f2f400ca703c69d30fd5f6cc1dda093"}
Jul 27 22:28:38.541685 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:38.541661    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"
Jul 27 22:28:38.556270 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:38.556243    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca449516-2e0b-4af3-bf92-ae1840c59e47-maas-api-service-ca\") pod \"ca449516-2e0b-4af3-bf92-ae1840c59e47\" (UID: \"ca449516-2e0b-4af3-bf92-ae1840c59e47\") "
Jul 27 22:28:38.556603 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:38.556582    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca449516-2e0b-4af3-bf92-ae1840c59e47-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ca449516-2e0b-4af3-bf92-ae1840c59e47" (UID: "ca449516-2e0b-4af3-bf92-ae1840c59e47"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:28:38.658621 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:38.658534    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca449516-2e0b-4af3-bf92-ae1840c59e47-maas-api-service-ca\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:39.410592 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:39.410552    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6" event={"ID":"ca449516-2e0b-4af3-bf92-ae1840c59e47","Type":"ContainerDied","Data":"055cbfe6243e22af9f75645a9629a40d2f2f400ca703c69d30fd5f6cc1dda093"}
Jul 27 22:28:39.410776 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:39.410603    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="055cbfe6243e22af9f75645a9629a40d2f2f400ca703c69d30fd5f6cc1dda093"
Jul 27 22:28:39.410776 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:39.410564    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"
Jul 27 22:28:41.200304 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.200266    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st"]
Jul 27 22:28:41.204161 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.204122    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0cb892-29753175-vn8st"]
Jul 27 22:28:41.226175 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.226131    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"]
Jul 27 22:28:41.226462 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.226388    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg" podUID="6ef42c5a-4b53-4cbb-b774-e94fabc02be6" containerName="payload-processing" containerID="cri-o://fde935198f8c72d87287b17ca7e4dda07afa629517e9741cbae162b482880e8a" gracePeriod=30
Jul 27 22:28:41.237021 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.236990    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"]
Jul 27 22:28:41.237682 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.237239    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z" podUID="1d5e6177-65fb-41e2-aa4f-e7361b2f442d" containerName="payload-pre-processing" containerID="cri-o://5184e4755643014984a4515a5ceef84a8d2b4e77017bd7246ef21f24934659f3" gracePeriod=30
Jul 27 22:28:41.424826 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.424794    2554 generic.go:356] "Generic (PLEG): container finished" podID="1d5e6177-65fb-41e2-aa4f-e7361b2f442d" containerID="5184e4755643014984a4515a5ceef84a8d2b4e77017bd7246ef21f24934659f3" exitCode=0
Jul 27 22:28:41.424973 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.424867    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z" event={"ID":"1d5e6177-65fb-41e2-aa4f-e7361b2f442d","Type":"ContainerDied","Data":"5184e4755643014984a4515a5ceef84a8d2b4e77017bd7246ef21f24934659f3"}
Jul 27 22:28:41.426550 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.426417    2554 generic.go:356] "Generic (PLEG): container finished" podID="6ef42c5a-4b53-4cbb-b774-e94fabc02be6" containerID="fde935198f8c72d87287b17ca7e4dda07afa629517e9741cbae162b482880e8a" exitCode=0
Jul 27 22:28:41.426550 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.426501    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg" event={"ID":"6ef42c5a-4b53-4cbb-b774-e94fabc02be6","Type":"ContainerDied","Data":"fde935198f8c72d87287b17ca7e4dda07afa629517e9741cbae162b482880e8a"}
Jul 27 22:28:41.483342 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.483298    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"]
Jul 27 22:28:41.486687 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.486656    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0cb892-5lnh6"]
Jul 27 22:28:41.516719 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.516698    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:28:41.519607 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.519580    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:28:41.586238 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.586211    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jszbz\" (UniqueName: \"kubernetes.io/projected/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-kube-api-access-jszbz\") pod \"6ef42c5a-4b53-4cbb-b774-e94fabc02be6\" (UID: \"6ef42c5a-4b53-4cbb-b774-e94fabc02be6\") "
Jul 27 22:28:41.586396 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.586288    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88g88\" (UniqueName: \"kubernetes.io/projected/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-kube-api-access-88g88\") pod \"1d5e6177-65fb-41e2-aa4f-e7361b2f442d\" (UID: \"1d5e6177-65fb-41e2-aa4f-e7361b2f442d\") "
Jul 27 22:28:41.586396 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.586335    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-plugins-config-volume\") pod \"1d5e6177-65fb-41e2-aa4f-e7361b2f442d\" (UID: \"1d5e6177-65fb-41e2-aa4f-e7361b2f442d\") "
Jul 27 22:28:41.586396 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.586357    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-plugins-config-volume\") pod \"6ef42c5a-4b53-4cbb-b774-e94fabc02be6\" (UID: \"6ef42c5a-4b53-4cbb-b774-e94fabc02be6\") "
Jul 27 22:28:41.586748 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.586718    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d5e6177-65fb-41e2-aa4f-e7361b2f442d" (UID: "1d5e6177-65fb-41e2-aa4f-e7361b2f442d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:28:41.586748 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.586731    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ef42c5a-4b53-4cbb-b774-e94fabc02be6" (UID: "6ef42c5a-4b53-4cbb-b774-e94fabc02be6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 22:28:41.588508 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.588474    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-kube-api-access-88g88" (OuterVolumeSpecName: "kube-api-access-88g88") pod "1d5e6177-65fb-41e2-aa4f-e7361b2f442d" (UID: "1d5e6177-65fb-41e2-aa4f-e7361b2f442d"). InnerVolumeSpecName "kube-api-access-88g88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:28:41.588616 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.588564    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-kube-api-access-jszbz" (OuterVolumeSpecName: "kube-api-access-jszbz") pod "6ef42c5a-4b53-4cbb-b774-e94fabc02be6" (UID: "6ef42c5a-4b53-4cbb-b774-e94fabc02be6"). InnerVolumeSpecName "kube-api-access-jszbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 22:28:41.688041 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.688002    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:41.688041 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.688034    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-plugins-config-volume\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:41.688041 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.688045    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jszbz\" (UniqueName: \"kubernetes.io/projected/6ef42c5a-4b53-4cbb-b774-e94fabc02be6-kube-api-access-jszbz\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:41.688302 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:41.688054    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88g88\" (UniqueName: \"kubernetes.io/projected/1d5e6177-65fb-41e2-aa4f-e7361b2f442d-kube-api-access-88g88\") on node \"ip-10-0-136-223.ec2.internal\" DevicePath \"\""
Jul 27 22:28:42.433202 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.433169    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"
Jul 27 22:28:42.433694 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.433168    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z" event={"ID":"1d5e6177-65fb-41e2-aa4f-e7361b2f442d","Type":"ContainerDied","Data":"8ea3050df60ebf4d899da5689609c5c78f8ec5bf76df95b27c791dcd1400c817"}
Jul 27 22:28:42.433694 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.433352    2554 scope.go:117] "RemoveContainer" containerID="5184e4755643014984a4515a5ceef84a8d2b4e77017bd7246ef21f24934659f3"
Jul 27 22:28:42.434893 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.434866    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg" event={"ID":"6ef42c5a-4b53-4cbb-b774-e94fabc02be6","Type":"ContainerDied","Data":"c5803af1a791345be27f0f118239d9628862424e362861067cf4935620df3fe5"}
Jul 27 22:28:42.435034 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.434897    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"
Jul 27 22:28:42.444650 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.444571    2554 scope.go:117] "RemoveContainer" containerID="fde935198f8c72d87287b17ca7e4dda07afa629517e9741cbae162b482880e8a"
Jul 27 22:28:42.463938 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.463903    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"]
Jul 27 22:28:42.468148 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.468123    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-0cb892-6f55d5c5db-djmpg"]
Jul 27 22:28:42.482947 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.482918    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"]
Jul 27 22:28:42.490754 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.490731    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-0cb892-574848448d-dmn9z"]
Jul 27 22:28:42.920911 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.920877    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15f43ce9-b27b-4050-9ff8-da89b4eb4ecc" path="/var/lib/kubelet/pods/15f43ce9-b27b-4050-9ff8-da89b4eb4ecc/volumes"
Jul 27 22:28:42.921205 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.921193    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d5e6177-65fb-41e2-aa4f-e7361b2f442d" path="/var/lib/kubelet/pods/1d5e6177-65fb-41e2-aa4f-e7361b2f442d/volumes"
Jul 27 22:28:42.921531 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.921518    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ef42c5a-4b53-4cbb-b774-e94fabc02be6" path="/var/lib/kubelet/pods/6ef42c5a-4b53-4cbb-b774-e94fabc02be6/volumes"
Jul 27 22:28:42.921795 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:42.921783    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca449516-2e0b-4af3-bf92-ae1840c59e47" path="/var/lib/kubelet/pods/ca449516-2e0b-4af3-bf92-ae1840c59e47/volumes"
Jul 27 22:28:49.169046 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:49.169003    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8766b45b-vzw5q_5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8/authorino/0.log"
Jul 27 22:28:55.628232 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:55.628202    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d57c545b5-svjgb_9c86c811-ce7b-4d16-9ebd-9d777dca1884/copy-manifests/0.log"
Jul 27 22:28:55.637544 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:55.637523    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d57c545b5-svjgb_9c86c811-ce7b-4d16-9ebd-9d777dca1884/manager/0.log"
Jul 27 22:28:56.345789 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:56.345757    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753175-92ttf_2693c67e-a006-406a-a5f8-66209e753c4c/cleanup/0.log"
Jul 27 22:28:57.787153 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:57.787123    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8766b45b-vzw5q_5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8/authorino/0.log"
Jul 27 22:28:58.386732 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:58.386697    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-v6ns2_eefea127-b6ea-4928-b497-8c0851d18c96/manager/0.log"
Jul 27 22:28:59.342361 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:59.342333    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd65f9cdf-rqfcx_19410132-3b17-46cd-bc3e-f4961cee6315/kube-auth-proxy/0.log"
Jul 27 22:28:59.586682 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:28:59.586641    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-rpm4j_eae449a6-8f51-4162-8645-2809579ef364/payload-pre-processing/0.log"
Jul 27 22:29:00.192667 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:00.192640    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-k8cmm_d69f0c13-40c6-4c19-94f0-bb8862f91b20/main/0.log"
Jul 27 22:29:00.544988 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:00.544958    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxf8w9_0a6cc990-f32c-4881-8f9e-3ae5ff691d40/main/0.log"
Jul 27 22:29:06.268088 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.268027    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j99rk/must-gather-5lmfh"]
Jul 27 22:29:06.268584 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.268564    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca449516-2e0b-4af3-bf92-ae1840c59e47" containerName="revoke-keys"
Jul 27 22:29:06.268632 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.268588    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca449516-2e0b-4af3-bf92-ae1840c59e47" containerName="revoke-keys"
Jul 27 22:29:06.268632 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.268600    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d5e6177-65fb-41e2-aa4f-e7361b2f442d" containerName="payload-pre-processing"
Jul 27 22:29:06.268632 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.268609    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d5e6177-65fb-41e2-aa4f-e7361b2f442d" containerName="payload-pre-processing"
Jul 27 22:29:06.268723 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.268643    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ef42c5a-4b53-4cbb-b774-e94fabc02be6" containerName="payload-processing"
Jul 27 22:29:06.268723 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.268653    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ef42c5a-4b53-4cbb-b774-e94fabc02be6" containerName="payload-processing"
Jul 27 22:29:06.268783 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.268764    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ef42c5a-4b53-4cbb-b774-e94fabc02be6" containerName="payload-processing"
Jul 27 22:29:06.268819 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.268782    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca449516-2e0b-4af3-bf92-ae1840c59e47" containerName="revoke-keys"
Jul 27 22:29:06.268819 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.268791    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d5e6177-65fb-41e2-aa4f-e7361b2f442d" containerName="payload-pre-processing"
Jul 27 22:29:06.272226 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.272208    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j99rk/must-gather-5lmfh"
Jul 27 22:29:06.274742 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.274719    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j99rk\"/\"openshift-service-ca.crt\""
Jul 27 22:29:06.275254 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.275239    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j99rk\"/\"default-dockercfg-f5phm\""
Jul 27 22:29:06.275599 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.275585    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j99rk\"/\"kube-root-ca.crt\""
Jul 27 22:29:06.284621 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.284600    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j99rk/must-gather-5lmfh"]
Jul 27 22:29:06.430254 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.430213    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq9gw\" (UniqueName: \"kubernetes.io/projected/9e70d1f7-6590-4a93-bc47-6cfda827c7cb-kube-api-access-xq9gw\") pod \"must-gather-5lmfh\" (UID: \"9e70d1f7-6590-4a93-bc47-6cfda827c7cb\") " pod="openshift-must-gather-j99rk/must-gather-5lmfh"
Jul 27 22:29:06.430254 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.430262    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9e70d1f7-6590-4a93-bc47-6cfda827c7cb-must-gather-output\") pod \"must-gather-5lmfh\" (UID: \"9e70d1f7-6590-4a93-bc47-6cfda827c7cb\") " pod="openshift-must-gather-j99rk/must-gather-5lmfh"
Jul 27 22:29:06.530980 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.530876    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq9gw\" (UniqueName: \"kubernetes.io/projected/9e70d1f7-6590-4a93-bc47-6cfda827c7cb-kube-api-access-xq9gw\") pod \"must-gather-5lmfh\" (UID: \"9e70d1f7-6590-4a93-bc47-6cfda827c7cb\") " pod="openshift-must-gather-j99rk/must-gather-5lmfh"
Jul 27 22:29:06.530980 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.530932    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9e70d1f7-6590-4a93-bc47-6cfda827c7cb-must-gather-output\") pod \"must-gather-5lmfh\" (UID: \"9e70d1f7-6590-4a93-bc47-6cfda827c7cb\") " pod="openshift-must-gather-j99rk/must-gather-5lmfh"
Jul 27 22:29:06.531305 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.531288    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9e70d1f7-6590-4a93-bc47-6cfda827c7cb-must-gather-output\") pod \"must-gather-5lmfh\" (UID: \"9e70d1f7-6590-4a93-bc47-6cfda827c7cb\") " pod="openshift-must-gather-j99rk/must-gather-5lmfh"
Jul 27 22:29:06.547826 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.547803    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq9gw\" (UniqueName: \"kubernetes.io/projected/9e70d1f7-6590-4a93-bc47-6cfda827c7cb-kube-api-access-xq9gw\") pod \"must-gather-5lmfh\" (UID: \"9e70d1f7-6590-4a93-bc47-6cfda827c7cb\") " pod="openshift-must-gather-j99rk/must-gather-5lmfh"
Jul 27 22:29:06.580580 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.580549    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j99rk/must-gather-5lmfh"
Jul 27 22:29:06.752140 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:06.752115    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j99rk/must-gather-5lmfh"]
Jul 27 22:29:06.754526 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:29:06.754500    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e70d1f7_6590_4a93_bc47_6cfda827c7cb.slice/crio-c039509f3253e894acb974ff42f26a91db394797827b6cd737f121433b931cdd WatchSource:0}: Error finding container c039509f3253e894acb974ff42f26a91db394797827b6cd737f121433b931cdd: Status 404 returned error can't find the container with id c039509f3253e894acb974ff42f26a91db394797827b6cd737f121433b931cdd
Jul 27 22:29:07.571468 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:07.571411    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j99rk/must-gather-5lmfh" event={"ID":"9e70d1f7-6590-4a93-bc47-6cfda827c7cb","Type":"ContainerStarted","Data":"c039509f3253e894acb974ff42f26a91db394797827b6cd737f121433b931cdd"}
Jul 27 22:29:08.579796 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:08.579695    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j99rk/must-gather-5lmfh" event={"ID":"9e70d1f7-6590-4a93-bc47-6cfda827c7cb","Type":"ContainerStarted","Data":"6de1bd4b096a00cbc3ad841ba6fe9013c95f365970a7b495c2df0dc6f389d632"}
Jul 27 22:29:08.579796 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:08.579760    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j99rk/must-gather-5lmfh" event={"ID":"9e70d1f7-6590-4a93-bc47-6cfda827c7cb","Type":"ContainerStarted","Data":"17c4a00ad1fe35327a5e1186068cf7581d9b34f2114ee1203cc14aacc884a68a"}
Jul 27 22:29:08.613267 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:08.613209    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j99rk/must-gather-5lmfh" podStartSLOduration=1.7518641050000001 podStartE2EDuration="2.613192108s" totalImagesPullingTime="861.328003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 22:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:29:08.607333269 +0000 UTC m=+3300.324739751" watchObservedRunningTime="2026-07-27 22:29:08.613192108 +0000 UTC m=+3300.330598634"
Jul 27 22:29:09.403320 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:09.403289    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rzszd_20a71333-87bf-440c-bec0-ad436ffe66f3/global-pull-secret-syncer/0.log"
Jul 27 22:29:09.415657 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:09.415626    2554 scope.go:117] "RemoveContainer" containerID="befcc966f84c0f7a46c62cd24e0bd16db2c1a66676c4d7082b06ca69e9dc6755"
Jul 27 22:29:09.426384 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:09.426359    2554 scope.go:117] "RemoveContainer" containerID="77b73fe5586712deffe685fefc05ebe257ef979f3587e396e324d3e7749b26f0"
Jul 27 22:29:09.545718 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:09.545677    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lmksj_ef06485f-d142-47b9-ae20-82afdd303030/konnectivity-agent/0.log"
Jul 27 22:29:09.674290 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:09.674193    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-223.ec2.internal_aa758d18188c78caf39faf92485f4815/haproxy/0.log"
Jul 27 22:29:10.553732 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:10.553620    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:29:10.575466 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:10.563717    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q96gh_0da1b92e-c511-430f-84ba-ebcedfbfb04a/ovn-acl-logging/0.log"
Jul 27 22:29:14.657832 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:14.657794    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8766b45b-vzw5q_5627db5c-4d0d-4d9d-ad24-34f0cf08f6e8/authorino/0.log"
Jul 27 22:29:15.151461 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:15.151270    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-v6ns2_eefea127-b6ea-4928-b497-8c0851d18c96/manager/0.log"
Jul 27 22:29:16.911916 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:16.911840    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ba6b240-7d7a-4954-881d-a65ca2cda8e2/alertmanager/0.log"
Jul 27 22:29:16.948176 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:16.948040    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ba6b240-7d7a-4954-881d-a65ca2cda8e2/config-reloader/0.log"
Jul 27 22:29:16.971917 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:16.971888    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ba6b240-7d7a-4954-881d-a65ca2cda8e2/kube-rbac-proxy-web/0.log"
Jul 27 22:29:16.997930 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:16.997891    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ba6b240-7d7a-4954-881d-a65ca2cda8e2/kube-rbac-proxy/0.log"
Jul 27 22:29:17.035269 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.035239    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ba6b240-7d7a-4954-881d-a65ca2cda8e2/kube-rbac-proxy-metric/0.log"
Jul 27 22:29:17.141401 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.141370    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ba6b240-7d7a-4954-881d-a65ca2cda8e2/prom-label-proxy/0.log"
Jul 27 22:29:17.186487 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.186396    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ba6b240-7d7a-4954-881d-a65ca2cda8e2/init-config-reloader/0.log"
Jul 27 22:29:17.283945 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.283911    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-f8xwb_81c9b1e0-9132-4a93-954f-849cc8834c83/kube-state-metrics/0.log"
Jul 27 22:29:17.316999 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.316969    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-f8xwb_81c9b1e0-9132-4a93-954f-849cc8834c83/kube-rbac-proxy-main/0.log"
Jul 27 22:29:17.347988 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.347945    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-f8xwb_81c9b1e0-9132-4a93-954f-849cc8834c83/kube-rbac-proxy-self/0.log"
Jul 27 22:29:17.377638 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.377612    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-758695c6d5-lp7s4_3bcb0b56-642f-4e6f-8da5-ed60182a7911/metrics-server/0.log"
Jul 27 22:29:17.415354 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.415265    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-4bhl5_28231086-8f03-457e-8b9f-b5a311ef79a1/monitoring-plugin/0.log"
Jul 27 22:29:17.676375 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.676320    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rn5vd_28a84019-3d4c-443b-a262-769a0fb14504/node-exporter/0.log"
Jul 27 22:29:17.701055 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.701028    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rn5vd_28a84019-3d4c-443b-a262-769a0fb14504/kube-rbac-proxy/0.log"
Jul 27 22:29:17.725180 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.725153    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rn5vd_28a84019-3d4c-443b-a262-769a0fb14504/init-textfile/0.log"
Jul 27 22:29:17.772749 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.772633    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-dncpg_79c9ce85-03ea-4c4d-97e5-507f77bd9b2f/kube-rbac-proxy-main/0.log"
Jul 27 22:29:17.797748 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.797718    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-dncpg_79c9ce85-03ea-4c4d-97e5-507f77bd9b2f/kube-rbac-proxy-self/0.log"
Jul 27 22:29:17.825554 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.825523    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-dncpg_79c9ce85-03ea-4c4d-97e5-507f77bd9b2f/openshift-state-metrics/0.log"
Jul 27 22:29:17.871526 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.871498    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce606690-6dc8-4de7-b869-520c34bc1069/prometheus/0.log"
Jul 27 22:29:17.899805 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.899770    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce606690-6dc8-4de7-b869-520c34bc1069/config-reloader/0.log"
Jul 27 22:29:17.927966 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.927939    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce606690-6dc8-4de7-b869-520c34bc1069/thanos-sidecar/0.log"
Jul 27 22:29:17.958058 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.957995    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce606690-6dc8-4de7-b869-520c34bc1069/kube-rbac-proxy-web/0.log"
Jul 27 22:29:17.985060 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:17.984972    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce606690-6dc8-4de7-b869-520c34bc1069/kube-rbac-proxy/0.log"
Jul 27 22:29:18.014079 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.014049    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce606690-6dc8-4de7-b869-520c34bc1069/kube-rbac-proxy-thanos/0.log"
Jul 27 22:29:18.041643 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.041542    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce606690-6dc8-4de7-b869-520c34bc1069/init-config-reloader/0.log"
Jul 27 22:29:18.076148 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.076063    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-gzvn5_8f02500e-6edc-4a0a-857e-7b56c85c9492/prometheus-operator/0.log"
Jul 27 22:29:18.095715 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.095691    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-gzvn5_8f02500e-6edc-4a0a-857e-7b56c85c9492/kube-rbac-proxy/0.log"
Jul 27 22:29:18.124341 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.124302    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-bvbmb_024d6f40-46c7-42fb-a254-52acc6fe989d/prometheus-operator-admission-webhook/0.log"
Jul 27 22:29:18.154987 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.154948    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66ffb64fb9-lx48v_b59944ea-bbee-49e7-b010-7d9c0dc83b23/telemeter-client/0.log"
Jul 27 22:29:18.184215 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.184173    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66ffb64fb9-lx48v_b59944ea-bbee-49e7-b010-7d9c0dc83b23/reload/0.log"
Jul 27 22:29:18.209602 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.209571    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66ffb64fb9-lx48v_b59944ea-bbee-49e7-b010-7d9c0dc83b23/kube-rbac-proxy/0.log"
Jul 27 22:29:18.250805 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.250781    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fb987ffb-wv8wj_2fa2aa24-829e-4f80-bfdf-ace703d93a02/thanos-query/0.log"
Jul 27 22:29:18.283127 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.283089    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fb987ffb-wv8wj_2fa2aa24-829e-4f80-bfdf-ace703d93a02/kube-rbac-proxy-web/0.log"
Jul 27 22:29:18.312784 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.312674    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fb987ffb-wv8wj_2fa2aa24-829e-4f80-bfdf-ace703d93a02/kube-rbac-proxy/0.log"
Jul 27 22:29:18.343625 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.343596    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fb987ffb-wv8wj_2fa2aa24-829e-4f80-bfdf-ace703d93a02/prom-label-proxy/0.log"
Jul 27 22:29:18.376867 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.376838    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fb987ffb-wv8wj_2fa2aa24-829e-4f80-bfdf-ace703d93a02/kube-rbac-proxy-rules/0.log"
Jul 27 22:29:18.418775 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:18.418718    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8fb987ffb-wv8wj_2fa2aa24-829e-4f80-bfdf-ace703d93a02/kube-rbac-proxy-metrics/0.log"
Jul 27 22:29:19.770301 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.770262    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"]
Jul 27 22:29:19.795315 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.795276    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.803399 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.803044    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"]
Jul 27 22:29:19.885219 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.885171    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-proc\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.885418 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.885317    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fhx7\" (UniqueName: \"kubernetes.io/projected/afab2087-4e7e-44ce-b20f-f24bd33c4302-kube-api-access-8fhx7\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.885418 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.885347    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-podres\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.885567 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.885493    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-lib-modules\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.885625 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.885562    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-sys\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.986749 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.986711    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-lib-modules\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.986924 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.986791    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-sys\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.986924 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.986850    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-proc\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.986924 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.986897    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-sys\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.987079 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.986897    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-lib-modules\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.987079 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.986935    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fhx7\" (UniqueName: \"kubernetes.io/projected/afab2087-4e7e-44ce-b20f-f24bd33c4302-kube-api-access-8fhx7\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.987079 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.986974    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-podres\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.987079 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.987008    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-proc\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.987259 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.987088    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/afab2087-4e7e-44ce-b20f-f24bd33c4302-podres\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:19.999631 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:19.999601    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fhx7\" (UniqueName: \"kubernetes.io/projected/afab2087-4e7e-44ce-b20f-f24bd33c4302-kube-api-access-8fhx7\") pod \"perf-node-gather-daemonset-vlfwl\" (UID: \"afab2087-4e7e-44ce-b20f-f24bd33c4302\") " pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:20.112534 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:20.112449    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:20.318471 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:20.316661    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"]
Jul 27 22:29:20.328106 ip-10-0-136-223 kubenswrapper[2554]: W0727 22:29:20.328046    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podafab2087_4e7e_44ce_b20f_f24bd33c4302.slice/crio-10d96e435d95f484ea4fdab88f8671238eb95114c175cff23d479ff1eef1a9ce WatchSource:0}: Error finding container 10d96e435d95f484ea4fdab88f8671238eb95114c175cff23d479ff1eef1a9ce: Status 404 returned error can't find the container with id 10d96e435d95f484ea4fdab88f8671238eb95114c175cff23d479ff1eef1a9ce
Jul 27 22:29:20.675166 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:20.675049    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl" event={"ID":"afab2087-4e7e-44ce-b20f-f24bd33c4302","Type":"ContainerStarted","Data":"362b55f9745a1ead41af5fb4e21e58a108554f6571c177fab40ca052ce1b07e9"}
Jul 27 22:29:20.675335 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:20.675166    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl" event={"ID":"afab2087-4e7e-44ce-b20f-f24bd33c4302","Type":"ContainerStarted","Data":"10d96e435d95f484ea4fdab88f8671238eb95114c175cff23d479ff1eef1a9ce"}
Jul 27 22:29:20.675335 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:20.675198    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:20.696719 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:20.696669    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl" podStartSLOduration=1.696652808 podStartE2EDuration="1.696652808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 22:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 22:29:20.695488098 +0000 UTC m=+3312.412894581" watchObservedRunningTime="2026-07-27 22:29:20.696652808 +0000 UTC m=+3312.414059289"
Jul 27 22:29:20.922499 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:20.922467    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84c5b49469-ctgss_7922e4f9-3158-4220-909f-1592b5a197c0/console/0.log"
Jul 27 22:29:22.766294 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:22.766257    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z2cg5_fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3/dns/0.log"
Jul 27 22:29:22.796039 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:22.796013    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z2cg5_fe7dfbb2-3025-4d40-9b4b-6ae6d6b568f3/kube-rbac-proxy/0.log"
Jul 27 22:29:22.854401 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:22.854368    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6h5c_82beb1c9-1fa4-4623-8bf6-82c83aa68ae7/dns-node-resolver/0.log"
Jul 27 22:29:23.570332 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:23.570291    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hdv2z_2be4f951-d474-4b2e-9104-73913eefa705/node-ca/0.log"
Jul 27 22:29:24.750399 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:24.750374    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd65f9cdf-rqfcx_19410132-3b17-46cd-bc3e-f4961cee6315/kube-auth-proxy/0.log"
Jul 27 22:29:24.875205 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:24.875174    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-rpm4j_eae449a6-8f51-4162-8645-2809579ef364/payload-pre-processing/0.log"
Jul 27 22:29:25.861169 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:25.861132    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mlfv6_33f83da1-b1ed-4e8e-9f43-439ea20b1f0a/serve-healthcheck-canary/0.log"
Jul 27 22:29:26.370635 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:26.370605    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ld9dt_4e0d62aa-a98e-4322-b329-e6beddf1c37f/kube-rbac-proxy/0.log"
Jul 27 22:29:26.395803 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:26.395772    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ld9dt_4e0d62aa-a98e-4322-b329-e6beddf1c37f/exporter/0.log"
Jul 27 22:29:26.425133 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:26.425081    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ld9dt_4e0d62aa-a98e-4322-b329-e6beddf1c37f/extractor/0.log"
Jul 27 22:29:26.696737 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:26.696652    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j99rk/perf-node-gather-daemonset-vlfwl"
Jul 27 22:29:30.264855 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:30.264776    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d57c545b5-svjgb_9c86c811-ce7b-4d16-9ebd-9d777dca1884/manager/0.log"
Jul 27 22:29:30.291357 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:30.291332    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d57c545b5-svjgb_9c86c811-ce7b-4d16-9ebd-9d777dca1884/copy-manifests/0.log"
Jul 27 22:29:30.321277 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:30.321247    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd65f9cdf-rqfcx_19410132-3b17-46cd-bc3e-f4961cee6315/kube-auth-proxy/0.log"
Jul 27 22:29:30.427578 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:30.427546    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-rpm4j_eae449a6-8f51-4162-8645-2809579ef364/payload-pre-processing/0.log"
Jul 27 22:29:31.558860 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:31.558828    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c57b59594-gcr27_09a86c8e-76a7-48f6-ac50-2ffb1bf3ae56/manager/0.log"
Jul 27 22:29:32.042395 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:32.042361    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd65f9cdf-rqfcx_19410132-3b17-46cd-bc3e-f4961cee6315/kube-auth-proxy/0.log"
Jul 27 22:29:32.143988 ip-10-0-136-223 kubenswrapper[2554]: I0727 22:29:32.143954    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-rpm4j_eae449a6-8f51-4162-8645-2809579ef364/payload-pre-processing/0.log"