Jul 28 12:51:03.499100 ip-10-0-136-204 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 12:51:03.853854 ip-10-0-136-204 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 12:51:03.853854 ip-10-0-136-204 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 12:51:03.853854 ip-10-0-136-204 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 12:51:03.853854 ip-10-0-136-204 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 12:51:03.853854 ip-10-0-136-204 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 12:51:03.855575 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.855429    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 12:51:03.860958 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.860936    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:03.860958 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.860955    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:03.860958 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.860959    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:03.860958 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.860964    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.860970    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.860975    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.860980    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.860984    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.860988    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.860993    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.860998    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861002    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861007    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861012    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861016    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861019    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861022    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861025    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861027    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861030    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861032    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861035    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:03.861126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861038    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861043    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861047    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861049    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861052    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861055    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861057    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861060    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861062    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861066    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861070    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861074    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861077    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861079    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861082    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861086    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861089    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861091    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861094    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:03.861581 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861096    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861099    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861102    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861104    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861107    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861109    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861112    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861114    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861117    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861120    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861122    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861126    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861130    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861133    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861137    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861139    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861142    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861144    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861147    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861149    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:03.862101 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861152    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861154    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861156    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861159    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861161    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861164    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861167    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861170    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861174    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861177    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861179    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861182    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861185    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861187    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861190    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861192    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861194    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861197    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861200    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861202    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:03.862589 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861204    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861207    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861210    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861213    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861216    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861218    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861220    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861223    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861225    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861228    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861231    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861234    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861236    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861239    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861242    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861245    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861247    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861250    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.861998    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:03.863187 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862006    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862011    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862014    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862017    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862019    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862022    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862025    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862028    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862030    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862032    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862035    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862037    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862041    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862044    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862046    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862049    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862053    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862055    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862058    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862060    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:03.863644 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862063    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862066    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862070    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862074    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862077    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862080    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862083    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862085    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862088    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862090    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862093    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862096    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862098    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862101    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862104    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862107    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862109    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862112    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862115    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:03.864160 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862118    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862120    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862123    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862125    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862130    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862142    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862146    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862149    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862153    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862156    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862160    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862162    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862165    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862169    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862172    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862175    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862178    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862180    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862183    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:03.864633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862186    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862188    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862191    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862194    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862196    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862199    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862201    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862204    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862207    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862209    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862212    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862214    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862217    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862221    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862223    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862226    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862228    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862230    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862233    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862235    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:03.865120 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862238    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862241    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862244    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862246    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862249    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862252    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862255    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862257    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862260    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862262    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862265    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862267    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862270    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862272    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862275    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862277    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862282    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862285    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862287    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862290    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:03.865599 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862666    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862671    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862674    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862677    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862680    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862682    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862685    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862688    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862690    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862693    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862695    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862698    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862701    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862703    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862706    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862709    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862712    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862715    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862718    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:03.866126 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862720    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862725    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862729    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862732    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862735    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862737    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862740    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862742    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862745    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862749    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862752    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862754    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862757    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862759    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862762    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862765    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862767    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862770    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862772    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:03.866598 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862775    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862778    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862780    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862783    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862785    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862788    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862790    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862793    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862795    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862798    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862800    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862819    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862824    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862828    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862832    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862835    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862838    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862840    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862843    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862846    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:03.867068 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862848    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862851    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862855    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862859    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862861    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862865    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862869    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862872    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862875    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862878    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862880    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862883    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862885    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862888    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862891    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862894    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862896    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862899    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862901    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862903    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:03.867595 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862906    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862912    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862915    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862918    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862921    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862923    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862926    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862929    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862932    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862934    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862937    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862939    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862942    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862945    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862948    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862951    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862953    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862956    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862959    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862961    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.862964    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:03.868099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863037    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863045    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863051    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863055    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863059    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863062    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863066    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863071    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863074    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863077    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863080    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863083    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863086    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863089    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863092    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863095    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863098    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863102    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863106    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863109    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863112    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863115    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863118    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863121    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 12:51:03.868594 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863124    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863129    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863132    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863135    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863138    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863140    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863143    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863146    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863150    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863153    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863156    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863159    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863162    2578 flags.go:64] FLAG: --enable-server="true"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863164    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863169    2578 flags.go:64] FLAG: --event-burst="100"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863172    2578 flags.go:64] FLAG: --event-qps="50"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863175    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863178    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863180    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863184    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863187    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863190    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863193    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863196    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863199    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 12:51:03.869216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863205    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863208    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863211    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863214    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863216    2578 flags.go:64] FLAG: --feature-gates=""
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863220    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863223    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863226    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863230    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863233    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863236    2578 flags.go:64] FLAG: --help="false"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863239    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-136-204.ec2.internal"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863242    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863245    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863247    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863250    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863254    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863257    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863260    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863263    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863266    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863269    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863272    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863274    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 28 12:51:03.869843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863277    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863280    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863283    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863286    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863289    2578 flags.go:64] FLAG: --lock-file=""
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863291    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863294    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863297    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863304    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863307    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863310    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863313    2578 flags.go:64] FLAG: --logging-format="text"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863316    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863319    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863322    2578 flags.go:64] FLAG: --manifest-url=""
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863325    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863329    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863332    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863336    2578 flags.go:64] FLAG: --max-pods="110"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863339    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863342    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863344    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863348    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863351    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863353    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 12:51:03.870446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863357    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863364    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863367    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863370    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863372    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863375    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863382    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863385    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863388    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863391    2578 flags.go:64] FLAG: --port="10250"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863393    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863396    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-017d338b0d95e7843"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863399    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863402    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863405    2578 flags.go:64] FLAG: --register-node="true"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863408    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863412    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863416    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863419    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863422    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863425    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863428    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863431    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863434    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863437    2578 flags.go:64] FLAG: --runonce="false"
Jul 28 12:51:03.871076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863440    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863443    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863446    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863448    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863451    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863454    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863457    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863460    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863463    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863466    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863469    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863472    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863475    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863477    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863480    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863486    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863488    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863491    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863495    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863498    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863500    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863503    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863505    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863509    2578 flags.go:64] FLAG: --v="2"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863513    2578 flags.go:64] FLAG: --version="false"
Jul 28 12:51:03.871677 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863518    2578 flags.go:64] FLAG: --vmodule=""
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863522    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863525    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863635    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863639    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863643    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863645    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863648    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863651    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863654    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863656    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863659    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863663    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863666    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863669    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863672    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863675    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863677    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863680    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:03.872442 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863684    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863687    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863690    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863692    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863695    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863697    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863700    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863702    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863705    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863707    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863710    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863713    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863716    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863718    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863721    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863724    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863727    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863729    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863732    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863735    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:03.872926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863737    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863740    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863742    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863744    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863747    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863749    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863752    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863754    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863757    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863760    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863762    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863764    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863768    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863771    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863773    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863776    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863778    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863780    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863783    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863785    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:03.873410 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863788    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863790    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863793    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863797    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863800    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863818    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863822    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863825    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863828    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863831    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863834    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863836    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863839    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863842    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863845    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863847    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863850    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863852    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863855    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:03.873910 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863857    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863860    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863862    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863865    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863869    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863875    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863878    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863880    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863883    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863886    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863888    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863891    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863893    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863895    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863898    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863900    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863905    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863907    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863910    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863913    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:03.874378 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863915    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863918    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863921    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.863923    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.863928    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.870881    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.870899    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.871558    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.871566    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871622    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871627    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871630    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871634    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871637    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871640    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:03.874903 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871642    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871645    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871648    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871651    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871653    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871656    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871658    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871661    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871664    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871666    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871669    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871673    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871677    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871680    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871683    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871686    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871689    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871692    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871694    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871697    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:03.875284 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871699    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871702    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871704    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871708    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871711    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871713    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871716    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871718    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871721    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871724    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871726    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871728    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871731    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871733    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871736    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871738    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871742    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871746    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871749    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:03.875827 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871752    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871755    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871757    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871760    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871762    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871765    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871767    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871770    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871773    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871775    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871779    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871782    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871785    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871787    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871790    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871793    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871796    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871799    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871801    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:03.876293 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871821    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871824    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871827    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871829    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871832    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871835    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871837    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871840    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871842    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871845    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871847    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871849    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871852    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871855    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871857    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871860    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871862    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871865    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871867    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871870    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:03.876752 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871873    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871875    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871878    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871880    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871883    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871885    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871888    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871891    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871893    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871897    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871899    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871903    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871906    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871908    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.871911    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:03.877255 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.871916    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872027    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872033    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872036    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872039    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872041    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872045    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872047    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872050    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872052    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872055    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872057    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872060    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872063    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872065    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872068    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872070    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872073    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872076    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872078    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:03.877634 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872081    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872083    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872086    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872088    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872091    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872093    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872095    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872098    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872101    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872104    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872107    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872109    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872111    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872114    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872117    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872119    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872122    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872124    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872126    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872129    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:03.878130 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872132    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872134    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872137    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872139    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872142    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872144    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872147    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872149    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872152    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872154    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872157    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872159    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872162    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872164    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872166    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872169    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872172    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872174    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872177    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872179    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:03.878670 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872182    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872184    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872187    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872190    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872192    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872195    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872197    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872200    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872202    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872205    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872207    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872210    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872212    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872215    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872217    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872220    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872222    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872224    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872227    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872229    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:03.879535 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872233    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872236    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872239    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872242    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872245    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872248    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872251    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872254    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872257    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872260    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872262    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872265    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872269    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872273    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872275    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872279    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872281    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872285    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872287    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:03.880261 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:03.872290    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:03.880735 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.872295    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 12:51:03.880735 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.872402    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 12:51:03.880735 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.874476    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 12:51:03.880735 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.875675    2578 server.go:1019] "Starting client certificate rotation"
Jul 28 12:51:03.880735 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.875776    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 12:51:03.880735 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.875858    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 12:51:03.880735 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.877915    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 12:51:03.882030 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.882011    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 12:51:03.893049 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.893032    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 28 12:51:03.895241 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.895225    2578 log.go:25] "Validated CRI v1 image API"
Jul 28 12:51:03.896057 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.896041    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 12:51:03.899661 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.899637    2578 fs.go:135] Filesystem UUIDs: map[0f0fb4c6-e75b-40a6-99af-d683f88fbb97:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9555eb60-8c05-40ca-85ff-6759135ee2f7:/dev/nvme0n1p4]
Jul 28 12:51:03.899714 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.899663    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 12:51:03.904690 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.904579    2578 manager.go:216] Machine: {Timestamp:2026-07-28 12:51:03.903339818 +0000 UTC m=+0.287104534 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104356 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23b701ad67e307f4db939536a51051 SystemUUID:ec23b701-ad67-e307-f4db-939536a51051 BootID:188ee4fd-c1f4-4875-a63d-dc45c493dca8 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e2:d7:a3:c4:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e2:d7:a3:c4:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:39:db:c7:e9:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 12:51:03.904690 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.904688    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 12:51:03.904801 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.904766    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 12:51:03.907051 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.907035    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 12:51:03.907378 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.907355    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 12:51:03.907520 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.907382    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-204.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 12:51:03.908602 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.908592    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 12:51:03.908634 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.908605    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 12:51:03.908634 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.908614    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 12:51:03.909356 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.909346    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 12:51:03.910244 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.910234    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 12:51:03.912922 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.912911    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 12:51:03.913091 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.913080    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 12:51:03.913125 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.913116    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 12:51:03.913159 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.913140    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 12:51:03.913159 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.913151    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 12:51:03.913212 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.913160    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 28 12:51:03.913212 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.913169    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 12:51:03.913551 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.913539    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 12:51:03.913584 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.913561    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 12:51:03.916013 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.915995    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 12:51:03.918323 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.918306    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 12:51:03.918416 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.918345    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 12:51:03.920038 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920024    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 12:51:03.920118 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920045    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 12:51:03.920118 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920054    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 12:51:03.920118 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920063    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 12:51:03.920118 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920075    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 12:51:03.920118 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920086    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 12:51:03.920118 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920099    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 12:51:03.920118 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920107    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 12:51:03.920118 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920119    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 12:51:03.920388 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920128    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 12:51:03.920388 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920140    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 12:51:03.920388 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920149    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 12:51:03.920838 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920826    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 12:51:03.920892 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.920842    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 12:51:03.924566 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.924544    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-204.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 12:51:03.924566 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:03.924554    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 12:51:03.924696 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:03.924621    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 12:51:03.924781 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.924768    2578 server.go:1268] "Started kubelet"
Jul 28 12:51:03.924929 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.924896    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 12:51:03.924983 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.924914    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 12:51:03.925028 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.924992    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 12:51:03.925757 ip-10-0-136-204 systemd[1]: Started Kubernetes Kubelet.
Jul 28 12:51:03.926862 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.926848    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 12:51:03.929245 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.929229    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 12:51:03.931289 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:03.931267    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 12:51:03.932387 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:03.931524    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-204.ec2.internal.18c6751ba6f6ae79  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-204.ec2.internal,UID:ip-10-0-136-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-204.ec2.internal,},FirstTimestamp:2026-07-28 12:51:03.924731513 +0000 UTC m=+0.308496208,LastTimestamp:2026-07-28 12:51:03.924731513 +0000 UTC m=+0.308496208,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-204.ec2.internal,}"
Jul 28 12:51:03.936569 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.936554    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 12:51:03.936641 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.936606    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 12:51:03.936698 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:03.936643    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:03.937326 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.937215    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 12:51:03.937646 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.937511    2578 factory.go:55] Registering systemd factory
Jul 28 12:51:03.937646 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.937528    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 28 12:51:03.938266 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.937981    2578 factory.go:153] Registering CRI-O factory
Jul 28 12:51:03.938266 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.938006    2578 factory.go:223] Registration of the crio container factory successfully
Jul 28 12:51:03.938394 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.938283    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 12:51:03.938394 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.938315    2578 factory.go:103] Registering Raw factory
Jul 28 12:51:03.938394 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.938341    2578 manager.go:1196] Started watching for new ooms in manager
Jul 28 12:51:03.938544 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.938435    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 12:51:03.938544 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.938498    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 12:51:03.938628 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.938613    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 12:51:03.938628 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.938624    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 12:51:03.939712 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.939696    2578 manager.go:349] Starting recovery of all containers
Jul 28 12:51:03.944648 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:03.944621    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 12:51:03.944821 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:03.944768    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 12:51:03.951618 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.951589    2578 manager.go:354] Recovery completed
Jul 28 12:51:03.957207 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.957193    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:03.958939 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.958912    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:03.959004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.958955    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:03.959004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.958971    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:03.959572 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.959555    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 12:51:03.959572 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.959571    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 12:51:03.959726 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.959589    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 12:51:03.959726 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.959571    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:03.961050 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.961035    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:03.961107 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.961070    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:03.961107 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.961084    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:03.961341 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:03.961257    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-204.ec2.internal.18c6751ba900a54b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-204.ec2.internal,UID:ip-10-0-136-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-204.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-204.ec2.internal,},FirstTimestamp:2026-07-28 12:51:03.958938955 +0000 UTC m=+0.342703651,LastTimestamp:2026-07-28 12:51:03.958938955 +0000 UTC m=+0.342703651,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-204.ec2.internal,}"
Jul 28 12:51:03.962343 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.962329    2578 policy_none.go:49] "None policy: Start"
Jul 28 12:51:03.962403 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.962359    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 12:51:03.962403 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.962374    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 12:51:03.964347 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:03.964334    2578 policy_none.go:47] "Start"
Jul 28 12:51:03.979523 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:03.979332    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-204.ec2.internal.18c6751ba9010097  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-204.ec2.internal,UID:ip-10-0-136-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-204.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-204.ec2.internal,},FirstTimestamp:2026-07-28 12:51:03.958962327 +0000 UTC m=+0.342727048,LastTimestamp:2026-07-28 12:51:03.958962327 +0000 UTC m=+0.342727048,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-204.ec2.internal,}"
Jul 28 12:51:03.994087 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:03.994018    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-204.ec2.internal.18c6751ba9013a94  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-204.ec2.internal,UID:ip-10-0-136-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-204.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-204.ec2.internal,},FirstTimestamp:2026-07-28 12:51:03.958977172 +0000 UTC m=+0.342741869,LastTimestamp:2026-07-28 12:51:03.958977172 +0000 UTC m=+0.342741869,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-204.ec2.internal,}"
Jul 28 12:51:04.002364 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.002347    2578 manager.go:337] "Starting Device Plugin manager"
Jul 28 12:51:04.002432 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.002407    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 12:51:04.002432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.002421    2578 server.go:87] "Starting device plugin registration server"
Jul 28 12:51:04.002679 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.002666    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 12:51:04.002758 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.002683    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 12:51:04.002834 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.002772    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 12:51:04.002886 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.002876    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 12:51:04.002886 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.002885    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 12:51:04.003409 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.003388    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 12:51:04.003473 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.003435    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:04.005781 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.005701    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-204.ec2.internal.18c6751ba900a54b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-204.ec2.internal.18c6751ba900a54b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-204.ec2.internal,UID:ip-10-0-136-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-204.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-204.ec2.internal,},FirstTimestamp:2026-07-28 12:51:03.958938955 +0000 UTC m=+0.342703651,LastTimestamp:2026-07-28 12:51:03.961051671 +0000 UTC m=+0.344816374,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-204.ec2.internal,}"
Jul 28 12:51:04.011853 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.011836    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cpc85"
Jul 28 12:51:04.019273 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.019212    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-204.ec2.internal.18c6751ba9010097\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-204.ec2.internal.18c6751ba9010097  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-204.ec2.internal,UID:ip-10-0-136-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-204.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-204.ec2.internal,},FirstTimestamp:2026-07-28 12:51:03.958962327 +0000 UTC m=+0.342727048,LastTimestamp:2026-07-28 12:51:03.961078136 +0000 UTC m=+0.344842832,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-204.ec2.internal,}"
Jul 28 12:51:04.025446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.025430    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cpc85"
Jul 28 12:51:04.030336 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.030271    2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-204.ec2.internal.18c6751ba9013a94\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-204.ec2.internal.18c6751ba9013a94  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-204.ec2.internal,UID:ip-10-0-136-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-204.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-204.ec2.internal,},FirstTimestamp:2026-07-28 12:51:03.958977172 +0000 UTC m=+0.342741869,LastTimestamp:2026-07-28 12:51:03.96108804 +0000 UTC m=+0.344852736,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-204.ec2.internal,}"
Jul 28 12:51:04.045501 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.040742    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 12:51:04.045501 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.042053    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 12:51:04.045501 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.042096    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 12:51:04.045501 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.042117    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 12:51:04.045501 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.042165    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 12:51:04.045501 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.045053    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:04.103384 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.103354    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:04.104505 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.104435    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:04.104505 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.104469    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:04.104505 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.104479    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:04.104505 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.104508    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.111823 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.111790    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.111926 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.111833    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-204.ec2.internal\": node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:04.142537 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.142504    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-204.ec2.internal"]
Jul 28 12:51:04.142670 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.142583    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:04.142670 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.142647    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:04.144081 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.144059    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:04.144243 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.144091    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:04.144243 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.144101    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:04.146476 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.146463    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:04.146573 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.146560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.146623 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.146588    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:04.147231 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.147214    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:04.147325 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.147232    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:04.147325 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.147255    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:04.147325 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.147264    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:04.147325 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.147239    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:04.147325 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.147324    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:04.149601 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.149585    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.149675 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.149610    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:04.150332 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.150316    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:04.150409 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.150342    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:04.150409 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.150351    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:04.175540 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.175516    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-204.ec2.internal\" not found" node="ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.180066 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.180049    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-204.ec2.internal\" not found" node="ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.240738 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.240713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/411cd910fa618dd63cf4ed911bf77b8a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal\" (UID: \"411cd910fa618dd63cf4ed911bf77b8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.240738 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.240742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/411cd910fa618dd63cf4ed911bf77b8a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal\" (UID: \"411cd910fa618dd63cf4ed911bf77b8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.240944 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.240770    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/94d3a7ac9a84028a23c9e8da860b6db4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-204.ec2.internal\" (UID: \"94d3a7ac9a84028a23c9e8da860b6db4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.242750 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.242734    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:04.341651 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.341625    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/411cd910fa618dd63cf4ed911bf77b8a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal\" (UID: \"411cd910fa618dd63cf4ed911bf77b8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.341651 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.341655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/411cd910fa618dd63cf4ed911bf77b8a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal\" (UID: \"411cd910fa618dd63cf4ed911bf77b8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.341883 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.341674    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/94d3a7ac9a84028a23c9e8da860b6db4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-204.ec2.internal\" (UID: \"94d3a7ac9a84028a23c9e8da860b6db4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.341883 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.341719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/94d3a7ac9a84028a23c9e8da860b6db4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-204.ec2.internal\" (UID: \"94d3a7ac9a84028a23c9e8da860b6db4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.341883 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.341746    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/411cd910fa618dd63cf4ed911bf77b8a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal\" (UID: \"411cd910fa618dd63cf4ed911bf77b8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.341883 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.341749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/411cd910fa618dd63cf4ed911bf77b8a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal\" (UID: \"411cd910fa618dd63cf4ed911bf77b8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.343690 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.343675    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:04.444578 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.444507    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:04.478706 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.478679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.483924 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.483707    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:04.545419 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.545385    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:04.645873 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.645847    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:04.746450 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.746379    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:04.786960 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.786936    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:04.846935 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.846905    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:04.875082 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.875057    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 12:51:04.875522 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.875203    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 12:51:04.875522 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.875227    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 12:51:04.900076 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:04.900049    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:04.947930 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:04.947908    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:05.032681 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:05.032593    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 12:46:05 +0000 UTC" deadline="2028-04-23 10:44:56.916355736 +0000 UTC"
Jul 28 12:51:05.032681 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:05.032639    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15237h53m51.883720948s"
Jul 28 12:51:05.048952 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:05.048924    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:05.149504 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:05.149471    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:05.174637 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:05.174618    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:05.175930 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:05.175914    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:05.175999 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:05.175946    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:05.175999 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:05.175956    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:05.181225 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:05.181200    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d3a7ac9a84028a23c9e8da860b6db4.slice/crio-9360a5a191bd78e66be2ff5fb7da69d55e4fb5d76f7ea6b7a42a576985f67a29 WatchSource:0}: Error finding container 9360a5a191bd78e66be2ff5fb7da69d55e4fb5d76f7ea6b7a42a576985f67a29: Status 404 returned error can't find the container with id 9360a5a191bd78e66be2ff5fb7da69d55e4fb5d76f7ea6b7a42a576985f67a29
Jul 28 12:51:05.181414 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:05.181395    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411cd910fa618dd63cf4ed911bf77b8a.slice/crio-02ae4a1040cfb8eadccef08ac76121f427637f17d6d3ce1905c517298cb25a59 WatchSource:0}: Error finding container 02ae4a1040cfb8eadccef08ac76121f427637f17d6d3ce1905c517298cb25a59: Status 404 returned error can't find the container with id 02ae4a1040cfb8eadccef08ac76121f427637f17d6d3ce1905c517298cb25a59
Jul 28 12:51:05.186579 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:05.186564    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 12:51:05.250581 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:05.250558    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:06.574046 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:06.574018    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-204.ec2.internal\" not found"
Jul 28 12:51:06.580390 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:06.580373    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:06.660163 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:06.660136    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:06.675216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:06.675190    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 12:51:06.676142 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:06.676129    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-204.ec2.internal"
Jul 28 12:51:06.683650 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:06.683631    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 12:51:07.136916 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.136862    2578 apiserver.go:52] "Watching apiserver"
Jul 28 12:51:07.145650 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.145618    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 12:51:07.146923 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.146892    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-204.ec2.internal","openshift-dns/node-resolver-jskh7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal","openshift-multus/multus-additional-cni-plugins-z8fnn","openshift-multus/multus-kwxzq","openshift-multus/network-metrics-daemon-b88wc","openshift-network-diagnostics/network-check-target-ld799","openshift-network-operator/iptables-alerter-vwmr8","kube-system/global-pull-secret-syncer-qsknb","kube-system/konnectivity-agent-kvr75","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4","openshift-cluster-node-tuning-operator/tuned-bz9j6","openshift-image-registry/node-ca-f84gz","openshift-ovn-kubernetes/ovnkube-node-m2jmq"]
Jul 28 12:51:07.149646 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.149628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:07.149738 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.149697    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:07.151633 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.151613    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f84gz"
Jul 28 12:51:07.154040 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.154017    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.155408 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.155389    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kc55j\""
Jul 28 12:51:07.155651 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.155629    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 12:51:07.155741 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.155696    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 12:51:07.155961 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.155938    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 12:51:07.156524 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.156507    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 12:51:07.158057 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.157051    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.158057 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.157536    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 12:51:07.158215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.158188    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 12:51:07.158615 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.158594    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 12:51:07.158705 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.158690    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rcmhh\""
Jul 28 12:51:07.159941 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.159919    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.161429    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.162122    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.162232    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.162418    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.162685    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9vbtr\""
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.162855    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2qj7r\""
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.162913    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.162420    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.163126    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.163171    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.163349    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.165063    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:07.165268 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.165108    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:07.167411 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.167394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:07.167514 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.167475    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:07.175174 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.175152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vwmr8"
Jul 28 12:51:07.177208 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-run-multus-certs\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.177208 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw4tf\" (UniqueName: \"kubernetes.io/projected/f022c708-2f19-42f5-9bc2-c353795dda51-kube-api-access-hw4tf\") pod \"node-ca-f84gz\" (UID: \"f022c708-2f19-42f5-9bc2-c353795dda51\") " pod="openshift-image-registry/node-ca-f84gz"
Jul 28 12:51:07.177208 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177181    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-slash\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.177414 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-run-ovn\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.177414 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-log-socket\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.177414 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-run-netns\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.177414 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-run-netns\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.177414 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-node-log\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.177646 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-run-ovn-kubernetes\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.177646 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68deab70-a94d-415f-9e9e-e6ef32666642-ovn-node-metrics-cert\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.177646 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177501    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-cnibin\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.177646 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-cni-binary-copy\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.177646 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-etc-kubernetes\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.177646 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f022c708-2f19-42f5-9bc2-c353795dda51-host\") pod \"node-ca-f84gz\" (UID: \"f022c708-2f19-42f5-9bc2-c353795dda51\") " pod="openshift-image-registry/node-ca-f84gz"
Jul 28 12:51:07.177952 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-run-systemd\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.177952 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68deab70-a94d-415f-9e9e-e6ef32666642-env-overrides\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.177952 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdn4t\" (UniqueName: \"kubernetes.io/projected/68deab70-a94d-415f-9e9e-e6ef32666642-kube-api-access-tdn4t\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.177952 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177774    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jskh7"
Jul 28 12:51:07.177952 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.177952 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-system-cni-dir\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.178267 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.177985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-hostroot\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.178267 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-cni-bin\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.178267 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68deab70-a94d-415f-9e9e-e6ef32666642-ovnkube-script-lib\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.178267 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-os-release\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.178267 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.178267 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-cni-dir\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.178554 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-os-release\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.178554 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-conf-dir\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.178554 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd9zn\" (UniqueName: \"kubernetes.io/projected/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-kube-api-access-dd9zn\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:07.178554 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f022c708-2f19-42f5-9bc2-c353795dda51-serviceca\") pod \"node-ca-f84gz\" (UID: \"f022c708-2f19-42f5-9bc2-c353795dda51\") " pod="openshift-image-registry/node-ca-f84gz"
Jul 28 12:51:07.178554 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178502    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-systemd-units\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.178554 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.178853 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9cjh\" (UniqueName: \"kubernetes.io/projected/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-kube-api-access-j9cjh\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.178853 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-run-k8s-cni-cncf-io\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.178853 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-var-lib-cni-bin\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.178853 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q28v7\" (UniqueName: \"kubernetes.io/projected/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-kube-api-access-q28v7\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.178853 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-etc-openvswitch\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.178853 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68deab70-a94d-415f-9e9e-e6ef32666642-ovnkube-config\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.179136 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-cnibin\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.179136 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:07.179136 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czjt2\" (UniqueName: \"kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2\") pod \"network-check-target-ld799\" (UID: \"de13a42d-3275-4c9c-a734-f12b7bf144df\") " pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:07.179136 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-kubelet\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.179136 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.178980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-run-openvswitch\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.179136 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.179010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.179136 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.179049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-system-cni-dir\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.179464 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.179140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-socket-dir-parent\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.179464 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.179172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-daemon-config\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.179464 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.179208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-var-lib-openvswitch\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.179464 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.179243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-cni-netd\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.179464 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.179285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.179464 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.179311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-var-lib-cni-multus\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.179464 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.179346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-var-lib-kubelet\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.180013 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.179980    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:07.182783 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.182762    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:51:07.182783 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.182778    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 12:51:07.182949 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.182903    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 12:51:07.182949 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.182913    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-48l75\""
Jul 28 12:51:07.183105 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.182959    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 12:51:07.183105 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.183005    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 12:51:07.183105 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.183067    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 12:51:07.183358 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.183342    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jpvcn\""
Jul 28 12:51:07.184045 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.184028    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b8c65\""
Jul 28 12:51:07.184391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.184373    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 12:51:07.186634 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.184970    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.186634 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.186491    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.190201 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.188030    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 12:51:07.190201 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.188143    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lfl66\""
Jul 28 12:51:07.190201 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.188248    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 12:51:07.190201 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.188958    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 12:51:07.190201 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.189018    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:51:07.190201 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.189159    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 12:51:07.190201 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.189292    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9m49c\""
Jul 28 12:51:07.190201 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.189372    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 12:51:07.212044 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.212026    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xth5q"
Jul 28 12:51:07.221067 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.221045    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xth5q"
Jul 28 12:51:07.261765 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.261673    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 12:51:07.275649 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.275049    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal" event={"ID":"411cd910fa618dd63cf4ed911bf77b8a","Type":"ContainerStarted","Data":"02ae4a1040cfb8eadccef08ac76121f427637f17d6d3ce1905c517298cb25a59"}
Jul 28 12:51:07.276383 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.276356    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-204.ec2.internal" event={"ID":"94d3a7ac9a84028a23c9e8da860b6db4","Type":"ContainerStarted","Data":"9360a5a191bd78e66be2ff5fb7da69d55e4fb5d76f7ea6b7a42a576985f67a29"}
Jul 28 12:51:07.279752 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.279728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-conf-dir\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.279871 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.279768    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd9zn\" (UniqueName: \"kubernetes.io/projected/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-kube-api-access-dd9zn\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:07.279871 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.279796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f022c708-2f19-42f5-9bc2-c353795dda51-serviceca\") pod \"node-ca-f84gz\" (UID: \"f022c708-2f19-42f5-9bc2-c353795dda51\") " pod="openshift-image-registry/node-ca-f84gz"
Jul 28 12:51:07.279871 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.279817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-conf-dir\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.279871 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.279833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68deab70-a94d-415f-9e9e-e6ef32666642-ovnkube-config\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.280088 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.279891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:07.280088 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.279915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.280088 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.279944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-run-k8s-cni-cncf-io\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.280088 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.279965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-var-lib-cni-bin\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.280088 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.279992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q28v7\" (UniqueName: \"kubernetes.io/projected/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-kube-api-access-q28v7\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.280088 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-kubelet\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.280088 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95627455-5e31-4559-9b52-fb1864f3c6c5-agent-certs\") pod \"konnectivity-agent-kvr75\" (UID: \"95627455-5e31-4559-9b52-fb1864f3c6c5\") " pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:07.280088 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-daemon-config\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.280088 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-var-lib-openvswitch\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-modprobe-d\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-run\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-var-lib-kubelet\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-host\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-var-lib-cni-multus\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-var-lib-kubelet\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-run-multus-certs\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-slash\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-run-ovn\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-log-socket\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-sysctl-conf\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt6rm\" (UniqueName: \"kubernetes.io/projected/664266f1-1fa1-48b1-bc3d-1432f56cb0d9-kube-api-access-xt6rm\") pod \"iptables-alerter-vwmr8\" (UID: \"664266f1-1fa1-48b1-bc3d-1432f56cb0d9\") " pod="openshift-network-operator/iptables-alerter-vwmr8"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-run-netns\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-run-netns\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-node-log\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-socket-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.280545 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-cni-binary-copy\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-etc-kubernetes\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f022c708-2f19-42f5-9bc2-c353795dda51-host\") pod \"node-ca-f84gz\" (UID: \"f022c708-2f19-42f5-9bc2-c353795dda51\") " pod="openshift-image-registry/node-ca-f84gz"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrfml\" (UniqueName: \"kubernetes.io/projected/0ef8725f-07bb-4f97-a3fa-3d17ff630687-kube-api-access-hrfml\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-sys\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.280711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f022c708-2f19-42f5-9bc2-c353795dda51-serviceca\") pod \"node-ca-f84gz\" (UID: \"f022c708-2f19-42f5-9bc2-c353795dda51\") " pod="openshift-image-registry/node-ca-f84gz"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-system-cni-dir\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-cni-bin\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68deab70-a94d-415f-9e9e-e6ef32666642-ovnkube-script-lib\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-device-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-sysconfig\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281216    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/68deab70-a94d-415f-9e9e-e6ef32666642-ovnkube-config\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-cni-dir\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-cni-dir\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.281391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-kubelet\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.282178 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.282178 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-systemd-units\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.282178 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6xvw\" (UniqueName: \"kubernetes.io/projected/a868bee4-b71e-465a-8da6-070c000a597a-kube-api-access-c6xvw\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.282178 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/607c523b-7e24-41a6-b546-e945742f9491-tmp-dir\") pod \"node-resolver-jskh7\" (UID: \"607c523b-7e24-41a6-b546-e945742f9491\") " pod="openshift-dns/node-resolver-jskh7"
Jul 28 12:51:07.282178 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-daemon-config\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.282178 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-run-k8s-cni-cncf-io\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.282178 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-var-lib-cni-bin\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.282178 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282059    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-systemd-units\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.282178 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-var-lib-openvswitch\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.282178 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282136    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f022c708-2f19-42f5-9bc2-c353795dda51-host\") pod \"node-ca-f84gz\" (UID: \"f022c708-2f19-42f5-9bc2-c353795dda51\") " pod="openshift-image-registry/node-ca-f84gz"
Jul 28 12:51:07.282178 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282154    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-var-lib-cni-multus\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282184    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-var-lib-kubelet\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-cni-bin\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282242    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-system-cni-dir\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.281893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9cjh\" (UniqueName: \"kubernetes.io/projected/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-kube-api-access-j9cjh\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-etc-openvswitch\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-registration-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/607c523b-7e24-41a6-b546-e945742f9491-hosts-file\") pod \"node-resolver-jskh7\" (UID: \"607c523b-7e24-41a6-b546-e945742f9491\") " pod="openshift-dns/node-resolver-jskh7"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-run-netns\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282395    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-slash\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282333    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-host-run-multus-certs\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-cnibin\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-run-netns\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-cnibin\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjt2\" (UniqueName: \"kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2\") pod \"network-check-target-ld799\" (UID: \"de13a42d-3275-4c9c-a734-f12b7bf144df\") " pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-run-openvswitch\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.282700 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282750    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da3d8ccd-539e-4d22-9e58-2851a576a3cd-dbus\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-sysctl-d\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-node-log\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282192    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-etc-kubernetes\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-systemd\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-log-socket\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.282992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283024    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-cni-binary-copy\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283130    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-run-ovn\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-run-openvswitch\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283289    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-system-cni-dir\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-socket-dir-parent\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-cni-netd\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.283407    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da3d8ccd-539e-4d22-9e58-2851a576a3cd-kubelet-config\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:07.283539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-etc-openvswitch\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.283468    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs podName:b98b32fe-aa1b-4b6c-ae70-f11bfabcb136 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:07.78345526 +0000 UTC m=+2.944223172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs") pod "network-metrics-daemon-b88wc" (UID: "b98b32fe-aa1b-4b6c-ae70-f11bfabcb136") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283522    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a868bee4-b71e-465a-8da6-070c000a597a-etc-tuned\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/664266f1-1fa1-48b1-bc3d-1432f56cb0d9-host-slash\") pod \"iptables-alerter-vwmr8\" (UID: \"664266f1-1fa1-48b1-bc3d-1432f56cb0d9\") " pod="openshift-network-operator/iptables-alerter-vwmr8"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283557    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-system-cni-dir\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/68deab70-a94d-415f-9e9e-e6ef32666642-ovnkube-script-lib\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283603    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-multus-socket-dir-parent\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw4tf\" (UniqueName: \"kubernetes.io/projected/f022c708-2f19-42f5-9bc2-c353795dda51-kube-api-access-hw4tf\") pod \"node-ca-f84gz\" (UID: \"f022c708-2f19-42f5-9bc2-c353795dda51\") " pod="openshift-image-registry/node-ca-f84gz"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-cni-netd\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68deab70-a94d-415f-9e9e-e6ef32666642-ovn-node-metrics-cert\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-run-ovn-kubernetes\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-cnibin\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-host-run-ovn-kubernetes\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-run-systemd\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.284432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283925    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-cnibin\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/68deab70-a94d-415f-9e9e-e6ef32666642-run-systemd\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68deab70-a94d-415f-9e9e-e6ef32666642-env-overrides\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.283997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdn4t\" (UniqueName: \"kubernetes.io/projected/68deab70-a94d-415f-9e9e-e6ef32666642-kube-api-access-tdn4t\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284059    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-sys-fs\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284154    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-lib-modules\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a868bee4-b71e-465a-8da6-070c000a597a-tmp\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z7wz\" (UniqueName: \"kubernetes.io/projected/607c523b-7e24-41a6-b546-e945742f9491-kube-api-access-6z7wz\") pod \"node-resolver-jskh7\" (UID: \"607c523b-7e24-41a6-b546-e945742f9491\") " pod="openshift-dns/node-resolver-jskh7"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-hostroot\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95627455-5e31-4559-9b52-fb1864f3c6c5-konnectivity-ca\") pod \"konnectivity-agent-kvr75\" (UID: \"95627455-5e31-4559-9b52-fb1864f3c6c5\") " pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284328    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/68deab70-a94d-415f-9e9e-e6ef32666642-env-overrides\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-kubernetes\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284394    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-hostroot\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284431    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/664266f1-1fa1-48b1-bc3d-1432f56cb0d9-iptables-alerter-script\") pod \"iptables-alerter-vwmr8\" (UID: \"664266f1-1fa1-48b1-bc3d-1432f56cb0d9\") " pod="openshift-network-operator/iptables-alerter-vwmr8"
Jul 28 12:51:07.285215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-os-release\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.286056 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284482    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-os-release\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.286056 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-os-release\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.286056 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-os-release\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.286056 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.284758    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.288393 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.288369    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/68deab70-a94d-415f-9e9e-e6ef32666642-ovn-node-metrics-cert\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.292414 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.292393    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q28v7\" (UniqueName: \"kubernetes.io/projected/011d84ea-64de-4dcf-85d6-4c1f9284b4bd-kube-api-access-q28v7\") pod \"multus-kwxzq\" (UID: \"011d84ea-64de-4dcf-85d6-4c1f9284b4bd\") " pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.294037 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.294002    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd9zn\" (UniqueName: \"kubernetes.io/projected/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-kube-api-access-dd9zn\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:07.300434 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.300414    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:07.300528 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.300442    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:07.300528 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.300458    2578 projected.go:196] Error preparing data for projected volume kube-api-access-czjt2 for pod openshift-network-diagnostics/network-check-target-ld799: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:07.300528 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.300511    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2 podName:de13a42d-3275-4c9c-a734-f12b7bf144df nodeName:}" failed. No retries permitted until 2026-07-28 12:51:07.800494801 +0000 UTC m=+2.961262728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-czjt2" (UniqueName: "kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2") pod "network-check-target-ld799" (UID: "de13a42d-3275-4c9c-a734-f12b7bf144df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:07.301071 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.301026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9cjh\" (UniqueName: \"kubernetes.io/projected/9cfe9b83-6bdd-47f3-9d79-ebafe92262e7-kube-api-access-j9cjh\") pod \"multus-additional-cni-plugins-z8fnn\" (UID: \"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7\") " pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.305420 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.305018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw4tf\" (UniqueName: \"kubernetes.io/projected/f022c708-2f19-42f5-9bc2-c353795dda51-kube-api-access-hw4tf\") pod \"node-ca-f84gz\" (UID: \"f022c708-2f19-42f5-9bc2-c353795dda51\") " pod="openshift-image-registry/node-ca-f84gz"
Jul 28 12:51:07.305524 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.305502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdn4t\" (UniqueName: \"kubernetes.io/projected/68deab70-a94d-415f-9e9e-e6ef32666642-kube-api-access-tdn4t\") pod \"ovnkube-node-m2jmq\" (UID: \"68deab70-a94d-415f-9e9e-e6ef32666642\") " pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.385559 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95627455-5e31-4559-9b52-fb1864f3c6c5-agent-certs\") pod \"konnectivity-agent-kvr75\" (UID: \"95627455-5e31-4559-9b52-fb1864f3c6c5\") " pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:07.385559 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-modprobe-d\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.385788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-run\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.385788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-var-lib-kubelet\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.385788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-host\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.385788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385654    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-sysctl-conf\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.385788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt6rm\" (UniqueName: \"kubernetes.io/projected/664266f1-1fa1-48b1-bc3d-1432f56cb0d9-kube-api-access-xt6rm\") pod \"iptables-alerter-vwmr8\" (UID: \"664266f1-1fa1-48b1-bc3d-1432f56cb0d9\") " pod="openshift-network-operator/iptables-alerter-vwmr8"
Jul 28 12:51:07.385788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385692    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-run\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.385788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385704    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-socket-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.385788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385727    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-modprobe-d\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.385788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.385788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-host\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.385788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrfml\" (UniqueName: \"kubernetes.io/projected/0ef8725f-07bb-4f97-a3fa-3d17ff630687-kube-api-access-hrfml\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-sys\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-device-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-sysconfig\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6xvw\" (UniqueName: \"kubernetes.io/projected/a868bee4-b71e-465a-8da6-070c000a597a-kube-api-access-c6xvw\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/607c523b-7e24-41a6-b546-e945742f9491-tmp-dir\") pod \"node-resolver-jskh7\" (UID: \"607c523b-7e24-41a6-b546-e945742f9491\") " pod="openshift-dns/node-resolver-jskh7"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385946    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-sysctl-conf\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-registration-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/607c523b-7e24-41a6-b546-e945742f9491-hosts-file\") pod \"node-resolver-jskh7\" (UID: \"607c523b-7e24-41a6-b546-e945742f9491\") " pod="openshift-dns/node-resolver-jskh7"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385998    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-var-lib-kubelet\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386003    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-sys\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.385788    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-socket-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da3d8ccd-539e-4d22-9e58-2851a576a3cd-dbus\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/607c523b-7e24-41a6-b546-e945742f9491-hosts-file\") pod \"node-resolver-jskh7\" (UID: \"607c523b-7e24-41a6-b546-e945742f9491\") " pod="openshift-dns/node-resolver-jskh7"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da3d8ccd-539e-4d22-9e58-2851a576a3cd-dbus\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-registration-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.386319 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-sysconfig\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386371    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-device-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-sysctl-d\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-systemd\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da3d8ccd-539e-4d22-9e58-2851a576a3cd-kubelet-config\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386512    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a868bee4-b71e-465a-8da6-070c000a597a-etc-tuned\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-systemd\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/664266f1-1fa1-48b1-bc3d-1432f56cb0d9-host-slash\") pod \"iptables-alerter-vwmr8\" (UID: \"664266f1-1fa1-48b1-bc3d-1432f56cb0d9\") " pod="openshift-network-operator/iptables-alerter-vwmr8"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386587    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/664266f1-1fa1-48b1-bc3d-1432f56cb0d9-host-slash\") pod \"iptables-alerter-vwmr8\" (UID: \"664266f1-1fa1-48b1-bc3d-1432f56cb0d9\") " pod="openshift-network-operator/iptables-alerter-vwmr8"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386594    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da3d8ccd-539e-4d22-9e58-2851a576a3cd-kubelet-config\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-sys-fs\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-lib-modules\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a868bee4-b71e-465a-8da6-070c000a597a-tmp\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-sysctl-d\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z7wz\" (UniqueName: \"kubernetes.io/projected/607c523b-7e24-41a6-b546-e945742f9491-kube-api-access-6z7wz\") pod \"node-resolver-jskh7\" (UID: \"607c523b-7e24-41a6-b546-e945742f9491\") " pod="openshift-dns/node-resolver-jskh7"
Jul 28 12:51:07.387099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95627455-5e31-4559-9b52-fb1864f3c6c5-konnectivity-ca\") pod \"konnectivity-agent-kvr75\" (UID: \"95627455-5e31-4559-9b52-fb1864f3c6c5\") " pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:07.388053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-kubernetes\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.388053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386790    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-lib-modules\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.388053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/664266f1-1fa1-48b1-bc3d-1432f56cb0d9-iptables-alerter-script\") pod \"iptables-alerter-vwmr8\" (UID: \"664266f1-1fa1-48b1-bc3d-1432f56cb0d9\") " pod="openshift-network-operator/iptables-alerter-vwmr8"
Jul 28 12:51:07.388053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:07.388053 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.386966    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:07.388053 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.387021    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret podName:da3d8ccd-539e-4d22-9e58-2851a576a3cd nodeName:}" failed. No retries permitted until 2026-07-28 12:51:07.887003221 +0000 UTC m=+3.047771150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret") pod "global-pull-secret-syncer-qsknb" (UID: "da3d8ccd-539e-4d22-9e58-2851a576a3cd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:07.388053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.387418    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95627455-5e31-4559-9b52-fb1864f3c6c5-konnectivity-ca\") pod \"konnectivity-agent-kvr75\" (UID: \"95627455-5e31-4559-9b52-fb1864f3c6c5\") " pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:07.388053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.387438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a868bee4-b71e-465a-8da6-070c000a597a-etc-kubernetes\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.388053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.386674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ef8725f-07bb-4f97-a3fa-3d17ff630687-sys-fs\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.388053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.387568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/664266f1-1fa1-48b1-bc3d-1432f56cb0d9-iptables-alerter-script\") pod \"iptables-alerter-vwmr8\" (UID: \"664266f1-1fa1-48b1-bc3d-1432f56cb0d9\") " pod="openshift-network-operator/iptables-alerter-vwmr8"
Jul 28 12:51:07.388053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.387587    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/607c523b-7e24-41a6-b546-e945742f9491-tmp-dir\") pod \"node-resolver-jskh7\" (UID: \"607c523b-7e24-41a6-b546-e945742f9491\") " pod="openshift-dns/node-resolver-jskh7"
Jul 28 12:51:07.388718 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.388673    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95627455-5e31-4559-9b52-fb1864f3c6c5-agent-certs\") pod \"konnectivity-agent-kvr75\" (UID: \"95627455-5e31-4559-9b52-fb1864f3c6c5\") " pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:07.389671 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.389648    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a868bee4-b71e-465a-8da6-070c000a597a-tmp\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.390535 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.390513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a868bee4-b71e-465a-8da6-070c000a597a-etc-tuned\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.396450 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.396432    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:07.409059 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.409032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt6rm\" (UniqueName: \"kubernetes.io/projected/664266f1-1fa1-48b1-bc3d-1432f56cb0d9-kube-api-access-xt6rm\") pod \"iptables-alerter-vwmr8\" (UID: \"664266f1-1fa1-48b1-bc3d-1432f56cb0d9\") " pod="openshift-network-operator/iptables-alerter-vwmr8"
Jul 28 12:51:07.435376 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.435347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z7wz\" (UniqueName: \"kubernetes.io/projected/607c523b-7e24-41a6-b546-e945742f9491-kube-api-access-6z7wz\") pod \"node-resolver-jskh7\" (UID: \"607c523b-7e24-41a6-b546-e945742f9491\") " pod="openshift-dns/node-resolver-jskh7"
Jul 28 12:51:07.435618 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.435601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6xvw\" (UniqueName: \"kubernetes.io/projected/a868bee4-b71e-465a-8da6-070c000a597a-kube-api-access-c6xvw\") pod \"tuned-bz9j6\" (UID: \"a868bee4-b71e-465a-8da6-070c000a597a\") " pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.435788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.435764    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrfml\" (UniqueName: \"kubernetes.io/projected/0ef8725f-07bb-4f97-a3fa-3d17ff630687-kube-api-access-hrfml\") pod \"aws-ebs-csi-driver-node-9rfv4\" (UID: \"0ef8725f-07bb-4f97-a3fa-3d17ff630687\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.468164 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.468123    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f84gz"
Jul 28 12:51:07.481748 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.481715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:07.497591 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.497568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vwmr8"
Jul 28 12:51:07.503389 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.503372    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z8fnn"
Jul 28 12:51:07.510030 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.510011    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kwxzq"
Jul 28 12:51:07.516794 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.516779    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jskh7"
Jul 28 12:51:07.525721 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.525705    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:07.533394 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.533376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4"
Jul 28 12:51:07.538022 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.538005    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bz9j6"
Jul 28 12:51:07.790009 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.789914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:07.790165 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.790085    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:07.790165 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.790148    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs podName:b98b32fe-aa1b-4b6c-ae70-f11bfabcb136 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:08.790133742 +0000 UTC m=+3.950901655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs") pod "network-metrics-daemon-b88wc" (UID: "b98b32fe-aa1b-4b6c-ae70-f11bfabcb136") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:07.890838 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.890788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjt2\" (UniqueName: \"kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2\") pod \"network-check-target-ld799\" (UID: \"de13a42d-3275-4c9c-a734-f12b7bf144df\") " pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:07.891077 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:07.890853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:07.891077 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.890953    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:07.891077 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.890983    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:07.891077 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.891006    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:07.891077 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.891016    2578 projected.go:196] Error preparing data for projected volume kube-api-access-czjt2 for pod openshift-network-diagnostics/network-check-target-ld799: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:07.891077 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.891022    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret podName:da3d8ccd-539e-4d22-9e58-2851a576a3cd nodeName:}" failed. No retries permitted until 2026-07-28 12:51:08.891003009 +0000 UTC m=+4.051770944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret") pod "global-pull-secret-syncer-qsknb" (UID: "da3d8ccd-539e-4d22-9e58-2851a576a3cd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:07.891077 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:07.891056    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2 podName:de13a42d-3275-4c9c-a734-f12b7bf144df nodeName:}" failed. No retries permitted until 2026-07-28 12:51:08.891045045 +0000 UTC m=+4.051812961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-czjt2" (UniqueName: "kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2") pod "network-check-target-ld799" (UID: "de13a42d-3275-4c9c-a734-f12b7bf144df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:08.006234 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:08.006204    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:08.226070 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:08.225954    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:46:07 +0000 UTC" deadline="2028-02-09 18:53:02.796348922 +0000 UTC"
Jul 28 12:51:08.226070 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:08.226023    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13470h1m54.570334854s"
Jul 28 12:51:08.265391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:08.265366    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:08.265515 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:08.265484    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:08.303219 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:08.303193    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011d84ea_64de_4dcf_85d6_4c1f9284b4bd.slice/crio-2decff8b8b7f55f6dfd4c447e7387071edf2a0636cf6b4caf6acbe6e2db28f2f WatchSource:0}: Error finding container 2decff8b8b7f55f6dfd4c447e7387071edf2a0636cf6b4caf6acbe6e2db28f2f: Status 404 returned error can't find the container with id 2decff8b8b7f55f6dfd4c447e7387071edf2a0636cf6b4caf6acbe6e2db28f2f
Jul 28 12:51:08.304390 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:08.304365    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95627455_5e31_4559_9b52_fb1864f3c6c5.slice/crio-cbe12a23f5c10f1c2c7dd1926f1197093bcd401c0ae6f3ebc5b96a29c434a2ff WatchSource:0}: Error finding container cbe12a23f5c10f1c2c7dd1926f1197093bcd401c0ae6f3ebc5b96a29c434a2ff: Status 404 returned error can't find the container with id cbe12a23f5c10f1c2c7dd1926f1197093bcd401c0ae6f3ebc5b96a29c434a2ff
Jul 28 12:51:08.305237 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:08.305218    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf022c708_2f19_42f5_9bc2_c353795dda51.slice/crio-09f0c518c1d21fd126b05d3826db4837bccf9f4cf4f113e7c183e9bbb9d4cb09 WatchSource:0}: Error finding container 09f0c518c1d21fd126b05d3826db4837bccf9f4cf4f113e7c183e9bbb9d4cb09: Status 404 returned error can't find the container with id 09f0c518c1d21fd126b05d3826db4837bccf9f4cf4f113e7c183e9bbb9d4cb09
Jul 28 12:51:08.306149 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:08.306123    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664266f1_1fa1_48b1_bc3d_1432f56cb0d9.slice/crio-ec22e981553d8d1a9025ac601f1af1f0f5a4be9126c3f26029d63d8a8ce46dc3 WatchSource:0}: Error finding container ec22e981553d8d1a9025ac601f1af1f0f5a4be9126c3f26029d63d8a8ce46dc3: Status 404 returned error can't find the container with id ec22e981553d8d1a9025ac601f1af1f0f5a4be9126c3f26029d63d8a8ce46dc3
Jul 28 12:51:08.333189 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:08.333160    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda868bee4_b71e_465a_8da6_070c000a597a.slice/crio-1364aa6bd85e9ef325bd0ffa9dc521092297a8bbc51f63a4117749ae14384a0c WatchSource:0}: Error finding container 1364aa6bd85e9ef325bd0ffa9dc521092297a8bbc51f63a4117749ae14384a0c: Status 404 returned error can't find the container with id 1364aa6bd85e9ef325bd0ffa9dc521092297a8bbc51f63a4117749ae14384a0c
Jul 28 12:51:08.798497 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:08.797580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:08.798497 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:08.797990    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:08.798497 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:08.798058    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs podName:b98b32fe-aa1b-4b6c-ae70-f11bfabcb136 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:10.798039271 +0000 UTC m=+5.958807203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs") pod "network-metrics-daemon-b88wc" (UID: "b98b32fe-aa1b-4b6c-ae70-f11bfabcb136") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:08.899205 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:08.899168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjt2\" (UniqueName: \"kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2\") pod \"network-check-target-ld799\" (UID: \"de13a42d-3275-4c9c-a734-f12b7bf144df\") " pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:08.899364 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:08.899234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:08.899364 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:08.899355    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:08.899485 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:08.899422    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret podName:da3d8ccd-539e-4d22-9e58-2851a576a3cd nodeName:}" failed. No retries permitted until 2026-07-28 12:51:10.899400268 +0000 UTC m=+6.060168180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret") pod "global-pull-secret-syncer-qsknb" (UID: "da3d8ccd-539e-4d22-9e58-2851a576a3cd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:08.899899 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:08.899867    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:08.899899 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:08.899897    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:08.900072 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:08.899911    2578 projected.go:196] Error preparing data for projected volume kube-api-access-czjt2 for pod openshift-network-diagnostics/network-check-target-ld799: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:08.900072 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:08.899959    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2 podName:de13a42d-3275-4c9c-a734-f12b7bf144df nodeName:}" failed. No retries permitted until 2026-07-28 12:51:10.899943899 +0000 UTC m=+6.060711813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-czjt2" (UniqueName: "kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2") pod "network-check-target-ld799" (UID: "de13a42d-3275-4c9c-a734-f12b7bf144df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:09.227138 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.227025    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:46:07 +0000 UTC" deadline="2028-04-04 02:35:25.688505976 +0000 UTC"
Jul 28 12:51:09.227138 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.227085    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14773h44m16.461424743s"
Jul 28 12:51:09.269054 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.269024    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:09.269248 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:09.269168    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:09.269582 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.269560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:09.269687 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:09.269666    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:09.290457 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.290369    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jskh7" event={"ID":"607c523b-7e24-41a6-b546-e945742f9491","Type":"ContainerStarted","Data":"13aaf44747ac1b539b010699e3d6d2f957b2e1f0ba77d12561c60d09f4946b80"}
Jul 28 12:51:09.300095 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.300064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vwmr8" event={"ID":"664266f1-1fa1-48b1-bc3d-1432f56cb0d9","Type":"ContainerStarted","Data":"ec22e981553d8d1a9025ac601f1af1f0f5a4be9126c3f26029d63d8a8ce46dc3"}
Jul 28 12:51:09.304047 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.304017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f84gz" event={"ID":"f022c708-2f19-42f5-9bc2-c353795dda51","Type":"ContainerStarted","Data":"09f0c518c1d21fd126b05d3826db4837bccf9f4cf4f113e7c183e9bbb9d4cb09"}
Jul 28 12:51:09.314011 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.313959    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kwxzq" event={"ID":"011d84ea-64de-4dcf-85d6-4c1f9284b4bd","Type":"ContainerStarted","Data":"2decff8b8b7f55f6dfd4c447e7387071edf2a0636cf6b4caf6acbe6e2db28f2f"}
Jul 28 12:51:09.318988 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.318962    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq" event={"ID":"68deab70-a94d-415f-9e9e-e6ef32666642","Type":"ContainerStarted","Data":"5d5b53ec4368ea1dc3ff35f9312fa1787a27a881157881a2303e71fcac975194"}
Jul 28 12:51:09.327521 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.326635    2578 generic.go:356] "Generic (PLEG): container finished" podID="411cd910fa618dd63cf4ed911bf77b8a" containerID="abaea943c50a6decd99ecd5faf106f79674a5793a5105d0814f7dce55b650b5c" exitCode=0
Jul 28 12:51:09.327521 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.326708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal" event={"ID":"411cd910fa618dd63cf4ed911bf77b8a","Type":"ContainerDied","Data":"abaea943c50a6decd99ecd5faf106f79674a5793a5105d0814f7dce55b650b5c"}
Jul 28 12:51:09.347985 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.347463    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-204.ec2.internal" event={"ID":"94d3a7ac9a84028a23c9e8da860b6db4","Type":"ContainerStarted","Data":"9156ea7bb3652fcf024571d3dab620b52d357215dd2043095f10ef85b7e44803"}
Jul 28 12:51:09.357735 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.357626    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bz9j6" event={"ID":"a868bee4-b71e-465a-8da6-070c000a597a","Type":"ContainerStarted","Data":"1364aa6bd85e9ef325bd0ffa9dc521092297a8bbc51f63a4117749ae14384a0c"}
Jul 28 12:51:09.370310 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.370200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4" event={"ID":"0ef8725f-07bb-4f97-a3fa-3d17ff630687","Type":"ContainerStarted","Data":"46fda82bdcbd5329ec1dcd2fe9392b97e9ded86a4668412929809d8445518067"}
Jul 28 12:51:09.391232 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.391196    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kvr75" event={"ID":"95627455-5e31-4559-9b52-fb1864f3c6c5","Type":"ContainerStarted","Data":"cbe12a23f5c10f1c2c7dd1926f1197093bcd401c0ae6f3ebc5b96a29c434a2ff"}
Jul 28 12:51:09.416773 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:09.416701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8fnn" event={"ID":"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7","Type":"ContainerStarted","Data":"062c373714aa99602c029650319b2f7d23f01308aff5a739370728281e9d173b"}
Jul 28 12:51:10.265760 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:10.265724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:10.266205 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:10.265891    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:10.442277 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:10.442206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal" event={"ID":"411cd910fa618dd63cf4ed911bf77b8a","Type":"ContainerStarted","Data":"217cbed25d48d17058961eac12d5c9783a73864cc60e05c2f15839b1e4fc5353"}
Jul 28 12:51:10.462217 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:10.462152    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-204.ec2.internal" podStartSLOduration=4.462122214 podStartE2EDuration="4.462122214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:09.377361792 +0000 UTC m=+4.538129748" watchObservedRunningTime="2026-07-28 12:51:10.462122214 +0000 UTC m=+5.622890151"
Jul 28 12:51:10.462394 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:10.462298    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-204.ec2.internal" podStartSLOduration=4.46229024 podStartE2EDuration="4.46229024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:10.460272156 +0000 UTC m=+5.621040088" watchObservedRunningTime="2026-07-28 12:51:10.46229024 +0000 UTC m=+5.623058175"
Jul 28 12:51:10.817161 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:10.817113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:10.817341 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:10.817290    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:10.817422 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:10.817363    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs podName:b98b32fe-aa1b-4b6c-ae70-f11bfabcb136 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:14.817342729 +0000 UTC m=+9.978110646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs") pod "network-metrics-daemon-b88wc" (UID: "b98b32fe-aa1b-4b6c-ae70-f11bfabcb136") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:10.918503 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:10.918465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:10.918667 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:10.918554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjt2\" (UniqueName: \"kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2\") pod \"network-check-target-ld799\" (UID: \"de13a42d-3275-4c9c-a734-f12b7bf144df\") " pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:10.918708 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:10.918691    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:10.918748 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:10.918712    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:10.918748 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:10.918727    2578 projected.go:196] Error preparing data for projected volume kube-api-access-czjt2 for pod openshift-network-diagnostics/network-check-target-ld799: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:10.918866 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:10.918785    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2 podName:de13a42d-3275-4c9c-a734-f12b7bf144df nodeName:}" failed. No retries permitted until 2026-07-28 12:51:14.918766678 +0000 UTC m=+10.079534593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-czjt2" (UniqueName: "kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2") pod "network-check-target-ld799" (UID: "de13a42d-3275-4c9c-a734-f12b7bf144df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:10.919214 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:10.919194    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:10.919277 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:10.919251    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret podName:da3d8ccd-539e-4d22-9e58-2851a576a3cd nodeName:}" failed. No retries permitted until 2026-07-28 12:51:14.919236452 +0000 UTC m=+10.080004369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret") pod "global-pull-secret-syncer-qsknb" (UID: "da3d8ccd-539e-4d22-9e58-2851a576a3cd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:11.268138 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:11.268053    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:11.268588 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:11.268191    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:11.268773 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:11.268757    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:11.268896 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:11.268872    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:12.266194 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:12.266159    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:12.266388 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:12.266310    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:13.267969 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:13.267932    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:13.268367 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:13.268067    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:13.268426 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:13.268403    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:13.268555 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:13.268518    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:14.266205 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:14.266171    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:14.266395 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:14.266316    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:14.851871 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:14.851835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:14.852320 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:14.852010    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:14.852320 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:14.852082    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs podName:b98b32fe-aa1b-4b6c-ae70-f11bfabcb136 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:22.852061865 +0000 UTC m=+18.012829783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs") pod "network-metrics-daemon-b88wc" (UID: "b98b32fe-aa1b-4b6c-ae70-f11bfabcb136") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:14.953268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:14.953232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjt2\" (UniqueName: \"kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2\") pod \"network-check-target-ld799\" (UID: \"de13a42d-3275-4c9c-a734-f12b7bf144df\") " pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:14.953445 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:14.953300    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:14.953445 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:14.953414    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:14.953553 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:14.953462    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret podName:da3d8ccd-539e-4d22-9e58-2851a576a3cd nodeName:}" failed. No retries permitted until 2026-07-28 12:51:22.953447483 +0000 UTC m=+18.114215395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret") pod "global-pull-secret-syncer-qsknb" (UID: "da3d8ccd-539e-4d22-9e58-2851a576a3cd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:14.953781 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:14.953766    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:14.953869 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:14.953789    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:14.953869 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:14.953815    2578 projected.go:196] Error preparing data for projected volume kube-api-access-czjt2 for pod openshift-network-diagnostics/network-check-target-ld799: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:14.953869 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:14.953847    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2 podName:de13a42d-3275-4c9c-a734-f12b7bf144df nodeName:}" failed. No retries permitted until 2026-07-28 12:51:22.9538373 +0000 UTC m=+18.114605212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-czjt2" (UniqueName: "kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2") pod "network-check-target-ld799" (UID: "de13a42d-3275-4c9c-a734-f12b7bf144df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:15.266585 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:15.266507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:15.266735 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:15.266587    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:15.266735 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:15.266602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:15.266735 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:15.266712    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:16.265773 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:16.265741    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:16.266261 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:16.265873    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:17.268816 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:17.268150    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:17.268816 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:17.268280    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:17.268816 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:17.268668    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:17.268816 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:17.268740    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:18.265640 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:18.265610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:18.265796 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:18.265760    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:19.266189 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:19.266153    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:19.266649 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:19.266276    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:19.266649 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:19.266337    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:19.266649 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:19.266464    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:20.265628 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:20.265597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:20.265846 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:20.265730    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:21.266347 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:21.266317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:21.266826 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:21.266444    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:21.266826 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:21.266821    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:21.266946 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:21.266922    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:22.265712 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:22.265679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:22.265999 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:22.265835    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:22.908927 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:22.908887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:22.909404 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:22.909063    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:22.909404 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:22.909160    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs podName:b98b32fe-aa1b-4b6c-ae70-f11bfabcb136 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:38.909136778 +0000 UTC m=+34.069904694 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs") pod "network-metrics-daemon-b88wc" (UID: "b98b32fe-aa1b-4b6c-ae70-f11bfabcb136") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:23.009860 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:23.009817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjt2\" (UniqueName: \"kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2\") pod \"network-check-target-ld799\" (UID: \"de13a42d-3275-4c9c-a734-f12b7bf144df\") " pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:23.010048 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:23.009887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:23.010048 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:23.009962    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:23.010048 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:23.009986    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:23.010048 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:23.009989    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:23.010048 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:23.010006    2578 projected.go:196] Error preparing data for projected volume kube-api-access-czjt2 for pod openshift-network-diagnostics/network-check-target-ld799: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:23.010048 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:23.010050    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret podName:da3d8ccd-539e-4d22-9e58-2851a576a3cd nodeName:}" failed. No retries permitted until 2026-07-28 12:51:39.010028148 +0000 UTC m=+34.170796062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret") pod "global-pull-secret-syncer-qsknb" (UID: "da3d8ccd-539e-4d22-9e58-2851a576a3cd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:23.010297 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:23.010067    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2 podName:de13a42d-3275-4c9c-a734-f12b7bf144df nodeName:}" failed. No retries permitted until 2026-07-28 12:51:39.010060174 +0000 UTC m=+34.170828086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-czjt2" (UniqueName: "kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2") pod "network-check-target-ld799" (UID: "de13a42d-3275-4c9c-a734-f12b7bf144df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:23.265850 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:23.265758    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:23.266009 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:23.265898    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:23.266009 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:23.265954    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:23.266128 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:23.266031    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:24.266313 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:24.266273    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:24.266758 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:24.266419    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:25.266835 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:25.266706    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:25.267292 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:25.266904    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:25.267292 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:25.267012    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:25.267469 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:25.267435    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:26.265765 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:26.265732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:26.265941 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:26.265858    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:27.265660 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.265479    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:27.266062 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.265528    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:27.266062 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:27.265740    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:27.266062 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:27.265789    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:27.480764 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.480731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bz9j6" event={"ID":"a868bee4-b71e-465a-8da6-070c000a597a","Type":"ContainerStarted","Data":"d4f72d4034efaaf0184009e8e6bdf36027f3a5ade18fcaccf69cf613e53ef583"}
Jul 28 12:51:27.482419 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.482396    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4" event={"ID":"0ef8725f-07bb-4f97-a3fa-3d17ff630687","Type":"ContainerStarted","Data":"4c08a8c0a5e61d5cbed9abc6cc398ebad234b0fe28a8068b568b2535a33da414"}
Jul 28 12:51:27.483954 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.483932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kvr75" event={"ID":"95627455-5e31-4559-9b52-fb1864f3c6c5","Type":"ContainerStarted","Data":"48ec15582a3d7f136c05902f980c5082f82aea1ede1ebccefec7eddb21c630af"}
Jul 28 12:51:27.485924 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.485895    2578 generic.go:356] "Generic (PLEG): container finished" podID="9cfe9b83-6bdd-47f3-9d79-ebafe92262e7" containerID="d09fc9f9658de6c795ef290771be2898a778afc638160c3a57a54cb528d27e35" exitCode=0
Jul 28 12:51:27.486050 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.486000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8fnn" event={"ID":"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7","Type":"ContainerDied","Data":"d09fc9f9658de6c795ef290771be2898a778afc638160c3a57a54cb528d27e35"}
Jul 28 12:51:27.487570 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.487552    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jskh7" event={"ID":"607c523b-7e24-41a6-b546-e945742f9491","Type":"ContainerStarted","Data":"dc48cf57e38e799c692e63cde1a38dd1875393bcd0b1f6f85476fe43ef45c12b"}
Jul 28 12:51:27.489074 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.489047    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f84gz" event={"ID":"f022c708-2f19-42f5-9bc2-c353795dda51","Type":"ContainerStarted","Data":"a6237a5e1872d888605f64c14685786a813b79c5089c00b7c30967e953dd8807"}
Jul 28 12:51:27.490370 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.490349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kwxzq" event={"ID":"011d84ea-64de-4dcf-85d6-4c1f9284b4bd","Type":"ContainerStarted","Data":"3362b30d93005668f79ac8e7bbf4992985e078cca235085e9789f98cde3ca293"}
Jul 28 12:51:27.492154 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.492139    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 12:51:27.492471 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.492451    2578 generic.go:356] "Generic (PLEG): container finished" podID="68deab70-a94d-415f-9e9e-e6ef32666642" containerID="7424decf20f517483e71e5a26336c7d07369edd5324afd269c2746ed78c591a9" exitCode=1
Jul 28 12:51:27.492538 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.492481    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq" event={"ID":"68deab70-a94d-415f-9e9e-e6ef32666642","Type":"ContainerStarted","Data":"c866e1eaf4620c030b3356894f97ac556878c1b041991a8c170533552864bad8"}
Jul 28 12:51:27.492580 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.492540    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq" event={"ID":"68deab70-a94d-415f-9e9e-e6ef32666642","Type":"ContainerDied","Data":"7424decf20f517483e71e5a26336c7d07369edd5324afd269c2746ed78c591a9"}
Jul 28 12:51:27.492613 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.492589    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq" event={"ID":"68deab70-a94d-415f-9e9e-e6ef32666642","Type":"ContainerStarted","Data":"cafb03efaee3570b7b96f7d05e0050d8f118a42160bd11ca64a03b3e1b348171"}
Jul 28 12:51:27.499983 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.499942    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bz9j6" podStartSLOduration=3.900077188 podStartE2EDuration="22.499930971s" totalImagesPullingTime="18.599853783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:27.499840155 +0000 UTC m=+22.660608109" watchObservedRunningTime="2026-07-28 12:51:27.499930971 +0000 UTC m=+22.660698905"
Jul 28 12:51:27.520857 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.520793    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kwxzq" podStartSLOduration=3.871945946 podStartE2EDuration="22.520778846s" totalImagesPullingTime="18.6488329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:27.520268538 +0000 UTC m=+22.681036496" watchObservedRunningTime="2026-07-28 12:51:27.520778846 +0000 UTC m=+22.681546780"
Jul 28 12:51:27.544054 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.543270    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kvr75" podStartSLOduration=12.117925791 podStartE2EDuration="22.543254248s" totalImagesPullingTime="10.425328457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:27.542910008 +0000 UTC m=+22.703677945" watchObservedRunningTime="2026-07-28 12:51:27.543254248 +0000 UTC m=+22.704022182"
Jul 28 12:51:27.599566 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.599431    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f84gz" podStartSLOduration=3.974142701 podStartE2EDuration="22.599414971s" totalImagesPullingTime="18.62527227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:27.57487873 +0000 UTC m=+22.735646677" watchObservedRunningTime="2026-07-28 12:51:27.599414971 +0000 UTC m=+22.760182952"
Jul 28 12:51:27.616020 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:27.615983    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jskh7" podStartSLOduration=4.014682562 podStartE2EDuration="22.615963824s" totalImagesPullingTime="18.601281262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:27.615464284 +0000 UTC m=+22.776232243" watchObservedRunningTime="2026-07-28 12:51:27.615963824 +0000 UTC m=+22.776731759"
Jul 28 12:51:28.075565 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.075539    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:28.076059 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.076041    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:28.112354 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.112335    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 12:51:28.240519 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.240415    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T12:51:28.112349936Z","UUID":"0692c3b3-ae39-4ea2-ba55-5139f83df0d0","Handler":null,"Name":"","Endpoint":""}
Jul 28 12:51:28.241745 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.241727    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 12:51:28.241857 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.241762    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 12:51:28.265896 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.265843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:28.266464 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:28.265966    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:28.497111 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.496686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vwmr8" event={"ID":"664266f1-1fa1-48b1-bc3d-1432f56cb0d9","Type":"ContainerStarted","Data":"c16d95ec36d41b5ad212a6bab2ecc4339af923c6bc694a067efc4ff25bf883a6"}
Jul 28 12:51:28.499699 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.499677    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 12:51:28.500182 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.500156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq" event={"ID":"68deab70-a94d-415f-9e9e-e6ef32666642","Type":"ContainerStarted","Data":"afd6668e4cd5c90c263d36406c5f06c03a66f7d5b42bb2f09a820613cbcb2ac2"}
Jul 28 12:51:28.500305 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.500233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq" event={"ID":"68deab70-a94d-415f-9e9e-e6ef32666642","Type":"ContainerStarted","Data":"e9228734441a419a4395dd5df953271dbfdfcccc64d4057003043c763abe8e34"}
Jul 28 12:51:28.500305 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.500283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq" event={"ID":"68deab70-a94d-415f-9e9e-e6ef32666642","Type":"ContainerStarted","Data":"758d680d59e0e38b144da705efa825589a7ea62d772ebc408a25e2413f55ac42"}
Jul 28 12:51:28.502209 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.502152    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4" event={"ID":"0ef8725f-07bb-4f97-a3fa-3d17ff630687","Type":"ContainerStarted","Data":"a3ede05c3f38cf6aaa7d5b6ce2e0c7f670549e965f440ae9b6e3d1df64cc345b"}
Jul 28 12:51:28.502873 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.502849    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:28.503345 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.503328    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kvr75"
Jul 28 12:51:28.544061 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:28.544012    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vwmr8" podStartSLOduration=4.919880208 podStartE2EDuration="23.543997981s" totalImagesPullingTime="18.624117773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:28.518922707 +0000 UTC m=+23.679690664" watchObservedRunningTime="2026-07-28 12:51:28.543997981 +0000 UTC m=+23.704765914"
Jul 28 12:51:29.266761 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:29.266340    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:29.266761 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:29.266461    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:29.266761 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:29.266522    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:29.266761 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:29.266629    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:30.265856 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:30.265587    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:30.266008 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:30.265940    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:30.510070 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:30.510044    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 12:51:30.510524 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:30.510491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq" event={"ID":"68deab70-a94d-415f-9e9e-e6ef32666642","Type":"ContainerStarted","Data":"84c03a162c2ffa08168fed9bb46a70bcb51730cb1807e5b63ff82aea1f56132d"}
Jul 28 12:51:30.512877 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:30.512846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4" event={"ID":"0ef8725f-07bb-4f97-a3fa-3d17ff630687","Type":"ContainerStarted","Data":"461eee7717972516163043de8d6999b74bf23089b8de3bcdfa99579cb6dbe3f8"}
Jul 28 12:51:31.265913 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:31.265878    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:31.266109 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:31.265890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:31.266109 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:31.266012    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:31.266109 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:31.266072    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:32.266088 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:32.265844    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:32.266847 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:32.266103    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:32.520818 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:32.520780    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 12:51:32.521205 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:32.521178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq" event={"ID":"68deab70-a94d-415f-9e9e-e6ef32666642","Type":"ContainerStarted","Data":"9b4ea2a101a04f0b3eeeebac0cbe28268dba223e448dd53b7ff2319b1605a9ce"}
Jul 28 12:51:32.521427 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:32.521411    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:32.521754 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:32.521739    2578 scope.go:117] "RemoveContainer" containerID="7424decf20f517483e71e5a26336c7d07369edd5324afd269c2746ed78c591a9"
Jul 28 12:51:32.523150 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:32.523128    2578 generic.go:356] "Generic (PLEG): container finished" podID="9cfe9b83-6bdd-47f3-9d79-ebafe92262e7" containerID="a4237c03f4c85402bcc1c121d659eb32eb138d86aba8c1232a504d002d8ce80f" exitCode=0
Jul 28 12:51:32.523267 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:32.523160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8fnn" event={"ID":"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7","Type":"ContainerDied","Data":"a4237c03f4c85402bcc1c121d659eb32eb138d86aba8c1232a504d002d8ce80f"}
Jul 28 12:51:32.538669 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:32.538650    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:32.556888 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:32.556852    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rfv4" podStartSLOduration=14.860056641 podStartE2EDuration="27.55683895s" totalImagesPullingTime="12.696782309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:30.537198658 +0000 UTC m=+25.697966619" watchObservedRunningTime="2026-07-28 12:51:32.55683895 +0000 UTC m=+27.717606893"
Jul 28 12:51:33.266036 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:33.266004    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:33.266303 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:33.266127    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:33.266715 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:33.266611    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:33.266715 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:33.266704    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:33.527501 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:33.527471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8fnn" event={"ID":"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7","Type":"ContainerStarted","Data":"c7097f58121f7128cf8e1d136c580f6da633adda4038fa5b0d72cf1675ae15c4"}
Jul 28 12:51:33.532998 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:33.532981    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 12:51:33.533391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:33.533363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq" event={"ID":"68deab70-a94d-415f-9e9e-e6ef32666642","Type":"ContainerStarted","Data":"795a09f0fa1c9bf6c6ace25e1808f9dc0609155d1e8029c8386b629b8741e961"}
Jul 28 12:51:33.533654 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:33.533637    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:33.533729 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:33.533714    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:33.549069 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:33.549042    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:51:33.595531 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:33.595481    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq" podStartSLOduration=9.913134953 podStartE2EDuration="28.59546582s" totalImagesPullingTime="18.682330867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:33.595375651 +0000 UTC m=+28.756143608" watchObservedRunningTime="2026-07-28 12:51:33.59546582 +0000 UTC m=+28.756233786"
Jul 28 12:51:34.266199 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:34.266172    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:34.266360 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:34.266265    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:34.537453 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:34.537424    2578 generic.go:356] "Generic (PLEG): container finished" podID="9cfe9b83-6bdd-47f3-9d79-ebafe92262e7" containerID="c7097f58121f7128cf8e1d136c580f6da633adda4038fa5b0d72cf1675ae15c4" exitCode=0
Jul 28 12:51:34.537613 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:34.537519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8fnn" event={"ID":"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7","Type":"ContainerDied","Data":"c7097f58121f7128cf8e1d136c580f6da633adda4038fa5b0d72cf1675ae15c4"}
Jul 28 12:51:34.610825 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:34.610780    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qsknb"]
Jul 28 12:51:34.610959 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:34.610933    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:34.611080 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:34.611038    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:34.614460 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:34.614440    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ld799"]
Jul 28 12:51:34.614546 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:34.614523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:34.614605 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:34.614590    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:34.617046 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:34.617022    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b88wc"]
Jul 28 12:51:34.617121 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:34.617104    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:34.617216 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:34.617196    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:35.542542 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:35.542512    2578 generic.go:356] "Generic (PLEG): container finished" podID="9cfe9b83-6bdd-47f3-9d79-ebafe92262e7" containerID="a14fbfad2cd631ba59f3874c67b899020b7585181028b591ea7a0872d3703916" exitCode=0
Jul 28 12:51:35.542930 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:35.542601    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8fnn" event={"ID":"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7","Type":"ContainerDied","Data":"a14fbfad2cd631ba59f3874c67b899020b7585181028b591ea7a0872d3703916"}
Jul 28 12:51:36.266418 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:36.266201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:36.266592 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:36.266244    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:36.266592 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:36.266519    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:36.266592 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:36.266247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:36.266715 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:36.266620    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:36.266715 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:36.266674    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:38.265439 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:38.265409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:38.265855 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:38.265475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:38.265855 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:38.265566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:38.265855 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:38.265583    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b88wc" podUID="b98b32fe-aa1b-4b6c-ae70-f11bfabcb136"
Jul 28 12:51:38.265855 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:38.265646    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsknb" podUID="da3d8ccd-539e-4d22-9e58-2851a576a3cd"
Jul 28 12:51:38.265855 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:38.265682    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ld799" podUID="de13a42d-3275-4c9c-a734-f12b7bf144df"
Jul 28 12:51:38.925283 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:38.925249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:38.925506 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:38.925405    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:38.925506 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:38.925485    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs podName:b98b32fe-aa1b-4b6c-ae70-f11bfabcb136 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:10.925463202 +0000 UTC m=+66.086231131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs") pod "network-metrics-daemon-b88wc" (UID: "b98b32fe-aa1b-4b6c-ae70-f11bfabcb136") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:39.026485 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:39.026442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjt2\" (UniqueName: \"kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2\") pod \"network-check-target-ld799\" (UID: \"de13a42d-3275-4c9c-a734-f12b7bf144df\") " pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:39.026667 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:39.026497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:39.026667 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:39.026606    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:39.026667 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:39.026619    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:39.026667 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:39.026643    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:39.026667 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:39.026658    2578 projected.go:196] Error preparing data for projected volume kube-api-access-czjt2 for pod openshift-network-diagnostics/network-check-target-ld799: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:39.026667 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:39.026671    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret podName:da3d8ccd-539e-4d22-9e58-2851a576a3cd nodeName:}" failed. No retries permitted until 2026-07-28 12:52:11.026657073 +0000 UTC m=+66.187424988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret") pod "global-pull-secret-syncer-qsknb" (UID: "da3d8ccd-539e-4d22-9e58-2851a576a3cd") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:39.026952 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:39.026700    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2 podName:de13a42d-3275-4c9c-a734-f12b7bf144df nodeName:}" failed. No retries permitted until 2026-07-28 12:52:11.026687809 +0000 UTC m=+66.187455721 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-czjt2" (UniqueName: "kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2") pod "network-check-target-ld799" (UID: "de13a42d-3275-4c9c-a734-f12b7bf144df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:40.147940 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.147908    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-204.ec2.internal" event="NodeReady"
Jul 28 12:51:40.148355 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.148043    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 12:51:40.188666 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.188634    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-869f55c65f-zzvcr"]
Jul 28 12:51:40.212353 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.212322    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"]
Jul 28 12:51:40.212520 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.212472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.215440 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.215414    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 12:51:40.215552 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.215467    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q9wzr\""
Jul 28 12:51:40.215759 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.215740    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 12:51:40.216827 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.216796    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 12:51:40.225136 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.225119    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 12:51:40.230381 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.230364    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"]
Jul 28 12:51:40.230495 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.230480    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"
Jul 28 12:51:40.234717 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.234697    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 12:51:40.235249 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.235111    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:51:40.235585 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.235382    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 12:51:40.238880 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.238857    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 12:51:40.243824 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.240038    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jr5cp\""
Jul 28 12:51:40.253756 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.253735    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-869f55c65f-zzvcr"]
Jul 28 12:51:40.253872 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.253776    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"]
Jul 28 12:51:40.253872 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.253831    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7cf9w"]
Jul 28 12:51:40.253980 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.253884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:51:40.257055 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.256992    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 12:51:40.257055 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.257006    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 12:51:40.257216 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.257083    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nm6rv\""
Jul 28 12:51:40.274496 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.274477    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.275027 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.274570    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-7b8zl"]
Jul 28 12:51:40.277981 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.277958    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 12:51:40.279345 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.279322    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wxrjt\""
Jul 28 12:51:40.279438 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.279428    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 12:51:40.300400 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.300376    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-msfd9"]
Jul 28 12:51:40.300511 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.300496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.303653 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.303633    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 12:51:40.303768 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.303650    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 28 12:51:40.303906 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.303893    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 28 12:51:40.304208 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.304190    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 12:51:40.304208 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.304195    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-crp6x\""
Jul 28 12:51:40.309841 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.309797    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 28 12:51:40.320599 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.320574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-msfd9"
Jul 28 12:51:40.320669 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.320627    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"]
Jul 28 12:51:40.320757 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.320737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:51:40.320864 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.320737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:51:40.320926 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.320896    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:51:40.324682 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.324656    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:51:40.325221 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.325204    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lj4m2\""
Jul 28 12:51:40.325366 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.325350    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n8x7n\""
Jul 28 12:51:40.325418 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.325398    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 12:51:40.325724 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.325692    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 12:51:40.326165 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.326145    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 12:51:40.326255 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.326179    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 12:51:40.326329 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.326311    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lcpbt\""
Jul 28 12:51:40.326381 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.326371    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 12:51:40.334867 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.334843    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.334963 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.334897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-image-registry-private-configuration\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.334963 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.334925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbndn\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-kube-api-access-dbndn\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.335044 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.334961    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hwjr\" (UniqueName: \"kubernetes.io/projected/e5687e46-d034-44c4-8bd5-57cd0dc9c05f-kube-api-access-7hwjr\") pod \"service-ca-operator-5d6c75f84f-7rh5b\" (UID: \"e5687e46-d034-44c4-8bd5-57cd0dc9c05f\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"
Jul 28 12:51:40.335044 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.335021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-trusted-ca\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.335112 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.335096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-registry-certificates\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.335170 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.335156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-installation-pull-secrets\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.335205 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.335179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-bound-sa-token\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.335237 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.335203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dd65c8d4-7057-46c9-945c-ce9db4bf0150-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:51:40.335237 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.335217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5687e46-d034-44c4-8bd5-57cd0dc9c05f-config\") pod \"service-ca-operator-5d6c75f84f-7rh5b\" (UID: \"e5687e46-d034-44c4-8bd5-57cd0dc9c05f\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"
Jul 28 12:51:40.335312 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.335241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5687e46-d034-44c4-8bd5-57cd0dc9c05f-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7rh5b\" (UID: \"e5687e46-d034-44c4-8bd5-57cd0dc9c05f\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"
Jul 28 12:51:40.335312 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.335259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c00717df-f13d-4716-9a39-604c35b9265b-ca-trust-extracted\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.335312 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.335278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:51:40.342836 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.342817    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-98cffcd85-lcdgz"]
Jul 28 12:51:40.342931 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.342921    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:51:40.346328 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.346307    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 12:51:40.346426 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.346411    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 12:51:40.346647 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.346314    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:51:40.349751 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.347001    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-44zj7\""
Jul 28 12:51:40.364159 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.364134    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"]
Jul 28 12:51:40.364269 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.364248    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.372218 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.372195    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 12:51:40.372365 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.372342    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 12:51:40.372842 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.372382    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 12:51:40.372842 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.372419    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 12:51:40.372842 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.372264    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 12:51:40.372842 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.372351    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 12:51:40.373060 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.372848    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h8q9d\""
Jul 28 12:51:40.390455 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.390434    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"]
Jul 28 12:51:40.390578 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.390559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"
Jul 28 12:51:40.393266 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.393247    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:51:40.394014 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.393991    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 28 12:51:40.394221 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.394024    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 28 12:51:40.394557 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.394532    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wg7hc\""
Jul 28 12:51:40.394822 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.394792    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 28 12:51:40.415742 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.415686    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-k7ghm"]
Jul 28 12:51:40.415869 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.415831    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:40.418778 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.418756    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 12:51:40.419134 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.419116    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ct6t5\""
Jul 28 12:51:40.420562 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.420544    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 12:51:40.420660 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.420578    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 28 12:51:40.420660 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.420580    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 28 12:51:40.429898 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.429879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"]
Jul 28 12:51:40.429997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.429909    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-msfd9"]
Jul 28 12:51:40.429997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.429924    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7cf9w"]
Jul 28 12:51:40.429997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.429942    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-7b8zl"]
Jul 28 12:51:40.429997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.429958    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"]
Jul 28 12:51:40.429997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.429983    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"]
Jul 28 12:51:40.429997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.430000    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-gwjgm"]
Jul 28 12:51:40.430187 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.430034    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.432875 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.432859    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 28 12:51:40.434036 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.433965    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 28 12:51:40.434140 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.434040    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 28 12:51:40.435173 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435155    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:51:40.435334 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435159    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pq2vt\""
Jul 28 12:51:40.435747 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-image-registry-private-configuration\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.435854 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbndn\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-kube-api-access-dbndn\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.435854 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hwjr\" (UniqueName: \"kubernetes.io/projected/e5687e46-d034-44c4-8bd5-57cd0dc9c05f-kube-api-access-7hwjr\") pod \"service-ca-operator-5d6c75f84f-7rh5b\" (UID: \"e5687e46-d034-44c4-8bd5-57cd0dc9c05f\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"
Jul 28 12:51:40.435854 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svnw\" (UniqueName: \"kubernetes.io/projected/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-kube-api-access-2svnw\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.436021 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-tmp-dir\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.436021 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-trusted-ca\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.436021 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-config-volume\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.436021 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-registry-certificates\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.436021 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-snapshots\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.436021 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.435996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:51:40.436286 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-installation-pull-secrets\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.436286 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-tmp\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.436286 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-service-ca-bundle\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.436286 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-serving-cert\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.436286 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-bound-sa-token\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.436286 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.436286 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvw72\" (UniqueName: \"kubernetes.io/projected/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-kube-api-access-kvw72\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.436286 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdfph\" (UniqueName: \"kubernetes.io/projected/6b95039e-7b8c-4847-8b03-77de7444f84e-kube-api-access-cdfph\") pod \"volume-data-source-validator-549c6d54cf-msfd9\" (UID: \"6b95039e-7b8c-4847-8b03-77de7444f84e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-msfd9"
Jul 28 12:51:40.436286 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2qrj\" (UniqueName: \"kubernetes.io/projected/76a5484e-7de9-453a-9210-a1af20f40e46-kube-api-access-x2qrj\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:51:40.436712 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dd65c8d4-7057-46c9-945c-ce9db4bf0150-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:51:40.436712 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5687e46-d034-44c4-8bd5-57cd0dc9c05f-config\") pod \"service-ca-operator-5d6c75f84f-7rh5b\" (UID: \"e5687e46-d034-44c4-8bd5-57cd0dc9c05f\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"
Jul 28 12:51:40.436712 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5687e46-d034-44c4-8bd5-57cd0dc9c05f-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7rh5b\" (UID: \"e5687e46-d034-44c4-8bd5-57cd0dc9c05f\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"
Jul 28 12:51:40.436712 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c00717df-f13d-4716-9a39-604c35b9265b-ca-trust-extracted\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.436712 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.436712 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.436485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:51:40.436712 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.436586    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:51:40.436712 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.436654    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert podName:dd65c8d4-7057-46c9-945c-ce9db4bf0150 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:40.936632305 +0000 UTC m=+36.097400231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-c7dk6" (UID: "dd65c8d4-7057-46c9-945c-ce9db4bf0150") : secret "networking-console-plugin-cert" not found
Jul 28 12:51:40.437942 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.437363    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c00717df-f13d-4716-9a39-604c35b9265b-ca-trust-extracted\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.437942 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.437613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-registry-certificates\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.437942 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.437664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.437942 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.437783    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:51:40.437942 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.437797    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869f55c65f-zzvcr: secret "image-registry-tls" not found
Jul 28 12:51:40.437942 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.437868    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls podName:c00717df-f13d-4716-9a39-604c35b9265b nodeName:}" failed. No retries permitted until 2026-07-28 12:51:40.937850387 +0000 UTC m=+36.098618299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls") pod "image-registry-869f55c65f-zzvcr" (UID: "c00717df-f13d-4716-9a39-604c35b9265b") : secret "image-registry-tls" not found
Jul 28 12:51:40.438343 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.438064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dd65c8d4-7057-46c9-945c-ce9db4bf0150-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:51:40.439192 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.438487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5687e46-d034-44c4-8bd5-57cd0dc9c05f-config\") pod \"service-ca-operator-5d6c75f84f-7rh5b\" (UID: \"e5687e46-d034-44c4-8bd5-57cd0dc9c05f\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"
Jul 28 12:51:40.441270 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.441245    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-trusted-ca\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.442415 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.442394    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 28 12:51:40.442564 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.442540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-image-registry-private-configuration\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.442635 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.442599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-installation-pull-secrets\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.443496 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.443473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5687e46-d034-44c4-8bd5-57cd0dc9c05f-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7rh5b\" (UID: \"e5687e46-d034-44c4-8bd5-57cd0dc9c05f\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"
Jul 28 12:51:40.445924 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.445902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-bound-sa-token\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.456084 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.456065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hwjr\" (UniqueName: \"kubernetes.io/projected/e5687e46-d034-44c4-8bd5-57cd0dc9c05f-kube-api-access-7hwjr\") pod \"service-ca-operator-5d6c75f84f-7rh5b\" (UID: \"e5687e46-d034-44c4-8bd5-57cd0dc9c05f\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"
Jul 28 12:51:40.458055 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.458036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbndn\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-kube-api-access-dbndn\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.464420 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.464399    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mgf4h"]
Jul 28 12:51:40.465682 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.465662    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-gwjgm"
Jul 28 12:51:40.470039 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.470024    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8pxqp\""
Jul 28 12:51:40.488635 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.488614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-k7ghm"]
Jul 28 12:51:40.488745 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.488643    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"]
Jul 28 12:51:40.488745 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.488658    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-98cffcd85-lcdgz"]
Jul 28 12:51:40.488745 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.488671    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-gwjgm"]
Jul 28 12:51:40.488745 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.488684    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mgf4h"]
Jul 28 12:51:40.488958 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.488750    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mgf4h"
Jul 28 12:51:40.492316 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.492286    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 12:51:40.492584 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.492463    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 12:51:40.492584 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.492538    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qldgx\""
Jul 28 12:51:40.492695 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.492656    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 12:51:40.538617 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.538593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfph\" (UniqueName: \"kubernetes.io/projected/6b95039e-7b8c-4847-8b03-77de7444f84e-kube-api-access-cdfph\") pod \"volume-data-source-validator-549c6d54cf-msfd9\" (UID: \"6b95039e-7b8c-4847-8b03-77de7444f84e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-msfd9"
Jul 28 12:51:40.538710 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.538622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-serving-cert\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.538710 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.538649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30bc73c0-3fcf-4377-8324-d8aa53a6fd95-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk\" (UID: \"30bc73c0-3fcf-4377-8324-d8aa53a6fd95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"
Jul 28 12:51:40.538710 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.538675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-stats-auth\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.538869 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.538743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db0c90d4-38e0-4275-bc1c-98ac44f91d58-trusted-ca\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.538869 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.538832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-default-certificate\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.538948 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.538872    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv9xf\" (UniqueName: \"kubernetes.io/projected/75391787-ee75-4954-af25-755dd1f434b4-kube-api-access-xv9xf\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:40.538948 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.538896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db0c90d4-38e0-4275-bc1c-98ac44f91d58-serving-cert\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.539041 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.538956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svnw\" (UniqueName: \"kubernetes.io/projected/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-kube-api-access-2svnw\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.539041 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9t45\" (UniqueName: \"kubernetes.io/projected/30bc73c0-3fcf-4377-8324-d8aa53a6fd95-kube-api-access-w9t45\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk\" (UID: \"30bc73c0-3fcf-4377-8324-d8aa53a6fd95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"
Jul 28 12:51:40.539135 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2qrj\" (UniqueName: \"kubernetes.io/projected/76a5484e-7de9-453a-9210-a1af20f40e46-kube-api-access-x2qrj\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:51:40.539135 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-snapshots\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.539135 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30bc73c0-3fcf-4377-8324-d8aa53a6fd95-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk\" (UID: \"30bc73c0-3fcf-4377-8324-d8aa53a6fd95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"
Jul 28 12:51:40.539135 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.539308 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-tmp\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.539308 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-service-ca-bundle\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.539308 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.539308 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvw72\" (UniqueName: \"kubernetes.io/projected/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-kube-api-access-kvw72\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.539484 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:40.539484 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.539387    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:51:40.539484 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.539484 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.539452    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls podName:011fbc6a-9e73-4aaf-8c83-bd717507d2b5 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:41.039434012 +0000 UTC m=+36.200201924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls") pod "dns-default-7cf9w" (UID: "011fbc6a-9e73-4aaf-8c83-bd717507d2b5") : secret "dns-default-metrics-tls" not found
Jul 28 12:51:40.539484 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db0c90d4-38e0-4275-bc1c-98ac44f91d58-config\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.539720 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-tmp-dir\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.539720 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.539720 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-config-volume\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.539720 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvwqd\" (UniqueName: \"kubernetes.io/projected/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-kube-api-access-bvwqd\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.539720 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539642    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlsqr\" (UniqueName: \"kubernetes.io/projected/db0c90d4-38e0-4275-bc1c-98ac44f91d58-kube-api-access-dlsqr\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.539720 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-tmp\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.539720 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:51:40.539720 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-snapshots\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.540063 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75391787-ee75-4954-af25-755dd1f434b4-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:40.540063 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.539769    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 12:51:40.540063 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.539848    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls podName:76a5484e-7de9-453a-9210-a1af20f40e46 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:41.039827372 +0000 UTC m=+36.200595297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls") pod "cluster-samples-operator-6748489656-v5dzm" (UID: "76a5484e-7de9-453a-9210-a1af20f40e46") : secret "samples-operator-tls" not found
Jul 28 12:51:40.540063 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-service-ca-bundle\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.540063 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.539913    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-tmp-dir\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.540228 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.540081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-config-volume\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.540411 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.540394    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.540971 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.540954    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-serving-cert\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.541847 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.541834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"
Jul 28 12:51:40.548219 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.548194    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2qrj\" (UniqueName: \"kubernetes.io/projected/76a5484e-7de9-453a-9210-a1af20f40e46-kube-api-access-x2qrj\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:51:40.548704 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.548686    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdfph\" (UniqueName: \"kubernetes.io/projected/6b95039e-7b8c-4847-8b03-77de7444f84e-kube-api-access-cdfph\") pod \"volume-data-source-validator-549c6d54cf-msfd9\" (UID: \"6b95039e-7b8c-4847-8b03-77de7444f84e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-msfd9"
Jul 28 12:51:40.548903 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.548885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvw72\" (UniqueName: \"kubernetes.io/projected/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-kube-api-access-kvw72\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:40.549227 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.549212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svnw\" (UniqueName: \"kubernetes.io/projected/8e4ad1a7-d332-4a33-8256-bf5082aba4c3-kube-api-access-2svnw\") pod \"insights-operator-5885fdb759-7b8zl\" (UID: \"8e4ad1a7-d332-4a33-8256-bf5082aba4c3\") " pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.557272 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.557250    2578 generic.go:356] "Generic (PLEG): container finished" podID="9cfe9b83-6bdd-47f3-9d79-ebafe92262e7" containerID="44f2c5fe0d3ad4c2c03306b6aef04ada4d4c0498bb0dc2cf5f0326197bc72502" exitCode=0
Jul 28 12:51:40.557342 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.557300    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8fnn" event={"ID":"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7","Type":"ContainerDied","Data":"44f2c5fe0d3ad4c2c03306b6aef04ada4d4c0498bb0dc2cf5f0326197bc72502"}
Jul 28 12:51:40.629324 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.629177    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-7b8zl"
Jul 28 12:51:40.637136 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.637107    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-msfd9"
Jul 28 12:51:40.640446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30bc73c0-3fcf-4377-8324-d8aa53a6fd95-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk\" (UID: \"30bc73c0-3fcf-4377-8324-d8aa53a6fd95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"
Jul 28 12:51:40.640504 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-stats-auth\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.640504 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db0c90d4-38e0-4275-bc1c-98ac44f91d58-trusted-ca\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.640574 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhr4d\" (UniqueName: \"kubernetes.io/projected/eed8a04e-5aea-410a-a3c6-083c1ebd26bb-kube-api-access-fhr4d\") pod \"ingress-canary-mgf4h\" (UID: \"eed8a04e-5aea-410a-a3c6-083c1ebd26bb\") " pod="openshift-ingress-canary/ingress-canary-mgf4h"
Jul 28 12:51:40.640574 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-default-certificate\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.640663 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv9xf\" (UniqueName: \"kubernetes.io/projected/75391787-ee75-4954-af25-755dd1f434b4-kube-api-access-xv9xf\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:40.640663 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db0c90d4-38e0-4275-bc1c-98ac44f91d58-serving-cert\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.640768 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9t45\" (UniqueName: \"kubernetes.io/projected/30bc73c0-3fcf-4377-8324-d8aa53a6fd95-kube-api-access-w9t45\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk\" (UID: \"30bc73c0-3fcf-4377-8324-d8aa53a6fd95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"
Jul 28 12:51:40.640768 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30bc73c0-3fcf-4377-8324-d8aa53a6fd95-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk\" (UID: \"30bc73c0-3fcf-4377-8324-d8aa53a6fd95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"
Jul 28 12:51:40.640768 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.640938 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:40.640938 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db0c90d4-38e0-4275-bc1c-98ac44f91d58-config\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.640938 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.640938 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz7fm\" (UniqueName: \"kubernetes.io/projected/b4219b34-a3cc-4dd9-9a04-75bf9fa89032-kube-api-access-mz7fm\") pod \"network-check-source-7d88cb55d8-gwjgm\" (UID: \"b4219b34-a3cc-4dd9-9a04-75bf9fa89032\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-gwjgm"
Jul 28 12:51:40.641135 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.640970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvwqd\" (UniqueName: \"kubernetes.io/projected/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-kube-api-access-bvwqd\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.641135 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.641003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlsqr\" (UniqueName: \"kubernetes.io/projected/db0c90d4-38e0-4275-bc1c-98ac44f91d58-kube-api-access-dlsqr\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.641135 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.641013    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:40.641135 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.641042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eed8a04e-5aea-410a-a3c6-083c1ebd26bb-cert\") pod \"ingress-canary-mgf4h\" (UID: \"eed8a04e-5aea-410a-a3c6-083c1ebd26bb\") " pod="openshift-ingress-canary/ingress-canary-mgf4h"
Jul 28 12:51:40.641135 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.641079    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls podName:75391787-ee75-4954-af25-755dd1f434b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:41.14106232 +0000 UTC m=+36.301830252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4vb57" (UID: "75391787-ee75-4954-af25-755dd1f434b4") : secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:40.641135 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.641117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75391787-ee75-4954-af25-755dd1f434b4-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:40.641430 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.641152    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/30bc73c0-3fcf-4377-8324-d8aa53a6fd95-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk\" (UID: \"30bc73c0-3fcf-4377-8324-d8aa53a6fd95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"
Jul 28 12:51:40.641560 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.641538    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db0c90d4-38e0-4275-bc1c-98ac44f91d58-trusted-ca\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.641676 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.641662    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 12:51:40.641738 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.641726    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:41.141709304 +0000 UTC m=+36.302477216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : secret "router-metrics-certs-default" not found
Jul 28 12:51:40.642329 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.642143    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:41.142127478 +0000 UTC m=+36.302895394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : configmap references non-existent config key: service-ca.crt
Jul 28 12:51:40.642329 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.642315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75391787-ee75-4954-af25-755dd1f434b4-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:40.642493 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.642423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db0c90d4-38e0-4275-bc1c-98ac44f91d58-config\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.643388 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.643368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db0c90d4-38e0-4275-bc1c-98ac44f91d58-serving-cert\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.643548 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.643532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/30bc73c0-3fcf-4377-8324-d8aa53a6fd95-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk\" (UID: \"30bc73c0-3fcf-4377-8324-d8aa53a6fd95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"
Jul 28 12:51:40.643869 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.643850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-default-certificate\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.643904 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.643875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-stats-auth\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.649889 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.649866    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv9xf\" (UniqueName: \"kubernetes.io/projected/75391787-ee75-4954-af25-755dd1f434b4-kube-api-access-xv9xf\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:40.650357 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.650340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9t45\" (UniqueName: \"kubernetes.io/projected/30bc73c0-3fcf-4377-8324-d8aa53a6fd95-kube-api-access-w9t45\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk\" (UID: \"30bc73c0-3fcf-4377-8324-d8aa53a6fd95\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"
Jul 28 12:51:40.653490 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.653466    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvwqd\" (UniqueName: \"kubernetes.io/projected/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-kube-api-access-bvwqd\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:40.653878 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.653861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlsqr\" (UniqueName: \"kubernetes.io/projected/db0c90d4-38e0-4275-bc1c-98ac44f91d58-kube-api-access-dlsqr\") pod \"console-operator-584dcb6b54-k7ghm\" (UID: \"db0c90d4-38e0-4275-bc1c-98ac44f91d58\") " pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.700938 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.700874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"
Jul 28 12:51:40.742690 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.742559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz7fm\" (UniqueName: \"kubernetes.io/projected/b4219b34-a3cc-4dd9-9a04-75bf9fa89032-kube-api-access-mz7fm\") pod \"network-check-source-7d88cb55d8-gwjgm\" (UID: \"b4219b34-a3cc-4dd9-9a04-75bf9fa89032\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-gwjgm"
Jul 28 12:51:40.742690 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.742635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eed8a04e-5aea-410a-a3c6-083c1ebd26bb-cert\") pod \"ingress-canary-mgf4h\" (UID: \"eed8a04e-5aea-410a-a3c6-083c1ebd26bb\") " pod="openshift-ingress-canary/ingress-canary-mgf4h"
Jul 28 12:51:40.742690 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.742657    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:40.742999 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.742741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhr4d\" (UniqueName: \"kubernetes.io/projected/eed8a04e-5aea-410a-a3c6-083c1ebd26bb-kube-api-access-fhr4d\") pod \"ingress-canary-mgf4h\" (UID: \"eed8a04e-5aea-410a-a3c6-083c1ebd26bb\") " pod="openshift-ingress-canary/ingress-canary-mgf4h"
Jul 28 12:51:40.748886 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.748654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eed8a04e-5aea-410a-a3c6-083c1ebd26bb-cert\") pod \"ingress-canary-mgf4h\" (UID: \"eed8a04e-5aea-410a-a3c6-083c1ebd26bb\") " pod="openshift-ingress-canary/ingress-canary-mgf4h"
Jul 28 12:51:40.755626 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.755600    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhr4d\" (UniqueName: \"kubernetes.io/projected/eed8a04e-5aea-410a-a3c6-083c1ebd26bb-kube-api-access-fhr4d\") pod \"ingress-canary-mgf4h\" (UID: \"eed8a04e-5aea-410a-a3c6-083c1ebd26bb\") " pod="openshift-ingress-canary/ingress-canary-mgf4h"
Jul 28 12:51:40.756297 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.756278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz7fm\" (UniqueName: \"kubernetes.io/projected/b4219b34-a3cc-4dd9-9a04-75bf9fa89032-kube-api-access-mz7fm\") pod \"network-check-source-7d88cb55d8-gwjgm\" (UID: \"b4219b34-a3cc-4dd9-9a04-75bf9fa89032\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-gwjgm"
Jul 28 12:51:40.764935 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.764909    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b"]
Jul 28 12:51:40.774173 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.774150    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-gwjgm"
Jul 28 12:51:40.810525 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.810495    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-7b8zl"]
Jul 28 12:51:40.828132 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.828111    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mgf4h"
Jul 28 12:51:40.832074 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.832050    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-msfd9"]
Jul 28 12:51:40.839076 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:40.838985    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4ad1a7_d332_4a33_8256_bf5082aba4c3.slice/crio-4bc8909eca303a011be1530209586199f2766f6b35495fb2e7eee98c5631ca55 WatchSource:0}: Error finding container 4bc8909eca303a011be1530209586199f2766f6b35495fb2e7eee98c5631ca55: Status 404 returned error can't find the container with id 4bc8909eca303a011be1530209586199f2766f6b35495fb2e7eee98c5631ca55
Jul 28 12:51:40.839743 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:40.839571    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b95039e_7b8c_4847_8b03_77de7444f84e.slice/crio-181021712f1ef8bbddab5ffc1e803e355243f0b07d70136be1bdb153ecaf7c36 WatchSource:0}: Error finding container 181021712f1ef8bbddab5ffc1e803e355243f0b07d70136be1bdb153ecaf7c36: Status 404 returned error can't find the container with id 181021712f1ef8bbddab5ffc1e803e355243f0b07d70136be1bdb153ecaf7c36
Jul 28 12:51:40.840640 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:40.840223    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5687e46_d034_44c4_8bd5_57cd0dc9c05f.slice/crio-79ae9393ec69b4281c3f1db61a819881c50cfb268bc7ba0552d836ae5d6a343e WatchSource:0}: Error finding container 79ae9393ec69b4281c3f1db61a819881c50cfb268bc7ba0552d836ae5d6a343e: Status 404 returned error can't find the container with id 79ae9393ec69b4281c3f1db61a819881c50cfb268bc7ba0552d836ae5d6a343e
Jul 28 12:51:40.945945 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.945853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:40.946088 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.946006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:51:40.946315 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.946195    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:51:40.946315 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.946209    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:51:40.946315 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.946222    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869f55c65f-zzvcr: secret "image-registry-tls" not found
Jul 28 12:51:40.946315 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.946262    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert podName:dd65c8d4-7057-46c9-945c-ce9db4bf0150 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:41.94624337 +0000 UTC m=+37.107011303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-c7dk6" (UID: "dd65c8d4-7057-46c9-945c-ce9db4bf0150") : secret "networking-console-plugin-cert" not found
Jul 28 12:51:40.946315 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:40.946279    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls podName:c00717df-f13d-4716-9a39-604c35b9265b nodeName:}" failed. No retries permitted until 2026-07-28 12:51:41.94627073 +0000 UTC m=+37.107038644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls") pod "image-registry-869f55c65f-zzvcr" (UID: "c00717df-f13d-4716-9a39-604c35b9265b") : secret "image-registry-tls" not found
Jul 28 12:51:40.991246 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:40.991210    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk"]
Jul 28 12:51:40.994426 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:40.994392    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bc73c0_3fcf_4377_8324_d8aa53a6fd95.slice/crio-ba421447cd9d27a5fe605b63a169b9da045eb1e9ff02621294c2a11982732f8a WatchSource:0}: Error finding container ba421447cd9d27a5fe605b63a169b9da045eb1e9ff02621294c2a11982732f8a: Status 404 returned error can't find the container with id ba421447cd9d27a5fe605b63a169b9da045eb1e9ff02621294c2a11982732f8a
Jul 28 12:51:41.013719 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.013694    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-gwjgm"]
Jul 28 12:51:41.016389 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:41.016363    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4219b34_a3cc_4dd9_9a04_75bf9fa89032.slice/crio-85ca45560c50e81ef28aabf74086d1d198b7c3fc2994fb34e5ddaeb75c6a659b WatchSource:0}: Error finding container 85ca45560c50e81ef28aabf74086d1d198b7c3fc2994fb34e5ddaeb75c6a659b: Status 404 returned error can't find the container with id 85ca45560c50e81ef28aabf74086d1d198b7c3fc2994fb34e5ddaeb75c6a659b
Jul 28 12:51:41.021210 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.021189    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mgf4h"]
Jul 28 12:51:41.023399 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:41.023377    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed8a04e_5aea_410a_a3c6_083c1ebd26bb.slice/crio-45f0da4957a16d0630a9d12120f8f8e89228269d2cda78b8e3bec0f55d13317e WatchSource:0}: Error finding container 45f0da4957a16d0630a9d12120f8f8e89228269d2cda78b8e3bec0f55d13317e: Status 404 returned error can't find the container with id 45f0da4957a16d0630a9d12120f8f8e89228269d2cda78b8e3bec0f55d13317e
Jul 28 12:51:41.029376 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.029356    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-k7ghm"]
Jul 28 12:51:41.031103 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:51:41.031081    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0c90d4_38e0_4275_bc1c_98ac44f91d58.slice/crio-b2369ca18a7d236c3acee206558327e3bbf1981884a6cad490779fdd88ef98bd WatchSource:0}: Error finding container b2369ca18a7d236c3acee206558327e3bbf1981884a6cad490779fdd88ef98bd: Status 404 returned error can't find the container with id b2369ca18a7d236c3acee206558327e3bbf1981884a6cad490779fdd88ef98bd
Jul 28 12:51:41.046708 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.046689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:41.046791 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.046746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:51:41.046866 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.046850    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:51:41.046866 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.046856    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 12:51:41.046936 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.046901    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls podName:76a5484e-7de9-453a-9210-a1af20f40e46 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:42.046888769 +0000 UTC m=+37.207656685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls") pod "cluster-samples-operator-6748489656-v5dzm" (UID: "76a5484e-7de9-453a-9210-a1af20f40e46") : secret "samples-operator-tls" not found
Jul 28 12:51:41.046936 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.046913    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls podName:011fbc6a-9e73-4aaf-8c83-bd717507d2b5 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:42.046907317 +0000 UTC m=+37.207675229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls") pod "dns-default-7cf9w" (UID: "011fbc6a-9e73-4aaf-8c83-bd717507d2b5") : secret "dns-default-metrics-tls" not found
Jul 28 12:51:41.147902 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.147874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:41.148093 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.147915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:41.148093 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.147949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:41.148093 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.148027    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 12:51:41.148093 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.148043    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:41.148093 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.148077    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:42.148058504 +0000 UTC m=+37.308826433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : configmap references non-existent config key: service-ca.crt
Jul 28 12:51:41.148672 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.148103    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls podName:75391787-ee75-4954-af25-755dd1f434b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:42.148085313 +0000 UTC m=+37.308853244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4vb57" (UID: "75391787-ee75-4954-af25-755dd1f434b4") : secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:41.148672 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.148126    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:42.148113312 +0000 UTC m=+37.308881224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : secret "router-metrics-certs-default" not found
Jul 28 12:51:41.562726 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.562076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b" event={"ID":"e5687e46-d034-44c4-8bd5-57cd0dc9c05f","Type":"ContainerStarted","Data":"79ae9393ec69b4281c3f1db61a819881c50cfb268bc7ba0552d836ae5d6a343e"}
Jul 28 12:51:41.563683 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.563655    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mgf4h" event={"ID":"eed8a04e-5aea-410a-a3c6-083c1ebd26bb","Type":"ContainerStarted","Data":"45f0da4957a16d0630a9d12120f8f8e89228269d2cda78b8e3bec0f55d13317e"}
Jul 28 12:51:41.565428 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.565393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-7b8zl" event={"ID":"8e4ad1a7-d332-4a33-8256-bf5082aba4c3","Type":"ContainerStarted","Data":"4bc8909eca303a011be1530209586199f2766f6b35495fb2e7eee98c5631ca55"}
Jul 28 12:51:41.567007 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.566934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk" event={"ID":"30bc73c0-3fcf-4377-8324-d8aa53a6fd95","Type":"ContainerStarted","Data":"ba421447cd9d27a5fe605b63a169b9da045eb1e9ff02621294c2a11982732f8a"}
Jul 28 12:51:41.568715 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.568663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-msfd9" event={"ID":"6b95039e-7b8c-4847-8b03-77de7444f84e","Type":"ContainerStarted","Data":"181021712f1ef8bbddab5ffc1e803e355243f0b07d70136be1bdb153ecaf7c36"}
Jul 28 12:51:41.570089 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.570000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm" event={"ID":"db0c90d4-38e0-4275-bc1c-98ac44f91d58","Type":"ContainerStarted","Data":"b2369ca18a7d236c3acee206558327e3bbf1981884a6cad490779fdd88ef98bd"}
Jul 28 12:51:41.574704 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.573889    2578 generic.go:356] "Generic (PLEG): container finished" podID="9cfe9b83-6bdd-47f3-9d79-ebafe92262e7" containerID="c79b156784f660210753cb0805cd1da96696cad883e5615c847d38b86d04937d" exitCode=0
Jul 28 12:51:41.574704 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.573972    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8fnn" event={"ID":"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7","Type":"ContainerDied","Data":"c79b156784f660210753cb0805cd1da96696cad883e5615c847d38b86d04937d"}
Jul 28 12:51:41.576139 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.576116    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-gwjgm" event={"ID":"b4219b34-a3cc-4dd9-9a04-75bf9fa89032","Type":"ContainerStarted","Data":"85ca45560c50e81ef28aabf74086d1d198b7c3fc2994fb34e5ddaeb75c6a659b"}
Jul 28 12:51:41.962385 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.961367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:51:41.962385 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:41.961501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:41.962385 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.961748    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:51:41.962385 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.961764    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869f55c65f-zzvcr: secret "image-registry-tls" not found
Jul 28 12:51:41.962385 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.961844    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls podName:c00717df-f13d-4716-9a39-604c35b9265b nodeName:}" failed. No retries permitted until 2026-07-28 12:51:43.96182415 +0000 UTC m=+39.122592084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls") pod "image-registry-869f55c65f-zzvcr" (UID: "c00717df-f13d-4716-9a39-604c35b9265b") : secret "image-registry-tls" not found
Jul 28 12:51:41.962385 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.962270    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:51:41.962385 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:41.962327    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert podName:dd65c8d4-7057-46c9-945c-ce9db4bf0150 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:43.962311238 +0000 UTC m=+39.123079164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-c7dk6" (UID: "dd65c8d4-7057-46c9-945c-ce9db4bf0150") : secret "networking-console-plugin-cert" not found
Jul 28 12:51:42.062455 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:42.062422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:42.062625 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:42.062497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:51:42.062625 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:42.062614    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 12:51:42.062751 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:42.062663    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls podName:76a5484e-7de9-453a-9210-a1af20f40e46 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:44.06264819 +0000 UTC m=+39.223416115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls") pod "cluster-samples-operator-6748489656-v5dzm" (UID: "76a5484e-7de9-453a-9210-a1af20f40e46") : secret "samples-operator-tls" not found
Jul 28 12:51:42.063004 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:42.062916    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:51:42.063004 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:42.062971    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls podName:011fbc6a-9e73-4aaf-8c83-bd717507d2b5 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:44.062955698 +0000 UTC m=+39.223723627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls") pod "dns-default-7cf9w" (UID: "011fbc6a-9e73-4aaf-8c83-bd717507d2b5") : secret "dns-default-metrics-tls" not found
Jul 28 12:51:42.164612 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:42.163585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:42.164612 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:42.163653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:42.164612 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:42.163707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:42.164612 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:42.163975    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:44.163954678 +0000 UTC m=+39.324722595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : configmap references non-existent config key: service-ca.crt
Jul 28 12:51:42.164612 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:42.164388    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 12:51:42.164612 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:42.164438    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:44.164422129 +0000 UTC m=+39.325190045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : secret "router-metrics-certs-default" not found
Jul 28 12:51:42.164612 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:42.164496    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:42.164612 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:42.164530    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls podName:75391787-ee75-4954-af25-755dd1f434b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:44.164518724 +0000 UTC m=+39.325286638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4vb57" (UID: "75391787-ee75-4954-af25-755dd1f434b4") : secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:42.589648 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:42.588853    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8fnn" event={"ID":"9cfe9b83-6bdd-47f3-9d79-ebafe92262e7","Type":"ContainerStarted","Data":"a6ca6eb78fb41a76fa6f16cd3420f3f7426bfd54f9b9327aa7f69f708297b618"}
Jul 28 12:51:42.618344 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:42.618265    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z8fnn" podStartSLOduration=8.29986043 podStartE2EDuration="37.618243663s" totalImagesPullingTime="29.318383233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:42.61720032 +0000 UTC m=+37.777968281" watchObservedRunningTime="2026-07-28 12:51:42.618243663 +0000 UTC m=+37.779011598"
Jul 28 12:51:43.983553 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:43.983516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:43.984054 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:43.983667    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:51:43.984054 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:43.983687    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869f55c65f-zzvcr: secret "image-registry-tls" not found
Jul 28 12:51:43.984054 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:43.983747    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls podName:c00717df-f13d-4716-9a39-604c35b9265b nodeName:}" failed. No retries permitted until 2026-07-28 12:51:47.983725722 +0000 UTC m=+43.144493655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls") pod "image-registry-869f55c65f-zzvcr" (UID: "c00717df-f13d-4716-9a39-604c35b9265b") : secret "image-registry-tls" not found
Jul 28 12:51:43.984054 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:43.983758    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:51:43.984054 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:43.983670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:51:43.984054 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:43.983831    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert podName:dd65c8d4-7057-46c9-945c-ce9db4bf0150 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:47.98379536 +0000 UTC m=+43.144563271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-c7dk6" (UID: "dd65c8d4-7057-46c9-945c-ce9db4bf0150") : secret "networking-console-plugin-cert" not found
Jul 28 12:51:44.085208 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:44.085179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:44.085370 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:44.085242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:51:44.085370 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:44.085324    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 12:51:44.085370 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:44.085331    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:51:44.085504 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:44.085377    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls podName:76a5484e-7de9-453a-9210-a1af20f40e46 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:48.085358811 +0000 UTC m=+43.246126744 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls") pod "cluster-samples-operator-6748489656-v5dzm" (UID: "76a5484e-7de9-453a-9210-a1af20f40e46") : secret "samples-operator-tls" not found
Jul 28 12:51:44.085504 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:44.085393    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls podName:011fbc6a-9e73-4aaf-8c83-bd717507d2b5 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:48.085384827 +0000 UTC m=+43.246152739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls") pod "dns-default-7cf9w" (UID: "011fbc6a-9e73-4aaf-8c83-bd717507d2b5") : secret "dns-default-metrics-tls" not found
Jul 28 12:51:44.186141 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:44.186112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:44.186284 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:44.186243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:44.186338 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:44.186288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:44.186436 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:44.186414    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:44.186521 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:44.186493    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls podName:75391787-ee75-4954-af25-755dd1f434b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:48.18647442 +0000 UTC m=+43.347242355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4vb57" (UID: "75391787-ee75-4954-af25-755dd1f434b4") : secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:44.186580 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:44.186561    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:48.186549001 +0000 UTC m=+43.347316913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : configmap references non-existent config key: service-ca.crt
Jul 28 12:51:44.186580 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:44.186415    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 12:51:44.186647 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:44.186603    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:48.18659214 +0000 UTC m=+43.347360055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : secret "router-metrics-certs-default" not found
Jul 28 12:51:48.023965 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:48.023923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:48.024446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:48.024061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:51:48.024446 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.024100    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:51:48.024446 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.024126    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869f55c65f-zzvcr: secret "image-registry-tls" not found
Jul 28 12:51:48.024446 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.024188    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls podName:c00717df-f13d-4716-9a39-604c35b9265b nodeName:}" failed. No retries permitted until 2026-07-28 12:51:56.024167232 +0000 UTC m=+51.184935147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls") pod "image-registry-869f55c65f-zzvcr" (UID: "c00717df-f13d-4716-9a39-604c35b9265b") : secret "image-registry-tls" not found
Jul 28 12:51:48.024446 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.024202    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:51:48.024446 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.024254    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert podName:dd65c8d4-7057-46c9-945c-ce9db4bf0150 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:56.024237347 +0000 UTC m=+51.185005279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-c7dk6" (UID: "dd65c8d4-7057-46c9-945c-ce9db4bf0150") : secret "networking-console-plugin-cert" not found
Jul 28 12:51:48.125339 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:48.125302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:48.125485 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:48.125380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:51:48.125485 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.125452    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:51:48.125561 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.125489    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 12:51:48.125561 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.125529    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls podName:011fbc6a-9e73-4aaf-8c83-bd717507d2b5 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:56.125510034 +0000 UTC m=+51.286277949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls") pod "dns-default-7cf9w" (UID: "011fbc6a-9e73-4aaf-8c83-bd717507d2b5") : secret "dns-default-metrics-tls" not found
Jul 28 12:51:48.125561 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.125553    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls podName:76a5484e-7de9-453a-9210-a1af20f40e46 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:56.125542743 +0000 UTC m=+51.286310655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls") pod "cluster-samples-operator-6748489656-v5dzm" (UID: "76a5484e-7de9-453a-9210-a1af20f40e46") : secret "samples-operator-tls" not found
Jul 28 12:51:48.226302 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:48.226268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:48.226478 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:48.226316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:48.226478 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.226438    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:48.226478 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.226446    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 12:51:48.226640 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.226509    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls podName:75391787-ee75-4954-af25-755dd1f434b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:56.226489794 +0000 UTC m=+51.387257719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4vb57" (UID: "75391787-ee75-4954-af25-755dd1f434b4") : secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:48.226640 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.226530    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:56.226520115 +0000 UTC m=+51.387288047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : secret "router-metrics-certs-default" not found
Jul 28 12:51:48.226640 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:48.226550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:48.226764 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:48.226652    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:56.22664095 +0000 UTC m=+51.387408862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : configmap references non-existent config key: service-ca.crt
Jul 28 12:51:49.609958 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.609651    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mgf4h" event={"ID":"eed8a04e-5aea-410a-a3c6-083c1ebd26bb","Type":"ContainerStarted","Data":"399b89b14ea531706e16615aa0fa7c0993550a73d94013e032b0b07b631cc404"}
Jul 28 12:51:49.611681 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.611613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-7b8zl" event={"ID":"8e4ad1a7-d332-4a33-8256-bf5082aba4c3","Type":"ContainerStarted","Data":"c3508453a91579ebbe2f670bcad25798e02f4ba67011d7ccc82fdd2f73d65999"}
Jul 28 12:51:49.613271 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.613248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk" event={"ID":"30bc73c0-3fcf-4377-8324-d8aa53a6fd95","Type":"ContainerStarted","Data":"e8644e65b7fcc3d84df05fd40a8ab01b4e8301a7545819ba9c75cafd2eee883e"}
Jul 28 12:51:49.615037 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.615008    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-msfd9" event={"ID":"6b95039e-7b8c-4847-8b03-77de7444f84e","Type":"ContainerStarted","Data":"e52bdaf93b3ead6cc33f11b9d06a63c26c444a7bd4729ddb5fdaa9d906059bc9"}
Jul 28 12:51:49.616704 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.616686    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/0.log"
Jul 28 12:51:49.616796 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.616718    2578 generic.go:356] "Generic (PLEG): container finished" podID="db0c90d4-38e0-4275-bc1c-98ac44f91d58" containerID="f04061c751c49a1e1f41f18171ea3a787e6c46db0a47edd191376965fbd3b780" exitCode=255
Jul 28 12:51:49.616994 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.616963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm" event={"ID":"db0c90d4-38e0-4275-bc1c-98ac44f91d58","Type":"ContainerDied","Data":"f04061c751c49a1e1f41f18171ea3a787e6c46db0a47edd191376965fbd3b780"}
Jul 28 12:51:49.617104 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.617029    2578 scope.go:117] "RemoveContainer" containerID="f04061c751c49a1e1f41f18171ea3a787e6c46db0a47edd191376965fbd3b780"
Jul 28 12:51:49.619205 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.619177    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-gwjgm" event={"ID":"b4219b34-a3cc-4dd9-9a04-75bf9fa89032","Type":"ContainerStarted","Data":"f506adc1f16e5456ca154646ba8e528af6aaf4bcaaa1e38871cf6879175be410"}
Jul 28 12:51:49.621189 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.621169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b" event={"ID":"e5687e46-d034-44c4-8bd5-57cd0dc9c05f","Type":"ContainerStarted","Data":"034a0471e51d6afb0f06af956a1b71f69f999325b39583c4a964f9debd81fb64"}
Jul 28 12:51:49.632446 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.632400    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mgf4h" podStartSLOduration=1.883102235 podStartE2EDuration="9.632383625s" totalImagesPullingTime="7.74928139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:49.629996037 +0000 UTC m=+44.790763972" watchObservedRunningTime="2026-07-28 12:51:49.632383625 +0000 UTC m=+44.793151562"
Jul 28 12:51:49.653314 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.652356    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b" podStartSLOduration=3.722449809 podStartE2EDuration="11.652337212s" totalImagesPullingTime="7.929887403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:49.651254157 +0000 UTC m=+44.812022092" watchObservedRunningTime="2026-07-28 12:51:49.652337212 +0000 UTC m=+44.813105149"
Jul 28 12:51:49.679820 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.677695    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-7b8zl" podStartSLOduration=3.7476047980000002 podStartE2EDuration="11.67767788s" totalImagesPullingTime="7.930073082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:49.677018082 +0000 UTC m=+44.837786044" watchObservedRunningTime="2026-07-28 12:51:49.67767788 +0000 UTC m=+44.838445815"
Jul 28 12:51:49.695291 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.695235    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-msfd9" podStartSLOduration=3.765427352 podStartE2EDuration="11.695216817s" totalImagesPullingTime="7.929789465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:49.693680252 +0000 UTC m=+44.854448184" watchObservedRunningTime="2026-07-28 12:51:49.695216817 +0000 UTC m=+44.855984753"
Jul 28 12:51:49.714990 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.714881    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk" podStartSLOduration=3.937512189 podStartE2EDuration="11.714865213s" totalImagesPullingTime="7.777353024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:49.714513805 +0000 UTC m=+44.875281757" watchObservedRunningTime="2026-07-28 12:51:49.714865213 +0000 UTC m=+44.875633144"
Jul 28 12:51:49.765022 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:49.764925    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-gwjgm" podStartSLOduration=3.997947355 podStartE2EDuration="11.764903923s" totalImagesPullingTime="7.766956568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:49.763678793 +0000 UTC m=+44.924446728" watchObservedRunningTime="2026-07-28 12:51:49.764903923 +0000 UTC m=+44.925671857"
Jul 28 12:51:50.627268 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:50.627236    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 12:51:50.627717 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:50.627703    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/0.log"
Jul 28 12:51:50.627773 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:50.627738    2578 generic.go:356] "Generic (PLEG): container finished" podID="db0c90d4-38e0-4275-bc1c-98ac44f91d58" containerID="7bd398a21ed4df1df9636b12065bafc59b3f61d3260b33fc29c97232816bdb0f" exitCode=255
Jul 28 12:51:50.627877 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:50.627854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm" event={"ID":"db0c90d4-38e0-4275-bc1c-98ac44f91d58","Type":"ContainerDied","Data":"7bd398a21ed4df1df9636b12065bafc59b3f61d3260b33fc29c97232816bdb0f"}
Jul 28 12:51:50.627940 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:50.627916    2578 scope.go:117] "RemoveContainer" containerID="f04061c751c49a1e1f41f18171ea3a787e6c46db0a47edd191376965fbd3b780"
Jul 28 12:51:50.628166 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:50.628141    2578 scope.go:117] "RemoveContainer" containerID="7bd398a21ed4df1df9636b12065bafc59b3f61d3260b33fc29c97232816bdb0f"
Jul 28 12:51:50.628352 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:50.628325    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-k7ghm_openshift-console-operator(db0c90d4-38e0-4275-bc1c-98ac44f91d58)\"" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm" podUID="db0c90d4-38e0-4275-bc1c-98ac44f91d58"
Jul 28 12:51:50.743325 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:50.743290    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:50.743489 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:50.743338    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:51:51.113300 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.113262    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hsmkh"]
Jul 28 12:51:51.147930 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.147888    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.151782 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.151753    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 12:51:51.152169 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.152148    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wb5jb\""
Jul 28 12:51:51.152917 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.152898    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 12:51:51.158249 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.158222    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hsmkh"]
Jul 28 12:51:51.253952 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.253914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vnmv\" (UniqueName: \"kubernetes.io/projected/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-api-access-6vnmv\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.254120 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.253976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-crio-socket\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.254120 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.254008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.254120 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.254054    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.254120 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.254090    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-data-volume\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.354646 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.354621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.354860 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.354654    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-data-volume\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.354860 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:51.354765    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:51.354860 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:51.354852    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls podName:d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:51.854830358 +0000 UTC m=+47.015598273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hsmkh" (UID: "d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:51.355031 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.354914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vnmv\" (UniqueName: \"kubernetes.io/projected/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-api-access-6vnmv\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.355031 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.354957    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-data-volume\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.355031 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.354970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-crio-socket\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.355031 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.355019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.355201 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.355094    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-crio-socket\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.355201 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:51.355116    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:51:51.355201 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:51.355168    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm podName:d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:51.855152644 +0000 UTC m=+47.015920574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hsmkh" (UID: "d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36") : configmap "kube-rbac-proxy" not found
Jul 28 12:51:51.376882 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.376822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vnmv\" (UniqueName: \"kubernetes.io/projected/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-api-access-6vnmv\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.632054 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.631960    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 12:51:51.632497 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.632374    2578 scope.go:117] "RemoveContainer" containerID="7bd398a21ed4df1df9636b12065bafc59b3f61d3260b33fc29c97232816bdb0f"
Jul 28 12:51:51.632591 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:51.632568    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-k7ghm_openshift-console-operator(db0c90d4-38e0-4275-bc1c-98ac44f91d58)\"" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm" podUID="db0c90d4-38e0-4275-bc1c-98ac44f91d58"
Jul 28 12:51:51.859520 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.859484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.859710 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:51.859538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:51.859710 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:51.859614    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:51:51.859710 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:51.859672    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:51.859710 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:51.859696    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm podName:d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:52.859678622 +0000 UTC m=+48.020446540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hsmkh" (UID: "d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36") : configmap "kube-rbac-proxy" not found
Jul 28 12:51:51.860010 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:51.859738    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls podName:d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:52.859721906 +0000 UTC m=+48.020489837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hsmkh" (UID: "d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:52.635596 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:52.635557    2578 scope.go:117] "RemoveContainer" containerID="7bd398a21ed4df1df9636b12065bafc59b3f61d3260b33fc29c97232816bdb0f"
Jul 28 12:51:52.636056 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:52.635758    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-k7ghm_openshift-console-operator(db0c90d4-38e0-4275-bc1c-98ac44f91d58)\"" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm" podUID="db0c90d4-38e0-4275-bc1c-98ac44f91d58"
Jul 28 12:51:52.867407 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:52.867371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:52.867570 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:52.867503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:52.867570 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:52.867515    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:52.867654 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:52.867582    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:51:52.867654 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:52.867584    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls podName:d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:54.867569316 +0000 UTC m=+50.028337228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hsmkh" (UID: "d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:52.867654 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:52.867633    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm podName:d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:54.867622001 +0000 UTC m=+50.028389913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hsmkh" (UID: "d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36") : configmap "kube-rbac-proxy" not found
Jul 28 12:51:53.262099 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:53.262070    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jskh7_607c523b-7e24-41a6-b546-e945742f9491/dns-node-resolver/0.log"
Jul 28 12:51:54.661994 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:54.661964    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f84gz_f022c708-2f19-42f5-9bc2-c353795dda51/node-ca/0.log"
Jul 28 12:51:54.883481 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:54.883444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:54.883652 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:54.883502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:54.883652 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:54.883576    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:51:54.883652 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:54.883647    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm podName:d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:58.883631574 +0000 UTC m=+54.044399485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hsmkh" (UID: "d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36") : configmap "kube-rbac-proxy" not found
Jul 28 12:51:54.883779 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:54.883671    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:54.883779 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:54.883732    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls podName:d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:58.883718624 +0000 UTC m=+54.044486557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hsmkh" (UID: "d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:55.061101 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:55.061072    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mgf4h_eed8a04e-5aea-410a-a3c6-083c1ebd26bb/serve-healthcheck-canary/0.log"
Jul 28 12:51:55.861693 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:55.861647    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk_30bc73c0-3fcf-4377-8324-d8aa53a6fd95/kube-storage-version-migrator-operator/0.log"
Jul 28 12:51:56.094610 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:56.094566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:51:56.094833 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:56.094677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:51:56.094833 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.094724    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:51:56.094942 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.094845    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert podName:dd65c8d4-7057-46c9-945c-ce9db4bf0150 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:12.094822698 +0000 UTC m=+67.255590627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-c7dk6" (UID: "dd65c8d4-7057-46c9-945c-ce9db4bf0150") : secret "networking-console-plugin-cert" not found
Jul 28 12:51:56.094942 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.094845    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:51:56.094942 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.094866    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869f55c65f-zzvcr: secret "image-registry-tls" not found
Jul 28 12:51:56.094942 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.094918    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls podName:c00717df-f13d-4716-9a39-604c35b9265b nodeName:}" failed. No retries permitted until 2026-07-28 12:52:12.094906192 +0000 UTC m=+67.255674103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls") pod "image-registry-869f55c65f-zzvcr" (UID: "c00717df-f13d-4716-9a39-604c35b9265b") : secret "image-registry-tls" not found
Jul 28 12:51:56.195694 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:56.195597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:51:56.195902 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:56.195717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:51:56.195902 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.195765    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 12:51:56.195902 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.195824    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:51:56.195902 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.195868    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls podName:011fbc6a-9e73-4aaf-8c83-bd717507d2b5 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:12.195854403 +0000 UTC m=+67.356622315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls") pod "dns-default-7cf9w" (UID: "011fbc6a-9e73-4aaf-8c83-bd717507d2b5") : secret "dns-default-metrics-tls" not found
Jul 28 12:51:56.195902 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.195880    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls podName:76a5484e-7de9-453a-9210-a1af20f40e46 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:12.195874992 +0000 UTC m=+67.356642904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls") pod "cluster-samples-operator-6748489656-v5dzm" (UID: "76a5484e-7de9-453a-9210-a1af20f40e46") : secret "samples-operator-tls" not found
Jul 28 12:51:56.296381 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:56.296346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:56.296580 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:56.296401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:51:56.296580 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:56.296435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:51:56.296580 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.296506    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 12:51:56.296580 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.296560    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:56.296580 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.296572    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:12.296551171 +0000 UTC m=+67.457319084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : secret "router-metrics-certs-default" not found
Jul 28 12:51:56.296882 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.296592    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle podName:bf21c8e3-9a60-4dfa-a9c5-79744cecceb1 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:12.296581748 +0000 UTC m=+67.457349674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle") pod "router-default-98cffcd85-lcdgz" (UID: "bf21c8e3-9a60-4dfa-a9c5-79744cecceb1") : configmap references non-existent config key: service-ca.crt
Jul 28 12:51:56.296882 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:56.296606    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls podName:75391787-ee75-4954-af25-755dd1f434b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:12.296600331 +0000 UTC m=+67.457368242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-4vb57" (UID: "75391787-ee75-4954-af25-755dd1f434b4") : secret "cluster-monitoring-operator-tls" not found
Jul 28 12:51:58.918062 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:58.918027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:58.918487 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:58.918081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:51:58.918487 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:58.918224    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:58.918487 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:51:58.918284    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls podName:d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:06.918267701 +0000 UTC m=+62.079035617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hsmkh" (UID: "d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:58.918615 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:51:58.918521    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:52:03.269743 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:03.269713    2578 scope.go:117] "RemoveContainer" containerID="7bd398a21ed4df1df9636b12065bafc59b3f61d3260b33fc29c97232816bdb0f"
Jul 28 12:52:03.672180 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:03.672150    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 12:52:03.672347 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:03.672224    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm" event={"ID":"db0c90d4-38e0-4275-bc1c-98ac44f91d58","Type":"ContainerStarted","Data":"acf4173219a55bf3dcfbd3aaf5e2ba58454882fc271bf6d7bb90ce49e83122db"}
Jul 28 12:52:03.672539 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:03.672508    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:52:03.692681 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:03.692623    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm" podStartSLOduration=17.951071514 podStartE2EDuration="25.692604031s" totalImagesPullingTime="7.741532517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:03.692112097 +0000 UTC m=+58.852880032" watchObservedRunningTime="2026-07-28 12:52:03.692604031 +0000 UTC m=+58.853371958"
Jul 28 12:52:03.833533 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:03.833503    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-k7ghm"
Jul 28 12:52:05.554310 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:05.554284    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m2jmq"
Jul 28 12:52:06.989453 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:06.989419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:52:06.991953 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:06.991930    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsmkh\" (UID: \"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36\") " pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:52:07.065499 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:07.065468    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wb5jb\""
Jul 28 12:52:07.073898 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:07.073871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hsmkh"
Jul 28 12:52:07.214776 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:07.214751    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hsmkh"]
Jul 28 12:52:07.216617 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:52:07.216596    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77a83fd_3c1a_4cd3_ae4c_9244f14f3e36.slice/crio-f6c5e6e746e875c90e17a9d57eed375f1a8b6de6bb6eed229c91a15f89ff55bd WatchSource:0}: Error finding container f6c5e6e746e875c90e17a9d57eed375f1a8b6de6bb6eed229c91a15f89ff55bd: Status 404 returned error can't find the container with id f6c5e6e746e875c90e17a9d57eed375f1a8b6de6bb6eed229c91a15f89ff55bd
Jul 28 12:52:07.687939 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:07.687898    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hsmkh" event={"ID":"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36","Type":"ContainerStarted","Data":"f6c5e6e746e875c90e17a9d57eed375f1a8b6de6bb6eed229c91a15f89ff55bd"}
Jul 28 12:52:10.930169 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:10.930127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:52:10.933204 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:10.933180    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 12:52:10.943168 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:10.943145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b98b32fe-aa1b-4b6c-ae70-f11bfabcb136-metrics-certs\") pod \"network-metrics-daemon-b88wc\" (UID: \"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136\") " pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:52:10.961290 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:10.961267    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n8x7n\""
Jul 28 12:52:10.969079 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:10.969059    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b88wc"
Jul 28 12:52:11.031058 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:11.031016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:52:11.031255 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:11.031233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjt2\" (UniqueName: \"kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2\") pod \"network-check-target-ld799\" (UID: \"de13a42d-3275-4c9c-a734-f12b7bf144df\") " pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:52:11.034180 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:11.034156    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 12:52:11.034618 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:11.034588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czjt2\" (UniqueName: \"kubernetes.io/projected/de13a42d-3275-4c9c-a734-f12b7bf144df-kube-api-access-czjt2\") pod \"network-check-target-ld799\" (UID: \"de13a42d-3275-4c9c-a734-f12b7bf144df\") " pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:52:11.044353 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:11.044303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da3d8ccd-539e-4d22-9e58-2851a576a3cd-original-pull-secret\") pod \"global-pull-secret-syncer-qsknb\" (UID: \"da3d8ccd-539e-4d22-9e58-2851a576a3cd\") " pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:52:11.242158 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:11.242126    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsknb"
Jul 28 12:52:11.254892 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:11.254867    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lcpbt\""
Jul 28 12:52:11.263089 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:11.263069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:52:12.140065 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.140023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:52:12.140541 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.140146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:52:12.143325 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.143262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls\") pod \"image-registry-869f55c65f-zzvcr\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") " pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:52:12.143325 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.143269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dd65c8d4-7057-46c9-945c-ce9db4bf0150-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-c7dk6\" (UID: \"dd65c8d4-7057-46c9-945c-ce9db4bf0150\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:52:12.241344 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.241301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:52:12.241516 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.241427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:52:12.244416 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.244388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/76a5484e-7de9-453a-9210-a1af20f40e46-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-v5dzm\" (UID: \"76a5484e-7de9-453a-9210-a1af20f40e46\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:52:12.244561 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.244527    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/011fbc6a-9e73-4aaf-8c83-bd717507d2b5-metrics-tls\") pod \"dns-default-7cf9w\" (UID: \"011fbc6a-9e73-4aaf-8c83-bd717507d2b5\") " pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:52:12.326434 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.326406    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q9wzr\""
Jul 28 12:52:12.334159 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.333935    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:52:12.342663 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.342632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:52:12.342796 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.342672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:52:12.342796 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.342706    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:52:12.343402 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.343374    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-service-ca-bundle\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:52:12.345758 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.345732    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf21c8e3-9a60-4dfa-a9c5-79744cecceb1-metrics-certs\") pod \"router-default-98cffcd85-lcdgz\" (UID: \"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1\") " pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:52:12.345884 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.345853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75391787-ee75-4954-af25-755dd1f434b4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-4vb57\" (UID: \"75391787-ee75-4954-af25-755dd1f434b4\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:52:12.372328 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.372301    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nm6rv\""
Jul 28 12:52:12.379690 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.379670    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"
Jul 28 12:52:12.388653 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.388636    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wxrjt\""
Jul 28 12:52:12.397058 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.397011    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:52:12.468183 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.468146    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-44zj7\""
Jul 28 12:52:12.475203 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.474971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"
Jul 28 12:52:12.481285 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.480330    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h8q9d\""
Jul 28 12:52:12.487080 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.486972    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:52:12.534796 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.534213    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ct6t5\""
Jul 28 12:52:12.534796 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.534399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"
Jul 28 12:52:12.689825 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.686364    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6"]
Jul 28 12:52:12.712894 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.706179    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b88wc"]
Jul 28 12:52:12.737202 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.735623    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hsmkh" event={"ID":"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36","Type":"ContainerStarted","Data":"68968a59c68f1d95678d2f092e9b8d548b48ba9ae47b950ea4aa9d86c0267c0e"}
Jul 28 12:52:12.762987 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.760563    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7cf9w"]
Jul 28 12:52:12.770166 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.770099    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qsknb"]
Jul 28 12:52:12.772964 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:52:12.772921    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3d8ccd_539e_4d22_9e58_2851a576a3cd.slice/crio-8912d44e93461a242386faecc6d2bfd0d5488e4bd1468442e23f618c8c20c9b6 WatchSource:0}: Error finding container 8912d44e93461a242386faecc6d2bfd0d5488e4bd1468442e23f618c8c20c9b6: Status 404 returned error can't find the container with id 8912d44e93461a242386faecc6d2bfd0d5488e4bd1468442e23f618c8c20c9b6
Jul 28 12:52:12.801317 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.801287    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-869f55c65f-zzvcr"]
Jul 28 12:52:12.804412 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:52:12.804364    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00717df_f13d_4716_9a39_604c35b9265b.slice/crio-dcedb311ecea93fdfecc978e90c93c197b0142004176cc1edec68877f8330e5c WatchSource:0}: Error finding container dcedb311ecea93fdfecc978e90c93c197b0142004176cc1edec68877f8330e5c: Status 404 returned error can't find the container with id dcedb311ecea93fdfecc978e90c93c197b0142004176cc1edec68877f8330e5c
Jul 28 12:52:12.808474 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.808444    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm"]
Jul 28 12:52:12.827730 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.827704    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-98cffcd85-lcdgz"]
Jul 28 12:52:12.841892 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.841862    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57"]
Jul 28 12:52:12.843384 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:52:12.843356    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf21c8e3_9a60_4dfa_a9c5_79744cecceb1.slice/crio-c80da1678935cd5c4e25e045da94209d3302f90583ad241685b90d59ef84d056 WatchSource:0}: Error finding container c80da1678935cd5c4e25e045da94209d3302f90583ad241685b90d59ef84d056: Status 404 returned error can't find the container with id c80da1678935cd5c4e25e045da94209d3302f90583ad241685b90d59ef84d056
Jul 28 12:52:12.845502 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:52:12.845468    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75391787_ee75_4954_af25_755dd1f434b4.slice/crio-e5a2011c30008b86263b02ab439fba22622e17ae644d4c6dd1da8aefaa16c54d WatchSource:0}: Error finding container e5a2011c30008b86263b02ab439fba22622e17ae644d4c6dd1da8aefaa16c54d: Status 404 returned error can't find the container with id e5a2011c30008b86263b02ab439fba22622e17ae644d4c6dd1da8aefaa16c54d
Jul 28 12:52:12.923392 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:12.923316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ld799"]
Jul 28 12:52:12.926721 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:52:12.926690    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde13a42d_3275_4c9c_a734_f12b7bf144df.slice/crio-8c347c0439934a2db0f17bde22be224a99c411f83a76201f2880b143ccc6bf6e WatchSource:0}: Error finding container 8c347c0439934a2db0f17bde22be224a99c411f83a76201f2880b143ccc6bf6e: Status 404 returned error can't find the container with id 8c347c0439934a2db0f17bde22be224a99c411f83a76201f2880b143ccc6bf6e
Jul 28 12:52:13.748058 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.747956    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm" event={"ID":"76a5484e-7de9-453a-9210-a1af20f40e46","Type":"ContainerStarted","Data":"ee723da03e24a9a6c94d4e518a277eb2ab7438d12b6782cf1a0507ae44b8369f"}
Jul 28 12:52:13.750271 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.750194    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6" event={"ID":"dd65c8d4-7057-46c9-945c-ce9db4bf0150","Type":"ContainerStarted","Data":"ab52f5db04d663c005af4e88ca53e8497d8435e373c93870edec19cc9a22ea9b"}
Jul 28 12:52:13.758547 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.758517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-98cffcd85-lcdgz" event={"ID":"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1","Type":"ContainerStarted","Data":"d22ca419a32d3a138dafe69ea6b54dff1e93a0d17f7ae4e44e1f6868e436db11"}
Jul 28 12:52:13.758704 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.758567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-98cffcd85-lcdgz" event={"ID":"bf21c8e3-9a60-4dfa-a9c5-79744cecceb1","Type":"ContainerStarted","Data":"c80da1678935cd5c4e25e045da94209d3302f90583ad241685b90d59ef84d056"}
Jul 28 12:52:13.761994 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.761968    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b88wc" event={"ID":"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136","Type":"ContainerStarted","Data":"d43addca42f08319161effd0513fcdebeaf5646593bd01c43c8abf6359ecc640"}
Jul 28 12:52:13.765441 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.764421    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57" event={"ID":"75391787-ee75-4954-af25-755dd1f434b4","Type":"ContainerStarted","Data":"e5a2011c30008b86263b02ab439fba22622e17ae644d4c6dd1da8aefaa16c54d"}
Jul 28 12:52:13.773918 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.773520    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr" event={"ID":"c00717df-f13d-4716-9a39-604c35b9265b","Type":"ContainerStarted","Data":"0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927"}
Jul 28 12:52:13.773918 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.773560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr" event={"ID":"c00717df-f13d-4716-9a39-604c35b9265b","Type":"ContainerStarted","Data":"dcedb311ecea93fdfecc978e90c93c197b0142004176cc1edec68877f8330e5c"}
Jul 28 12:52:13.773918 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.773874    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:52:13.777587 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.777565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7cf9w" event={"ID":"011fbc6a-9e73-4aaf-8c83-bd717507d2b5","Type":"ContainerStarted","Data":"d71454d4e019d84d8d079547d89225ecb71549acd4fc478ccdc55cad299d65b6"}
Jul 28 12:52:13.790012 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.789976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ld799" event={"ID":"de13a42d-3275-4c9c-a734-f12b7bf144df","Type":"ContainerStarted","Data":"f6a64bfed34fc2777e0d5bc782311b3202752194df0fd424acc3fc69f921d31c"}
Jul 28 12:52:13.790104 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.790015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ld799" event={"ID":"de13a42d-3275-4c9c-a734-f12b7bf144df","Type":"ContainerStarted","Data":"8c347c0439934a2db0f17bde22be224a99c411f83a76201f2880b143ccc6bf6e"}
Jul 28 12:52:13.790476 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.790454    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:52:13.797548 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.797524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qsknb" event={"ID":"da3d8ccd-539e-4d22-9e58-2851a576a3cd","Type":"ContainerStarted","Data":"8912d44e93461a242386faecc6d2bfd0d5488e4bd1468442e23f618c8c20c9b6"}
Jul 28 12:52:13.812176 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.811451    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-98cffcd85-lcdgz" podStartSLOduration=35.811433168 podStartE2EDuration="35.811433168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:13.786048867 +0000 UTC m=+68.946816805" watchObservedRunningTime="2026-07-28 12:52:13.811433168 +0000 UTC m=+68.972201102"
Jul 28 12:52:13.812176 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.811783    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr" podStartSLOduration=67.811773225 podStartE2EDuration="1m7.811773225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:13.809822054 +0000 UTC m=+68.970590003" watchObservedRunningTime="2026-07-28 12:52:13.811773225 +0000 UTC m=+68.972541160"
Jul 28 12:52:13.833888 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:13.832318    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ld799" podStartSLOduration=68.83230147 podStartE2EDuration="1m8.83230147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:13.83226941 +0000 UTC m=+68.993037367" watchObservedRunningTime="2026-07-28 12:52:13.83230147 +0000 UTC m=+68.993069405"
Jul 28 12:52:14.487716 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:14.487570    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:52:14.490500 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:14.490474    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:52:14.805573 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:14.804465    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:52:14.806073 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:14.805868    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-98cffcd85-lcdgz"
Jul 28 12:52:15.118533 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.117313    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"]
Jul 28 12:52:15.120682 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.120653    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:15.128363 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.128335    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 12:52:15.128363 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.128348    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 12:52:15.130226 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.129319    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 12:52:15.130226 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.129330    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 12:52:15.141293 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.141267    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"]
Jul 28 12:52:15.195658 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.195626    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-gm2c6"]
Jul 28 12:52:15.199031 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.199005    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb477d9b6-ndwmf"]
Jul 28 12:52:15.199280 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.199137    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-gm2c6"
Jul 28 12:52:15.202496 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.202473    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.205021 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.204998    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 12:52:15.205589 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.205562    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 12:52:15.207118 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.207095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6rb6l\""
Jul 28 12:52:15.207337 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.207319    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 12:52:15.207821 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.207791    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 12:52:15.208046 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.208030    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x4m6r\""
Jul 28 12:52:15.208211 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.208194    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 12:52:15.208344 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.208328    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 12:52:15.208452 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.208426    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 12:52:15.220350 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.220273    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-gm2c6"]
Jul 28 12:52:15.244260 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.244195    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb477d9b6-ndwmf"]
Jul 28 12:52:15.269721 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.269690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc6vr\" (UniqueName: \"kubernetes.io/projected/c24ea4ed-96b4-4c63-8b65-ed0fdb3bfed8-kube-api-access-lc6vr\") pod \"downloads-7c97dc4555-gm2c6\" (UID: \"c24ea4ed-96b4-4c63-8b65-ed0fdb3bfed8\") " pod="openshift-console/downloads-7c97dc4555-gm2c6"
Jul 28 12:52:15.269941 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.269746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-oauth-serving-cert\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.269941 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.269772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7d08155b-1e4d-4185-8093-af4e064dfdf2-klusterlet-config\") pod \"klusterlet-addon-workmgr-597d866cf8-cchkr\" (UID: \"7d08155b-1e4d-4185-8093-af4e064dfdf2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:15.269941 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.269797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d08155b-1e4d-4185-8093-af4e064dfdf2-tmp\") pod \"klusterlet-addon-workmgr-597d866cf8-cchkr\" (UID: \"7d08155b-1e4d-4185-8093-af4e064dfdf2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:15.269941 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.269848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-service-ca\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.269941 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.269863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42xft\" (UniqueName: \"kubernetes.io/projected/ab85d766-0b64-488b-9d16-c625b359eff7-kube-api-access-42xft\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.269941 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.269921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-oauth-config\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.270276 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.269949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2m2t\" (UniqueName: \"kubernetes.io/projected/7d08155b-1e4d-4185-8093-af4e064dfdf2-kube-api-access-f2m2t\") pod \"klusterlet-addon-workmgr-597d866cf8-cchkr\" (UID: \"7d08155b-1e4d-4185-8093-af4e064dfdf2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:15.270276 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.269978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-serving-cert\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.270276 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.269997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-console-config\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.370429 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.370346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d08155b-1e4d-4185-8093-af4e064dfdf2-tmp\") pod \"klusterlet-addon-workmgr-597d866cf8-cchkr\" (UID: \"7d08155b-1e4d-4185-8093-af4e064dfdf2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:15.370429 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.370393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-service-ca\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.370429 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.370418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42xft\" (UniqueName: \"kubernetes.io/projected/ab85d766-0b64-488b-9d16-c625b359eff7-kube-api-access-42xft\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.370703 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.370488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-oauth-config\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.370703 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.370516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2m2t\" (UniqueName: \"kubernetes.io/projected/7d08155b-1e4d-4185-8093-af4e064dfdf2-kube-api-access-f2m2t\") pod \"klusterlet-addon-workmgr-597d866cf8-cchkr\" (UID: \"7d08155b-1e4d-4185-8093-af4e064dfdf2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:15.370703 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.370550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-serving-cert\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.370703 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.370579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-console-config\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.370703 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.370627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc6vr\" (UniqueName: \"kubernetes.io/projected/c24ea4ed-96b4-4c63-8b65-ed0fdb3bfed8-kube-api-access-lc6vr\") pod \"downloads-7c97dc4555-gm2c6\" (UID: \"c24ea4ed-96b4-4c63-8b65-ed0fdb3bfed8\") " pod="openshift-console/downloads-7c97dc4555-gm2c6"
Jul 28 12:52:15.370703 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.370657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-oauth-serving-cert\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.370703 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.370683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7d08155b-1e4d-4185-8093-af4e064dfdf2-klusterlet-config\") pod \"klusterlet-addon-workmgr-597d866cf8-cchkr\" (UID: \"7d08155b-1e4d-4185-8093-af4e064dfdf2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:15.371068 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.370835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d08155b-1e4d-4185-8093-af4e064dfdf2-tmp\") pod \"klusterlet-addon-workmgr-597d866cf8-cchkr\" (UID: \"7d08155b-1e4d-4185-8093-af4e064dfdf2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:15.372128 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.372096    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-service-ca\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.372256 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.372173    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-console-config\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.372550 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.372496    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-oauth-serving-cert\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.374430 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.374104    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7d08155b-1e4d-4185-8093-af4e064dfdf2-klusterlet-config\") pod \"klusterlet-addon-workmgr-597d866cf8-cchkr\" (UID: \"7d08155b-1e4d-4185-8093-af4e064dfdf2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:15.374430 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.374340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-oauth-config\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.375093 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.375071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-serving-cert\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.385991 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.385963    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc6vr\" (UniqueName: \"kubernetes.io/projected/c24ea4ed-96b4-4c63-8b65-ed0fdb3bfed8-kube-api-access-lc6vr\") pod \"downloads-7c97dc4555-gm2c6\" (UID: \"c24ea4ed-96b4-4c63-8b65-ed0fdb3bfed8\") " pod="openshift-console/downloads-7c97dc4555-gm2c6"
Jul 28 12:52:15.387495 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.387468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2m2t\" (UniqueName: \"kubernetes.io/projected/7d08155b-1e4d-4185-8093-af4e064dfdf2-kube-api-access-f2m2t\") pod \"klusterlet-addon-workmgr-597d866cf8-cchkr\" (UID: \"7d08155b-1e4d-4185-8093-af4e064dfdf2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:15.388984 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.388966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42xft\" (UniqueName: \"kubernetes.io/projected/ab85d766-0b64-488b-9d16-c625b359eff7-kube-api-access-42xft\") pod \"console-5cb477d9b6-ndwmf\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") " pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.433918 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.433880    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:15.515245 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.515209    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-gm2c6"
Jul 28 12:52:15.523434 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.523135    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:15.563214 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.563184    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55cbd9f9c9-n64d8"]
Jul 28 12:52:15.566410 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.566391    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.575682 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.575662    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 12:52:15.587222 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.584729    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cbd9f9c9-n64d8"]
Jul 28 12:52:15.672737 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.672655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-oauth-serving-cert\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.672737 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.672695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-trusted-ca-bundle\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.672974 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.672758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-service-ca\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.672974 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.672866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-oauth-config\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.672974 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.672902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d795k\" (UniqueName: \"kubernetes.io/projected/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-kube-api-access-d795k\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.672974 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.672931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-serving-cert\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.672974 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.672960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-config\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.774075 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.774035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-oauth-config\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.774244 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.774090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d795k\" (UniqueName: \"kubernetes.io/projected/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-kube-api-access-d795k\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.774244 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.774121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-serving-cert\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.774244 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.774149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-config\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.774244 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.774184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-oauth-serving-cert\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.774426 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.774293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-trusted-ca-bundle\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.774426 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.774376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-service-ca\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.775008 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.774979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-oauth-serving-cert\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.775132 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.775085    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-service-ca\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.775132 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.775085    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-config\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.775312 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.775293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-trusted-ca-bundle\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.777343 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.777315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-oauth-config\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.777432 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.777315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-serving-cert\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.784763 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.784741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d795k\" (UniqueName: \"kubernetes.io/projected/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-kube-api-access-d795k\") pod \"console-55cbd9f9c9-n64d8\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") " pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:15.877768 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:15.877730    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:21.107601 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.107575    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"]
Jul 28 12:52:21.170254 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:52:21.170213    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d08155b_1e4d_4185_8093_af4e064dfdf2.slice/crio-4a6cd69633d24219683ffdec89bf57c5be1f3155873d541608a2581a0e368505 WatchSource:0}: Error finding container 4a6cd69633d24219683ffdec89bf57c5be1f3155873d541608a2581a0e368505: Status 404 returned error can't find the container with id 4a6cd69633d24219683ffdec89bf57c5be1f3155873d541608a2581a0e368505
Jul 28 12:52:21.344152 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.344121    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-gm2c6"]
Jul 28 12:52:21.348122 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:52:21.348090    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24ea4ed_96b4_4c63_8b65_ed0fdb3bfed8.slice/crio-35022a87477cefef40e8ec169eee01ba8f8e7c0e04c71f860330b4ef6349e5ed WatchSource:0}: Error finding container 35022a87477cefef40e8ec169eee01ba8f8e7c0e04c71f860330b4ef6349e5ed: Status 404 returned error can't find the container with id 35022a87477cefef40e8ec169eee01ba8f8e7c0e04c71f860330b4ef6349e5ed
Jul 28 12:52:21.577876 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.577817    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cbd9f9c9-n64d8"]
Jul 28 12:52:21.584257 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.584225    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb477d9b6-ndwmf"]
Jul 28 12:52:21.604023 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:52:21.603850    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab85d766_0b64_488b_9d16_c625b359eff7.slice/crio-7f1dfd6c30998b5ef22e32ffa08ed0b1caefac14f053e726dccb928630a35a9a WatchSource:0}: Error finding container 7f1dfd6c30998b5ef22e32ffa08ed0b1caefac14f053e726dccb928630a35a9a: Status 404 returned error can't find the container with id 7f1dfd6c30998b5ef22e32ffa08ed0b1caefac14f053e726dccb928630a35a9a
Jul 28 12:52:21.834146 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.834000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b88wc" event={"ID":"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136","Type":"ContainerStarted","Data":"5f66f3665ac579c4797bb181745ca097f3442e2563e930d8378be152b60b8382"}
Jul 28 12:52:21.834146 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.834084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b88wc" event={"ID":"b98b32fe-aa1b-4b6c-ae70-f11bfabcb136","Type":"ContainerStarted","Data":"7050ac321ca39020ae6368827057c3965f0f2a4243b5c43d06b6985b20736829"}
Jul 28 12:52:21.835852 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.835826    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-gm2c6" event={"ID":"c24ea4ed-96b4-4c63-8b65-ed0fdb3bfed8","Type":"ContainerStarted","Data":"35022a87477cefef40e8ec169eee01ba8f8e7c0e04c71f860330b4ef6349e5ed"}
Jul 28 12:52:21.837312 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.837287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57" event={"ID":"75391787-ee75-4954-af25-755dd1f434b4","Type":"ContainerStarted","Data":"205e1669849f8f56b48d91b81208f08f9ad4b468c95951a175a913a6b8eb589a"}
Jul 28 12:52:21.839092 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.839068    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7cf9w" event={"ID":"011fbc6a-9e73-4aaf-8c83-bd717507d2b5","Type":"ContainerStarted","Data":"0272bd287e5716a9b86444daf52a32118eb2d1d5f5dacc6d3ddb676e5b2665d5"}
Jul 28 12:52:21.839199 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.839113    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7cf9w" event={"ID":"011fbc6a-9e73-4aaf-8c83-bd717507d2b5","Type":"ContainerStarted","Data":"71dac1d966093a6aba4bf1315950457ad882910476e7ba8e0aba445fab32b548"}
Jul 28 12:52:21.839199 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.839177    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:52:21.840229 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.840207    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb477d9b6-ndwmf" event={"ID":"ab85d766-0b64-488b-9d16-c625b359eff7","Type":"ContainerStarted","Data":"7f1dfd6c30998b5ef22e32ffa08ed0b1caefac14f053e726dccb928630a35a9a"}
Jul 28 12:52:21.841514 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.841491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6" event={"ID":"dd65c8d4-7057-46c9-945c-ce9db4bf0150","Type":"ContainerStarted","Data":"76fee317d5b7bf1a22232c1e06442768cdbc003265b4c5aa08a180861d498b89"}
Jul 28 12:52:21.842927 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.842907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cbd9f9c9-n64d8" event={"ID":"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b","Type":"ContainerStarted","Data":"3bb6d5fd269ebe746dd44cb3d78e5de9bebdc722516b56b323a4633e19acf21e"}
Jul 28 12:52:21.844120 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.844102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr" event={"ID":"7d08155b-1e4d-4185-8093-af4e064dfdf2","Type":"ContainerStarted","Data":"4a6cd69633d24219683ffdec89bf57c5be1f3155873d541608a2581a0e368505"}
Jul 28 12:52:21.845839 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.845776    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qsknb" event={"ID":"da3d8ccd-539e-4d22-9e58-2851a576a3cd","Type":"ContainerStarted","Data":"3eea9e5437d040f6b25f2c721d0870a7d4cbaa43a2508a9228102009ca943c56"}
Jul 28 12:52:21.847870 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.847790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hsmkh" event={"ID":"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36","Type":"ContainerStarted","Data":"3dcc1077b693d20c6a67bed45d96bb4fc56c41657341753aa2e01b51ce34b5ab"}
Jul 28 12:52:21.850836 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.850738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm" event={"ID":"76a5484e-7de9-453a-9210-a1af20f40e46","Type":"ContainerStarted","Data":"0afeb1dd47cee0ee276876d450967099c9a3a779e2b33565fef8f0b50b1d2949"}
Jul 28 12:52:21.850836 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.850779    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm" event={"ID":"76a5484e-7de9-453a-9210-a1af20f40e46","Type":"ContainerStarted","Data":"ecf44a701c414d932af02e4d85407bdcd48fbddb23eca714088d9be46767e1f8"}
Jul 28 12:52:21.856463 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.855838    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b88wc" podStartSLOduration=69.512808519 podStartE2EDuration="1m16.855797054s" totalImagesPullingTime="7.342988535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:21.855703665 +0000 UTC m=+77.016471599" watchObservedRunningTime="2026-07-28 12:52:21.855797054 +0000 UTC m=+77.016564989"
Jul 28 12:52:21.903382 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.903327    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-4vb57" podStartSLOduration=35.584385814 podStartE2EDuration="43.903305709s" totalImagesPullingTime="8.318919895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:21.901007038 +0000 UTC m=+77.061774972" watchObservedRunningTime="2026-07-28 12:52:21.903305709 +0000 UTC m=+77.064073644"
Jul 28 12:52:21.903964 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.903925    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qsknb" podStartSLOduration=68.507673518 podStartE2EDuration="1m16.903913522s" totalImagesPullingTime="8.396240004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:21.880605624 +0000 UTC m=+77.041373582" watchObservedRunningTime="2026-07-28 12:52:21.903913522 +0000 UTC m=+77.064681457"
Jul 28 12:52:21.928411 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.927627    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7cf9w" podStartSLOduration=34.615476966 podStartE2EDuration="41.927605483s" totalImagesPullingTime="7.312128517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:21.926944828 +0000 UTC m=+77.087712764" watchObservedRunningTime="2026-07-28 12:52:21.927605483 +0000 UTC m=+77.088373421"
Jul 28 12:52:21.959391 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:21.959297    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-c7dk6" podStartSLOduration=36.603169115 podStartE2EDuration="43.959274393s" totalImagesPullingTime="7.356105278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:21.958410701 +0000 UTC m=+77.119178636" watchObservedRunningTime="2026-07-28 12:52:21.959274393 +0000 UTC m=+77.120042328"
Jul 28 12:52:22.004426 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:22.004369    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-v5dzm" podStartSLOduration=36.782598732 podStartE2EDuration="44.004350855s" totalImagesPullingTime="7.221752123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:22.003957764 +0000 UTC m=+77.164725730" watchObservedRunningTime="2026-07-28 12:52:22.004350855 +0000 UTC m=+77.165118789"
Jul 28 12:52:30.915857 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:30.915742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hsmkh" event={"ID":"d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36","Type":"ContainerStarted","Data":"d4e7200bbc2667e74de1d5a1f182ab2c8ec669a82b6fe9d5f7d89ae2d0b2690e"}
Jul 28 12:52:30.917977 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:30.917943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb477d9b6-ndwmf" event={"ID":"ab85d766-0b64-488b-9d16-c625b359eff7","Type":"ContainerStarted","Data":"7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556"}
Jul 28 12:52:30.920224 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:30.920191    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cbd9f9c9-n64d8" event={"ID":"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b","Type":"ContainerStarted","Data":"0bf388578cbfc406f469411921aae16fc872daa0d0e308e82374b4872304d63e"}
Jul 28 12:52:30.922047 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:30.922019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr" event={"ID":"7d08155b-1e4d-4185-8093-af4e064dfdf2","Type":"ContainerStarted","Data":"6250ef193630d3bf3d69904c060c533e4e11aec6d2e35fdc8a35b44b2e674dd8"}
Jul 28 12:52:30.922231 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:30.922215    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:30.924351 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:30.924331    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr"
Jul 28 12:52:30.966035 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:30.965981    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hsmkh" podStartSLOduration=16.921158703 podStartE2EDuration="39.96596187s" totalImagesPullingTime="23.044803167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:30.946597275 +0000 UTC m=+86.107365210" watchObservedRunningTime="2026-07-28 12:52:30.96596187 +0000 UTC m=+86.126729806"
Jul 28 12:52:30.967010 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:30.966966    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-597d866cf8-cchkr" podStartSLOduration=6.520236835 podStartE2EDuration="15.966955232s" totalImagesPullingTime="9.446718397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:30.964890572 +0000 UTC m=+86.125658540" watchObservedRunningTime="2026-07-28 12:52:30.966955232 +0000 UTC m=+86.127723167"
Jul 28 12:52:31.013995 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:31.013943    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55cbd9f9c9-n64d8" podStartSLOduration=7.031282708 podStartE2EDuration="16.013928872s" totalImagesPullingTime="8.982646164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:30.990773241 +0000 UTC m=+86.151541175" watchObservedRunningTime="2026-07-28 12:52:31.013928872 +0000 UTC m=+86.174696806"
Jul 28 12:52:31.014602 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:31.014565    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb477d9b6-ndwmf" podStartSLOduration=7.01233271 podStartE2EDuration="16.01455233s" totalImagesPullingTime="9.00221962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:31.01284908 +0000 UTC m=+86.173617040" watchObservedRunningTime="2026-07-28 12:52:31.01455233 +0000 UTC m=+86.175320306"
Jul 28 12:52:31.863757 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:31.863724    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7cf9w"
Jul 28 12:52:34.639658 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.639617    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4bj5p"]
Jul 28 12:52:34.644437 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.644411    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.647877 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.647847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 12:52:34.650053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.649183    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 12:52:34.650053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.649461    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 12:52:34.650053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.649658    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nlpmr\""
Jul 28 12:52:34.650053 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.649866    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 12:52:34.660721 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.660683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-tls\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.660839 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.660771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-accelerators-collector-config\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.660901 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.660855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-wtmp\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.660955 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.660929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp9fx\" (UniqueName: \"kubernetes.io/projected/54e95159-3335-4796-9e96-30ec5873dd31-kube-api-access-jp9fx\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.661050 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.660967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54e95159-3335-4796-9e96-30ec5873dd31-sys\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.661050 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.660983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-textfile\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.661050 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.660998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.661050 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.661030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e95159-3335-4796-9e96-30ec5873dd31-metrics-client-ca\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.661240 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.661086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54e95159-3335-4796-9e96-30ec5873dd31-root\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.762031 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.761982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54e95159-3335-4796-9e96-30ec5873dd31-root\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.762210 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-tls\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.762210 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762106    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54e95159-3335-4796-9e96-30ec5873dd31-root\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.762210 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-accelerators-collector-config\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.762360 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-wtmp\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.762360 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9fx\" (UniqueName: \"kubernetes.io/projected/54e95159-3335-4796-9e96-30ec5873dd31-kube-api-access-jp9fx\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.762360 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54e95159-3335-4796-9e96-30ec5873dd31-sys\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.762360 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-textfile\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.762517 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.762517 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e95159-3335-4796-9e96-30ec5873dd31-metrics-client-ca\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.763127 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762627    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54e95159-3335-4796-9e96-30ec5873dd31-sys\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.763127 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762770    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-wtmp\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.763127 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762770    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-accelerators-collector-config\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.763127 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762893    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-textfile\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.763127 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.762983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e95159-3335-4796-9e96-30ec5873dd31-metrics-client-ca\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.765287 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.765261    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-tls\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.765492 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.765470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e95159-3335-4796-9e96-30ec5873dd31-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.772463 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.772440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp9fx\" (UniqueName: \"kubernetes.io/projected/54e95159-3335-4796-9e96-30ec5873dd31-kube-api-access-jp9fx\") pod \"node-exporter-4bj5p\" (UID: \"54e95159-3335-4796-9e96-30ec5873dd31\") " pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:34.809308 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.809278    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:52:34.960371 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:34.958406    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4bj5p"
Jul 28 12:52:35.523522 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:35.523469    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:35.523722 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:35.523542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:35.532902 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:35.532874    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:35.878962 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:35.878865    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:35.878962 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:35.878930    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:35.884524 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:35.884500    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:35.950692 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:35.950660    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:52:35.951161 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:35.951140    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:52:36.045297 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:36.045204    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb477d9b6-ndwmf"]
Jul 28 12:52:37.970187 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:37.970158    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-869f55c65f-zzvcr"]
Jul 28 12:52:40.971008 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:52:40.970980    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e95159_3335_4796_9e96_30ec5873dd31.slice/crio-4debef5d34e40622ebe054d51f084ccc13fb4735d6b06d9db3829e6a70201aaf WatchSource:0}: Error finding container 4debef5d34e40622ebe054d51f084ccc13fb4735d6b06d9db3829e6a70201aaf: Status 404 returned error can't find the container with id 4debef5d34e40622ebe054d51f084ccc13fb4735d6b06d9db3829e6a70201aaf
Jul 28 12:52:41.983756 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:41.983714    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-gm2c6" event={"ID":"c24ea4ed-96b4-4c63-8b65-ed0fdb3bfed8","Type":"ContainerStarted","Data":"3e26a3b04ab372473e0f3833efaee15240435ac38b41fa89a44790b914d0a113"}
Jul 28 12:52:41.984440 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:41.984419    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-gm2c6"
Jul 28 12:52:41.986373 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:41.986342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4bj5p" event={"ID":"54e95159-3335-4796-9e96-30ec5873dd31","Type":"ContainerStarted","Data":"4debef5d34e40622ebe054d51f084ccc13fb4735d6b06d9db3829e6a70201aaf"}
Jul 28 12:52:42.004761 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:42.004685    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-gm2c6"
Jul 28 12:52:42.006768 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:42.006718    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-gm2c6" podStartSLOduration=7.105476343 podStartE2EDuration="27.006697715s" totalImagesPullingTime="19.901221372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:42.005167 +0000 UTC m=+97.165934959" watchObservedRunningTime="2026-07-28 12:52:42.006697715 +0000 UTC m=+97.167465662"
Jul 28 12:52:42.993416 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:42.993375    2578 generic.go:356] "Generic (PLEG): container finished" podID="54e95159-3335-4796-9e96-30ec5873dd31" containerID="f86f10015893fb0d626a5ffe4f694ae7a1ef4d3ad60c53a0dfeb7fa04505b9be" exitCode=0
Jul 28 12:52:42.993920 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:42.993468    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4bj5p" event={"ID":"54e95159-3335-4796-9e96-30ec5873dd31","Type":"ContainerDied","Data":"f86f10015893fb0d626a5ffe4f694ae7a1ef4d3ad60c53a0dfeb7fa04505b9be"}
Jul 28 12:52:44.000967 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:44.000923    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4bj5p" event={"ID":"54e95159-3335-4796-9e96-30ec5873dd31","Type":"ContainerStarted","Data":"96cae1c1f7ceee3553fe219294116dd1155bb98d309d25552c682f2c3a17f0ff"}
Jul 28 12:52:44.001412 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:44.000992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4bj5p" event={"ID":"54e95159-3335-4796-9e96-30ec5873dd31","Type":"ContainerStarted","Data":"31082c8740bda8cf3876c59dba009100dac1cb62cdc3f9ce6ad4ba7099763d58"}
Jul 28 12:52:44.024482 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:44.024424    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4bj5p" podStartSLOduration=8.380926614 podStartE2EDuration="10.024407397s" totalImagesPullingTime="1.534408023s" totalInitContainerRuntime="109.07276ms" isStatefulPod=true podCreationTimestamp="2026-07-28 12:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:44.022986418 +0000 UTC m=+99.183754469" watchObservedRunningTime="2026-07-28 12:52:44.024407397 +0000 UTC m=+99.185175332"
Jul 28 12:52:45.810943 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:45.810911    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ld799"
Jul 28 12:52:49.918325 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:52:49.918284    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55cbd9f9c9-n64d8"]
Jul 28 12:53:01.068627 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:01.068592    2578 generic.go:356] "Generic (PLEG): container finished" podID="8e4ad1a7-d332-4a33-8256-bf5082aba4c3" containerID="c3508453a91579ebbe2f670bcad25798e02f4ba67011d7ccc82fdd2f73d65999" exitCode=0
Jul 28 12:53:01.069095 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:01.068672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-7b8zl" event={"ID":"8e4ad1a7-d332-4a33-8256-bf5082aba4c3","Type":"ContainerDied","Data":"c3508453a91579ebbe2f670bcad25798e02f4ba67011d7ccc82fdd2f73d65999"}
Jul 28 12:53:01.069095 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:01.069009    2578 scope.go:117] "RemoveContainer" containerID="c3508453a91579ebbe2f670bcad25798e02f4ba67011d7ccc82fdd2f73d65999"
Jul 28 12:53:02.074557 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:02.074520    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-7b8zl" event={"ID":"8e4ad1a7-d332-4a33-8256-bf5082aba4c3","Type":"ContainerStarted","Data":"ed3cc9f1ca2b3da715727465655a1b6cf9318eac1a3cb896ef85b2eaacc60467"}
Jul 28 12:53:02.976374 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:02.976325    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cb477d9b6-ndwmf" podUID="ab85d766-0b64-488b-9d16-c625b359eff7" containerName="console" containerID="cri-o://7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556" gracePeriod=15
Jul 28 12:53:02.991262 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:02.991231    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr" podUID="c00717df-f13d-4716-9a39-604c35b9265b" containerName="registry" containerID="cri-o://0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927" gracePeriod=30
Jul 28 12:53:03.268304 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.268276    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:53:03.295792 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.295767    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:53:03.423048 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423018    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls\") pod \"c00717df-f13d-4716-9a39-604c35b9265b\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") "
Jul 28 12:53:03.423202 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423056    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbndn\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-kube-api-access-dbndn\") pod \"c00717df-f13d-4716-9a39-604c35b9265b\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") "
Jul 28 12:53:03.423202 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423078    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-serving-cert\") pod \"ab85d766-0b64-488b-9d16-c625b359eff7\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") "
Jul 28 12:53:03.423202 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423104    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-service-ca\") pod \"ab85d766-0b64-488b-9d16-c625b359eff7\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") "
Jul 28 12:53:03.423202 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423163    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-bound-sa-token\") pod \"c00717df-f13d-4716-9a39-604c35b9265b\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") "
Jul 28 12:53:03.423202 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423190    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-oauth-config\") pod \"ab85d766-0b64-488b-9d16-c625b359eff7\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") "
Jul 28 12:53:03.423454 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423233    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42xft\" (UniqueName: \"kubernetes.io/projected/ab85d766-0b64-488b-9d16-c625b359eff7-kube-api-access-42xft\") pod \"ab85d766-0b64-488b-9d16-c625b359eff7\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") "
Jul 28 12:53:03.423454 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423263    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-installation-pull-secrets\") pod \"c00717df-f13d-4716-9a39-604c35b9265b\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") "
Jul 28 12:53:03.423454 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423287    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-oauth-serving-cert\") pod \"ab85d766-0b64-488b-9d16-c625b359eff7\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") "
Jul 28 12:53:03.423454 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423321    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-trusted-ca\") pod \"c00717df-f13d-4716-9a39-604c35b9265b\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") "
Jul 28 12:53:03.423454 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423353    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-console-config\") pod \"ab85d766-0b64-488b-9d16-c625b359eff7\" (UID: \"ab85d766-0b64-488b-9d16-c625b359eff7\") "
Jul 28 12:53:03.423454 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423384    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-image-registry-private-configuration\") pod \"c00717df-f13d-4716-9a39-604c35b9265b\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") "
Jul 28 12:53:03.423454 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423415    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c00717df-f13d-4716-9a39-604c35b9265b-ca-trust-extracted\") pod \"c00717df-f13d-4716-9a39-604c35b9265b\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") "
Jul 28 12:53:03.423791 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423462    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-registry-certificates\") pod \"c00717df-f13d-4716-9a39-604c35b9265b\" (UID: \"c00717df-f13d-4716-9a39-604c35b9265b\") "
Jul 28 12:53:03.423791 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.423664    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-service-ca" (OuterVolumeSpecName: "service-ca") pod "ab85d766-0b64-488b-9d16-c625b359eff7" (UID: "ab85d766-0b64-488b-9d16-c625b359eff7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:53:03.424507 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.424070    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ab85d766-0b64-488b-9d16-c625b359eff7" (UID: "ab85d766-0b64-488b-9d16-c625b359eff7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:53:03.424507 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.424176    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-console-config" (OuterVolumeSpecName: "console-config") pod "ab85d766-0b64-488b-9d16-c625b359eff7" (UID: "ab85d766-0b64-488b-9d16-c625b359eff7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:53:03.424687 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.424603    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c00717df-f13d-4716-9a39-604c35b9265b" (UID: "c00717df-f13d-4716-9a39-604c35b9265b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:53:03.426422 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.426381    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c00717df-f13d-4716-9a39-604c35b9265b" (UID: "c00717df-f13d-4716-9a39-604c35b9265b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:53:03.426422 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.426391    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ab85d766-0b64-488b-9d16-c625b359eff7" (UID: "ab85d766-0b64-488b-9d16-c625b359eff7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:53:03.426641 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.426453    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c00717df-f13d-4716-9a39-604c35b9265b" (UID: "c00717df-f13d-4716-9a39-604c35b9265b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:53:03.426641 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.426479    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c00717df-f13d-4716-9a39-604c35b9265b" (UID: "c00717df-f13d-4716-9a39-604c35b9265b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:53:03.426641 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.426497    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ab85d766-0b64-488b-9d16-c625b359eff7" (UID: "ab85d766-0b64-488b-9d16-c625b359eff7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:53:03.426788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.426712    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-kube-api-access-dbndn" (OuterVolumeSpecName: "kube-api-access-dbndn") pod "c00717df-f13d-4716-9a39-604c35b9265b" (UID: "c00717df-f13d-4716-9a39-604c35b9265b"). InnerVolumeSpecName "kube-api-access-dbndn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:53:03.426788 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.426756    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c00717df-f13d-4716-9a39-604c35b9265b" (UID: "c00717df-f13d-4716-9a39-604c35b9265b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:53:03.426993 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.426973    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab85d766-0b64-488b-9d16-c625b359eff7-kube-api-access-42xft" (OuterVolumeSpecName: "kube-api-access-42xft") pod "ab85d766-0b64-488b-9d16-c625b359eff7" (UID: "ab85d766-0b64-488b-9d16-c625b359eff7"). InnerVolumeSpecName "kube-api-access-42xft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:53:03.427029 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.426999    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c00717df-f13d-4716-9a39-604c35b9265b" (UID: "c00717df-f13d-4716-9a39-604c35b9265b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:53:03.433692 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.433671    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00717df-f13d-4716-9a39-604c35b9265b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c00717df-f13d-4716-9a39-604c35b9265b" (UID: "c00717df-f13d-4716-9a39-604c35b9265b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:53:03.524869 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524845    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-installation-pull-secrets\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524872    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-oauth-serving-cert\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524881    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-trusted-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524890    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-console-config\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524899    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c00717df-f13d-4716-9a39-604c35b9265b-image-registry-private-configuration\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524908    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c00717df-f13d-4716-9a39-604c35b9265b-ca-trust-extracted\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524917    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c00717df-f13d-4716-9a39-604c35b9265b-registry-certificates\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524925    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-registry-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524933    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbndn\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-kube-api-access-dbndn\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524941    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-serving-cert\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524950    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab85d766-0b64-488b-9d16-c625b359eff7-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524958    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c00717df-f13d-4716-9a39-604c35b9265b-bound-sa-token\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524966    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab85d766-0b64-488b-9d16-c625b359eff7-console-oauth-config\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:03.525004 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:03.524974    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42xft\" (UniqueName: \"kubernetes.io/projected/ab85d766-0b64-488b-9d16-c625b359eff7-kube-api-access-42xft\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:04.084027 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.083992    2578 generic.go:356] "Generic (PLEG): container finished" podID="c00717df-f13d-4716-9a39-604c35b9265b" containerID="0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927" exitCode=0
Jul 28 12:53:04.084211 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.084036    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr"
Jul 28 12:53:04.084211 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.084091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr" event={"ID":"c00717df-f13d-4716-9a39-604c35b9265b","Type":"ContainerDied","Data":"0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927"}
Jul 28 12:53:04.084211 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.084141    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869f55c65f-zzvcr" event={"ID":"c00717df-f13d-4716-9a39-604c35b9265b","Type":"ContainerDied","Data":"dcedb311ecea93fdfecc978e90c93c197b0142004176cc1edec68877f8330e5c"}
Jul 28 12:53:04.084211 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.084164    2578 scope.go:117] "RemoveContainer" containerID="0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927"
Jul 28 12:53:04.085666 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.085643    2578 generic.go:356] "Generic (PLEG): container finished" podID="ab85d766-0b64-488b-9d16-c625b359eff7" containerID="7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556" exitCode=0
Jul 28 12:53:04.085771 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.085698    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb477d9b6-ndwmf"
Jul 28 12:53:04.085771 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.085711    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb477d9b6-ndwmf" event={"ID":"ab85d766-0b64-488b-9d16-c625b359eff7","Type":"ContainerDied","Data":"7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556"}
Jul 28 12:53:04.085771 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.085748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb477d9b6-ndwmf" event={"ID":"ab85d766-0b64-488b-9d16-c625b359eff7","Type":"ContainerDied","Data":"7f1dfd6c30998b5ef22e32ffa08ed0b1caefac14f053e726dccb928630a35a9a"}
Jul 28 12:53:04.092275 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.092257    2578 scope.go:117] "RemoveContainer" containerID="0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927"
Jul 28 12:53:04.092572 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:53:04.092542    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927\": container with ID starting with 0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927 not found: ID does not exist" containerID="0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927"
Jul 28 12:53:04.092659 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.092579    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927"} err="failed to get container status \"0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927\": rpc error: code = NotFound desc = could not find container \"0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927\": container with ID starting with 0c83a6534d4675cae822d0b6ea04c7880ca5de6b9f1547a7d9ccabf80e700927 not found: ID does not exist"
Jul 28 12:53:04.092659 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.092610    2578 scope.go:117] "RemoveContainer" containerID="7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556"
Jul 28 12:53:04.100941 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.100917    2578 scope.go:117] "RemoveContainer" containerID="7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556"
Jul 28 12:53:04.101201 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:53:04.101183    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556\": container with ID starting with 7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556 not found: ID does not exist" containerID="7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556"
Jul 28 12:53:04.101266 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.101215    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556"} err="failed to get container status \"7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556\": rpc error: code = NotFound desc = could not find container \"7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556\": container with ID starting with 7b0f4f0299bbcf9d8222e2a9eb977f617cc0ca049176953a57081c45d632a556 not found: ID does not exist"
Jul 28 12:53:04.114480 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.114459    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-869f55c65f-zzvcr"]
Jul 28 12:53:04.120308 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.120290    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-869f55c65f-zzvcr"]
Jul 28 12:53:04.133417 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.133389    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb477d9b6-ndwmf"]
Jul 28 12:53:04.139666 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:04.139648    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb477d9b6-ndwmf"]
Jul 28 12:53:05.274998 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:05.274962    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab85d766-0b64-488b-9d16-c625b359eff7" path="/var/lib/kubelet/pods/ab85d766-0b64-488b-9d16-c625b359eff7/volumes"
Jul 28 12:53:05.275401 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:05.275389    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00717df-f13d-4716-9a39-604c35b9265b" path="/var/lib/kubelet/pods/c00717df-f13d-4716-9a39-604c35b9265b/volumes"
Jul 28 12:53:14.942277 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:14.942227    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55cbd9f9c9-n64d8" podUID="a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" containerName="console" containerID="cri-o://0bf388578cbfc406f469411921aae16fc872daa0d0e308e82374b4872304d63e" gracePeriod=15
Jul 28 12:53:15.130075 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.130040    2578 generic.go:356] "Generic (PLEG): container finished" podID="a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" containerID="0bf388578cbfc406f469411921aae16fc872daa0d0e308e82374b4872304d63e" exitCode=0
Jul 28 12:53:15.130275 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.130088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cbd9f9c9-n64d8" event={"ID":"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b","Type":"ContainerDied","Data":"0bf388578cbfc406f469411921aae16fc872daa0d0e308e82374b4872304d63e"}
Jul 28 12:53:15.276386 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.276358    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:53:15.426440 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.426402    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-oauth-serving-cert\") pod \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") "
Jul 28 12:53:15.426440 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.426448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-serving-cert\") pod \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") "
Jul 28 12:53:15.426689 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.426479    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d795k\" (UniqueName: \"kubernetes.io/projected/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-kube-api-access-d795k\") pod \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") "
Jul 28 12:53:15.426689 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.426512    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-oauth-config\") pod \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") "
Jul 28 12:53:15.426689 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.426563    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-service-ca\") pod \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") "
Jul 28 12:53:15.426689 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.426615    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-trusted-ca-bundle\") pod \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") "
Jul 28 12:53:15.426689 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.426640    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-config\") pod \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\" (UID: \"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b\") "
Jul 28 12:53:15.427041 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.427005    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" (UID: "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:53:15.427100 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.427066    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-config" (OuterVolumeSpecName: "console-config") pod "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" (UID: "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:53:15.427100 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.427078    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-service-ca" (OuterVolumeSpecName: "service-ca") pod "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" (UID: "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:53:15.427194 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.427102    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" (UID: "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:53:15.428995 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.428970    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" (UID: "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:53:15.429152 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.429106    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-kube-api-access-d795k" (OuterVolumeSpecName: "kube-api-access-d795k") pod "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" (UID: "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b"). InnerVolumeSpecName "kube-api-access-d795k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:53:15.429358 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.429338    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" (UID: "a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:53:15.528035 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.528004    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-oauth-serving-cert\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:15.528035 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.528031    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-serving-cert\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:15.528239 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.528045    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d795k\" (UniqueName: \"kubernetes.io/projected/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-kube-api-access-d795k\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:15.528239 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.528059    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-oauth-config\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:15.528239 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.528073    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:15.528239 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.528084    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-trusted-ca-bundle\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:15.528239 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:15.528094    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b-console-config\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:53:16.135262 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:16.135228    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cbd9f9c9-n64d8" event={"ID":"a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b","Type":"ContainerDied","Data":"3bb6d5fd269ebe746dd44cb3d78e5de9bebdc722516b56b323a4633e19acf21e"}
Jul 28 12:53:16.135664 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:16.135282    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cbd9f9c9-n64d8"
Jul 28 12:53:16.135664 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:16.135309    2578 scope.go:117] "RemoveContainer" containerID="0bf388578cbfc406f469411921aae16fc872daa0d0e308e82374b4872304d63e"
Jul 28 12:53:16.157867 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:16.157842    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55cbd9f9c9-n64d8"]
Jul 28 12:53:16.164034 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:16.164011    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55cbd9f9c9-n64d8"]
Jul 28 12:53:17.270947 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:17.270912    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" path="/var/lib/kubelet/pods/a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b/volumes"
Jul 28 12:53:20.151067 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:20.151035    2578 generic.go:356] "Generic (PLEG): container finished" podID="e5687e46-d034-44c4-8bd5-57cd0dc9c05f" containerID="034a0471e51d6afb0f06af956a1b71f69f999325b39583c4a964f9debd81fb64" exitCode=0
Jul 28 12:53:20.151476 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:20.151076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b" event={"ID":"e5687e46-d034-44c4-8bd5-57cd0dc9c05f","Type":"ContainerDied","Data":"034a0471e51d6afb0f06af956a1b71f69f999325b39583c4a964f9debd81fb64"}
Jul 28 12:53:20.151476 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:20.151419    2578 scope.go:117] "RemoveContainer" containerID="034a0471e51d6afb0f06af956a1b71f69f999325b39583c4a964f9debd81fb64"
Jul 28 12:53:20.152692 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:20.152671    2578 generic.go:356] "Generic (PLEG): container finished" podID="30bc73c0-3fcf-4377-8324-d8aa53a6fd95" containerID="e8644e65b7fcc3d84df05fd40a8ab01b4e8301a7545819ba9c75cafd2eee883e" exitCode=0
Jul 28 12:53:20.152766 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:20.152739    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk" event={"ID":"30bc73c0-3fcf-4377-8324-d8aa53a6fd95","Type":"ContainerDied","Data":"e8644e65b7fcc3d84df05fd40a8ab01b4e8301a7545819ba9c75cafd2eee883e"}
Jul 28 12:53:20.153030 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:20.153017    2578 scope.go:117] "RemoveContainer" containerID="e8644e65b7fcc3d84df05fd40a8ab01b4e8301a7545819ba9c75cafd2eee883e"
Jul 28 12:53:21.162612 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:21.162579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7rh5b" event={"ID":"e5687e46-d034-44c4-8bd5-57cd0dc9c05f","Type":"ContainerStarted","Data":"bd45ab153debf072d765d2685035204524e5caef44f0effaeedf60b953ccda7d"}
Jul 28 12:53:21.164575 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:21.164552    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk" event={"ID":"30bc73c0-3fcf-4377-8324-d8aa53a6fd95","Type":"ContainerStarted","Data":"2bda61a5b5cf61afe98b90581be53c492d79bf6a89d7dc177d218ef807e1afdb"}
Jul 28 12:53:59.041343 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.041256    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85b7d87986-sqkfm"]
Jul 28 12:53:59.041929 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.041528    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" containerName="console"
Jul 28 12:53:59.041929 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.041550    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" containerName="console"
Jul 28 12:53:59.041929 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.041560    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab85d766-0b64-488b-9d16-c625b359eff7" containerName="console"
Jul 28 12:53:59.041929 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.041565    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab85d766-0b64-488b-9d16-c625b359eff7" containerName="console"
Jul 28 12:53:59.041929 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.041584    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00717df-f13d-4716-9a39-604c35b9265b" containerName="registry"
Jul 28 12:53:59.041929 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.041590    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00717df-f13d-4716-9a39-604c35b9265b" containerName="registry"
Jul 28 12:53:59.041929 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.041643    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8274d1c-bb3f-44c8-a8ce-2f79ec8bef0b" containerName="console"
Jul 28 12:53:59.041929 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.041655    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00717df-f13d-4716-9a39-604c35b9265b" containerName="registry"
Jul 28 12:53:59.041929 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.041664    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab85d766-0b64-488b-9d16-c625b359eff7" containerName="console"
Jul 28 12:53:59.044777 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.044758    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.047566 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.047542    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 28 12:53:59.047683 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.047542    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 28 12:53:59.047683 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.047614    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dm46v\""
Jul 28 12:53:59.047824 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.047680    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 28 12:53:59.047883 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.047861    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 28 12:53:59.048012 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.047994    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 28 12:53:59.053421 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.053399    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 28 12:53:59.061457 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.061432    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85b7d87986-sqkfm"]
Jul 28 12:53:59.150250 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.150212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01fcd59c-1576-4a5d-8925-c209270bcae3-metrics-client-ca\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.150250 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.150252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-secret-telemeter-client\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.150466 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.150281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01fcd59c-1576-4a5d-8925-c209270bcae3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.150466 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.150330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk54k\" (UniqueName: \"kubernetes.io/projected/01fcd59c-1576-4a5d-8925-c209270bcae3-kube-api-access-gk54k\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.150466 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.150355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01fcd59c-1576-4a5d-8925-c209270bcae3-serving-certs-ca-bundle\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.150466 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.150379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-federate-client-tls\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.150466 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.150442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-telemeter-client-tls\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.150620 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.150476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.251547 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.251496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01fcd59c-1576-4a5d-8925-c209270bcae3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.251701 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.251559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk54k\" (UniqueName: \"kubernetes.io/projected/01fcd59c-1576-4a5d-8925-c209270bcae3-kube-api-access-gk54k\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.251701 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.251598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01fcd59c-1576-4a5d-8925-c209270bcae3-serving-certs-ca-bundle\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.251701 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.251624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-federate-client-tls\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.251701 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.251677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-telemeter-client-tls\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.251926 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.251702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.251926 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.251876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01fcd59c-1576-4a5d-8925-c209270bcae3-metrics-client-ca\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.252012 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.251932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-secret-telemeter-client\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.252706 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.252543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01fcd59c-1576-4a5d-8925-c209270bcae3-serving-certs-ca-bundle\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.252859 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.252724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01fcd59c-1576-4a5d-8925-c209270bcae3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.252859 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.252830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01fcd59c-1576-4a5d-8925-c209270bcae3-metrics-client-ca\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.254424 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.254390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.254549 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.254449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-secret-telemeter-client\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.254549 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.254493    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-telemeter-client-tls\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.254668 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.254559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/01fcd59c-1576-4a5d-8925-c209270bcae3-federate-client-tls\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.260560 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.260537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk54k\" (UniqueName: \"kubernetes.io/projected/01fcd59c-1576-4a5d-8925-c209270bcae3-kube-api-access-gk54k\") pod \"telemeter-client-85b7d87986-sqkfm\" (UID: \"01fcd59c-1576-4a5d-8925-c209270bcae3\") " pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.354426 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.354338    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm"
Jul 28 12:53:59.496234 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:53:59.496085    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85b7d87986-sqkfm"]
Jul 28 12:53:59.498985 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:53:59.498947    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fcd59c_1576_4a5d_8925_c209270bcae3.slice/crio-fe741ed13ee2ffa2e8652a4d94b101d7a8e7d13592325a334e0176f94db9e27f WatchSource:0}: Error finding container fe741ed13ee2ffa2e8652a4d94b101d7a8e7d13592325a334e0176f94db9e27f: Status 404 returned error can't find the container with id fe741ed13ee2ffa2e8652a4d94b101d7a8e7d13592325a334e0176f94db9e27f
Jul 28 12:54:00.306874 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:00.306833    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm" event={"ID":"01fcd59c-1576-4a5d-8925-c209270bcae3","Type":"ContainerStarted","Data":"fe741ed13ee2ffa2e8652a4d94b101d7a8e7d13592325a334e0176f94db9e27f"}
Jul 28 12:54:02.316126 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:02.316092    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm" event={"ID":"01fcd59c-1576-4a5d-8925-c209270bcae3","Type":"ContainerStarted","Data":"56c6d158e204b8964d578b2828bed42211df3d35e6e73986a1c582b0290ad9c7"}
Jul 28 12:54:03.321969 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:03.321936    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm" event={"ID":"01fcd59c-1576-4a5d-8925-c209270bcae3","Type":"ContainerStarted","Data":"ead0b66de01d5ab9d8b71cacf8d43fdf57becbe8f70c7bcf0de89591f8b598c7"}
Jul 28 12:54:03.322311 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:03.321995    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm" event={"ID":"01fcd59c-1576-4a5d-8925-c209270bcae3","Type":"ContainerStarted","Data":"95552543d9fe2c2f6876c1cc018b79dac836cbdff639608df38f4b56919accf9"}
Jul 28 12:54:03.351043 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:03.350997    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85b7d87986-sqkfm" podStartSLOduration=0.945238808 podStartE2EDuration="4.350980708s" totalImagesPullingTime="3.4057419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:53:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:54:03.350658642 +0000 UTC m=+178.511426577" watchObservedRunningTime="2026-07-28 12:54:03.350980708 +0000 UTC m=+178.511748642"
Jul 28 12:54:04.281619 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.281589    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78dfcdf86b-h4jp2"]
Jul 28 12:54:04.284712 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.284689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.287537 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.287516    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x4m6r\""
Jul 28 12:54:04.287670 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.287600    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 12:54:04.288868 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.288842    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 12:54:04.288979 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.288870    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 12:54:04.288979 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.288870    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 12:54:04.288979 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.288870    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 12:54:04.293100 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.293083    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 12:54:04.306193 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.306169    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78dfcdf86b-h4jp2"]
Jul 28 12:54:04.395252 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.395210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-trusted-ca-bundle\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.395715 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.395280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-oauth-config\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.395715 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.395368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-serving-cert\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.395715 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.395483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-service-ca\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.395715 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.395541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-oauth-serving-cert\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.395715 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.395612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-config\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.395715 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.395654    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfknw\" (UniqueName: \"kubernetes.io/projected/eaf32c07-ee03-4f9e-85df-5c40ac872a60-kube-api-access-qfknw\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.496297 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.496254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-config\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.496297 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.496295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfknw\" (UniqueName: \"kubernetes.io/projected/eaf32c07-ee03-4f9e-85df-5c40ac872a60-kube-api-access-qfknw\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.496577 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.496321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-trusted-ca-bundle\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.496577 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.496345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-oauth-config\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.496577 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.496372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-serving-cert\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.496577 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.496399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-service-ca\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.496577 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.496423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-oauth-serving-cert\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.497179 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.497154    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-oauth-serving-cert\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.497286 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.497234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-trusted-ca-bundle\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.497374 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.497353    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-config\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.497450 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.497428    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-service-ca\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.498997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.498967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-oauth-config\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.499160 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.499141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-serving-cert\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.509007 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.508988    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfknw\" (UniqueName: \"kubernetes.io/projected/eaf32c07-ee03-4f9e-85df-5c40ac872a60-kube-api-access-qfknw\") pod \"console-78dfcdf86b-h4jp2\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") " pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.594079 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.593989    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:04.730866 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:04.730840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78dfcdf86b-h4jp2"]
Jul 28 12:54:04.732633 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:54:04.732605    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf32c07_ee03_4f9e_85df_5c40ac872a60.slice/crio-0186a46f78ffc03b7f95493b86c3f56aaba624a128e16fb27a998dc9c8ca5dbe WatchSource:0}: Error finding container 0186a46f78ffc03b7f95493b86c3f56aaba624a128e16fb27a998dc9c8ca5dbe: Status 404 returned error can't find the container with id 0186a46f78ffc03b7f95493b86c3f56aaba624a128e16fb27a998dc9c8ca5dbe
Jul 28 12:54:05.332145 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:05.332108    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dfcdf86b-h4jp2" event={"ID":"eaf32c07-ee03-4f9e-85df-5c40ac872a60","Type":"ContainerStarted","Data":"046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581"}
Jul 28 12:54:05.332335 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:05.332160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dfcdf86b-h4jp2" event={"ID":"eaf32c07-ee03-4f9e-85df-5c40ac872a60","Type":"ContainerStarted","Data":"0186a46f78ffc03b7f95493b86c3f56aaba624a128e16fb27a998dc9c8ca5dbe"}
Jul 28 12:54:05.354664 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:05.354605    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78dfcdf86b-h4jp2" podStartSLOduration=1.354589107 podStartE2EDuration="1.354589107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:54:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:54:05.35254813 +0000 UTC m=+180.513316086" watchObservedRunningTime="2026-07-28 12:54:05.354589107 +0000 UTC m=+180.515357041"
Jul 28 12:54:10.621343 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.621309    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78dfcdf86b-h4jp2"]
Jul 28 12:54:10.657458 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.657431    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-646c96b867-4bccv"]
Jul 28 12:54:10.662107 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.662087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.672854 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.672832    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-646c96b867-4bccv"]
Jul 28 12:54:10.747593 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.747558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-trusted-ca-bundle\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.747750 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.747622    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-console-config\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.747750 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.747650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpqbt\" (UniqueName: \"kubernetes.io/projected/63d90cb9-c389-4981-8846-92edacf64392-kube-api-access-wpqbt\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.747750 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.747671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-oauth-serving-cert\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.747750 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.747714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-service-ca\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.747750 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.747737    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-serving-cert\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.747953 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.747767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-oauth-config\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.849154 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.849116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-console-config\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.849154 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.849157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqbt\" (UniqueName: \"kubernetes.io/projected/63d90cb9-c389-4981-8846-92edacf64392-kube-api-access-wpqbt\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.849392 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.849176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-oauth-serving-cert\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.849392 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.849204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-service-ca\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.849392 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.849235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-serving-cert\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.849392 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.849267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-oauth-config\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.849392 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.849299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-trusted-ca-bundle\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.850064 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.850039    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-oauth-serving-cert\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.850171 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.850144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-service-ca\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.850285 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.850268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-trusted-ca-bundle\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.850332 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.850273    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-console-config\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.851917 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.851892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-serving-cert\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.852014 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.851929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-oauth-config\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.858697 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.858676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqbt\" (UniqueName: \"kubernetes.io/projected/63d90cb9-c389-4981-8846-92edacf64392-kube-api-access-wpqbt\") pod \"console-646c96b867-4bccv\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") " pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:10.971872 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:10.971787    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:11.104295 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:11.104270    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-646c96b867-4bccv"]
Jul 28 12:54:11.106762 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:54:11.106729    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d90cb9_c389_4981_8846_92edacf64392.slice/crio-3a296d1fde072de5a2d969ce1e1f2b08ab341f4e6c897e393cdd3e595fdbf642 WatchSource:0}: Error finding container 3a296d1fde072de5a2d969ce1e1f2b08ab341f4e6c897e393cdd3e595fdbf642: Status 404 returned error can't find the container with id 3a296d1fde072de5a2d969ce1e1f2b08ab341f4e6c897e393cdd3e595fdbf642
Jul 28 12:54:11.359997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:11.359967    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646c96b867-4bccv" event={"ID":"63d90cb9-c389-4981-8846-92edacf64392","Type":"ContainerStarted","Data":"87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a"}
Jul 28 12:54:11.360146 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:11.360016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646c96b867-4bccv" event={"ID":"63d90cb9-c389-4981-8846-92edacf64392","Type":"ContainerStarted","Data":"3a296d1fde072de5a2d969ce1e1f2b08ab341f4e6c897e393cdd3e595fdbf642"}
Jul 28 12:54:11.382300 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:11.382258    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-646c96b867-4bccv" podStartSLOduration=1.382243989 podStartE2EDuration="1.382243989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:54:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:54:11.38097571 +0000 UTC m=+186.541743674" watchObservedRunningTime="2026-07-28 12:54:11.382243989 +0000 UTC m=+186.543011923"
Jul 28 12:54:14.594147 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:14.594110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:20.972493 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:20.972455    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:20.972990 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:20.972515    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:20.977080 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:20.977060    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:21.404435 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:21.404410    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:54:35.640696 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:35.640642    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78dfcdf86b-h4jp2" podUID="eaf32c07-ee03-4f9e-85df-5c40ac872a60" containerName="console" containerID="cri-o://046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581" gracePeriod=15
Jul 28 12:54:35.891509 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:35.891453    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:36.067907 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.067869    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-serving-cert\") pod \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") "
Jul 28 12:54:36.068102 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.067918    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-service-ca\") pod \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") "
Jul 28 12:54:36.068102 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.067966    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-oauth-serving-cert\") pod \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") "
Jul 28 12:54:36.068102 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.068065    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-trusted-ca-bundle\") pod \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") "
Jul 28 12:54:36.068265 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.068141    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfknw\" (UniqueName: \"kubernetes.io/projected/eaf32c07-ee03-4f9e-85df-5c40ac872a60-kube-api-access-qfknw\") pod \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") "
Jul 28 12:54:36.068265 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.068190    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-oauth-config\") pod \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") "
Jul 28 12:54:36.068265 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.068217    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-config\") pod \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\" (UID: \"eaf32c07-ee03-4f9e-85df-5c40ac872a60\") "
Jul 28 12:54:36.068418 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.068368    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-service-ca" (OuterVolumeSpecName: "service-ca") pod "eaf32c07-ee03-4f9e-85df-5c40ac872a60" (UID: "eaf32c07-ee03-4f9e-85df-5c40ac872a60"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:54:36.068418 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.068376    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eaf32c07-ee03-4f9e-85df-5c40ac872a60" (UID: "eaf32c07-ee03-4f9e-85df-5c40ac872a60"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:54:36.068516 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.068438    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eaf32c07-ee03-4f9e-85df-5c40ac872a60" (UID: "eaf32c07-ee03-4f9e-85df-5c40ac872a60"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:54:36.068672 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.068611    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:54:36.068672 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.068641    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-oauth-serving-cert\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:54:36.068672 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.068673    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-config" (OuterVolumeSpecName: "console-config") pod "eaf32c07-ee03-4f9e-85df-5c40ac872a60" (UID: "eaf32c07-ee03-4f9e-85df-5c40ac872a60"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:54:36.070314 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.070289    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eaf32c07-ee03-4f9e-85df-5c40ac872a60" (UID: "eaf32c07-ee03-4f9e-85df-5c40ac872a60"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:54:36.070422 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.070312    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf32c07-ee03-4f9e-85df-5c40ac872a60-kube-api-access-qfknw" (OuterVolumeSpecName: "kube-api-access-qfknw") pod "eaf32c07-ee03-4f9e-85df-5c40ac872a60" (UID: "eaf32c07-ee03-4f9e-85df-5c40ac872a60"). InnerVolumeSpecName "kube-api-access-qfknw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:54:36.070422 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.070359    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eaf32c07-ee03-4f9e-85df-5c40ac872a60" (UID: "eaf32c07-ee03-4f9e-85df-5c40ac872a60"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:54:36.169925 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.169833    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-oauth-config\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:54:36.169925 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.169867    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-config\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:54:36.169925 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.169876    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eaf32c07-ee03-4f9e-85df-5c40ac872a60-console-serving-cert\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:54:36.169925 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.169884    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf32c07-ee03-4f9e-85df-5c40ac872a60-trusted-ca-bundle\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:54:36.169925 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.169893    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfknw\" (UniqueName: \"kubernetes.io/projected/eaf32c07-ee03-4f9e-85df-5c40ac872a60-kube-api-access-qfknw\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:54:36.459946 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.459857    2578 generic.go:356] "Generic (PLEG): container finished" podID="eaf32c07-ee03-4f9e-85df-5c40ac872a60" containerID="046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581" exitCode=0
Jul 28 12:54:36.459946 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.459900    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dfcdf86b-h4jp2" event={"ID":"eaf32c07-ee03-4f9e-85df-5c40ac872a60","Type":"ContainerDied","Data":"046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581"}
Jul 28 12:54:36.459946 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.459908    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dfcdf86b-h4jp2"
Jul 28 12:54:36.459946 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.459941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dfcdf86b-h4jp2" event={"ID":"eaf32c07-ee03-4f9e-85df-5c40ac872a60","Type":"ContainerDied","Data":"0186a46f78ffc03b7f95493b86c3f56aaba624a128e16fb27a998dc9c8ca5dbe"}
Jul 28 12:54:36.460250 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.459961    2578 scope.go:117] "RemoveContainer" containerID="046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581"
Jul 28 12:54:36.468566 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.468548    2578 scope.go:117] "RemoveContainer" containerID="046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581"
Jul 28 12:54:36.468829 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:54:36.468796    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581\": container with ID starting with 046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581 not found: ID does not exist" containerID="046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581"
Jul 28 12:54:36.468927 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.468836    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581"} err="failed to get container status \"046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581\": rpc error: code = NotFound desc = could not find container \"046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581\": container with ID starting with 046bb3519f84c554cbc3b448957042e341648eb0554c370a87ad196df6b80581 not found: ID does not exist"
Jul 28 12:54:36.482122 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.482100    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78dfcdf86b-h4jp2"]
Jul 28 12:54:36.487751 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:36.487666    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78dfcdf86b-h4jp2"]
Jul 28 12:54:37.270324 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:54:37.270276    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf32c07-ee03-4f9e-85df-5c40ac872a60" path="/var/lib/kubelet/pods/eaf32c07-ee03-4f9e-85df-5c40ac872a60/volumes"
Jul 28 12:56:05.167289 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:05.167262    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 12:56:05.174625 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:05.174603    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 12:56:05.175957 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:05.175938    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 12:56:05.178920 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:05.178904    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 12:56:05.183784 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:05.183766    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 12:56:41.670670 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.670636    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gzrzt"]
Jul 28 12:56:41.673038 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.670964    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf32c07-ee03-4f9e-85df-5c40ac872a60" containerName="console"
Jul 28 12:56:41.673038 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.670976    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf32c07-ee03-4f9e-85df-5c40ac872a60" containerName="console"
Jul 28 12:56:41.673038 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.671029    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf32c07-ee03-4f9e-85df-5c40ac872a60" containerName="console"
Jul 28 12:56:41.673935 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.673920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt"
Jul 28 12:56:41.676709 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.676690    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 28 12:56:41.677906 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.677885    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r9qkr\""
Jul 28 12:56:41.677906 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.677895    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 28 12:56:41.686353 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.686334    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gzrzt"]
Jul 28 12:56:41.736297 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.736269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b33c39d-2c41-46bd-bad1-becb671e74aa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gzrzt\" (UID: \"4b33c39d-2c41-46bd-bad1-becb671e74aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt"
Jul 28 12:56:41.736449 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.736353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp4zx\" (UniqueName: \"kubernetes.io/projected/4b33c39d-2c41-46bd-bad1-becb671e74aa-kube-api-access-xp4zx\") pod \"cert-manager-webhook-6486ffd997-gzrzt\" (UID: \"4b33c39d-2c41-46bd-bad1-becb671e74aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt"
Jul 28 12:56:41.837516 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.837483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp4zx\" (UniqueName: \"kubernetes.io/projected/4b33c39d-2c41-46bd-bad1-becb671e74aa-kube-api-access-xp4zx\") pod \"cert-manager-webhook-6486ffd997-gzrzt\" (UID: \"4b33c39d-2c41-46bd-bad1-becb671e74aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt"
Jul 28 12:56:41.837516 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.837522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b33c39d-2c41-46bd-bad1-becb671e74aa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gzrzt\" (UID: \"4b33c39d-2c41-46bd-bad1-becb671e74aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt"
Jul 28 12:56:41.850117 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.850089    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b33c39d-2c41-46bd-bad1-becb671e74aa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gzrzt\" (UID: \"4b33c39d-2c41-46bd-bad1-becb671e74aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt"
Jul 28 12:56:41.850908 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.850885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp4zx\" (UniqueName: \"kubernetes.io/projected/4b33c39d-2c41-46bd-bad1-becb671e74aa-kube-api-access-xp4zx\") pod \"cert-manager-webhook-6486ffd997-gzrzt\" (UID: \"4b33c39d-2c41-46bd-bad1-becb671e74aa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt"
Jul 28 12:56:41.998101 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:41.998021    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt"
Jul 28 12:56:42.130295 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:42.130270    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gzrzt"]
Jul 28 12:56:42.132301 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:56:42.132270    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b33c39d_2c41_46bd_bad1_becb671e74aa.slice/crio-0f3fde58b754793a3d8c1fe2f73597a922e2813dc36c06b09143b4d4617e8ca8 WatchSource:0}: Error finding container 0f3fde58b754793a3d8c1fe2f73597a922e2813dc36c06b09143b4d4617e8ca8: Status 404 returned error can't find the container with id 0f3fde58b754793a3d8c1fe2f73597a922e2813dc36c06b09143b4d4617e8ca8
Jul 28 12:56:42.134145 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:42.134127    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 12:56:42.942438 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:42.942380    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt" event={"ID":"4b33c39d-2c41-46bd-bad1-becb671e74aa","Type":"ContainerStarted","Data":"0f3fde58b754793a3d8c1fe2f73597a922e2813dc36c06b09143b4d4617e8ca8"}
Jul 28 12:56:45.962612 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:45.962576    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt" event={"ID":"4b33c39d-2c41-46bd-bad1-becb671e74aa","Type":"ContainerStarted","Data":"e727b43c2a5c336cf237a4ff07f3e1d027b14d36be9a404a06887a33ce9c3059"}
Jul 28 12:56:45.963014 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:45.962699    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt"
Jul 28 12:56:45.987225 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:45.987182    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt" podStartSLOduration=1.773111366 podStartE2EDuration="4.987168574s" totalImagesPullingTime="3.214057208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:56:45.984555444 +0000 UTC m=+341.145323378" watchObservedRunningTime="2026-07-28 12:56:45.987168574 +0000 UTC m=+341.147936508"
Jul 28 12:56:51.969555 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:56:51.969518    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gzrzt"
Jul 28 12:57:20.895519 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.895437    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"]
Jul 28 12:57:20.901688 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.901670    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:20.904905 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.904869    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n5pcj\""
Jul 28 12:57:20.904905 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.904881    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 12:57:20.905089 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.904953    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 12:57:20.905089 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.905009    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 12:57:20.905224 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.905207    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 12:57:20.921073 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.921045    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"]
Jul 28 12:57:20.953123 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.953093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl8jt\" (UniqueName: \"kubernetes.io/projected/6de136f9-5cd7-40ad-8820-fd896420a2a6-kube-api-access-jl8jt\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:20.953237 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.953152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6de136f9-5cd7-40ad-8820-fd896420a2a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:20.953237 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.953203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6de136f9-5cd7-40ad-8820-fd896420a2a6-manifests\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:20.953237 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.953228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6de136f9-5cd7-40ad-8820-fd896420a2a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:20.953337 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:20.953285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6de136f9-5cd7-40ad-8820-fd896420a2a6-tmp\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.054429 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.054391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6de136f9-5cd7-40ad-8820-fd896420a2a6-manifests\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.054590 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.054438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6de136f9-5cd7-40ad-8820-fd896420a2a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.054643 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.054620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6de136f9-5cd7-40ad-8820-fd896420a2a6-tmp\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.054716 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.054699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl8jt\" (UniqueName: \"kubernetes.io/projected/6de136f9-5cd7-40ad-8820-fd896420a2a6-kube-api-access-jl8jt\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.054829 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.054786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6de136f9-5cd7-40ad-8820-fd896420a2a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.054897 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.054880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6de136f9-5cd7-40ad-8820-fd896420a2a6-manifests\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.057008 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.056982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6de136f9-5cd7-40ad-8820-fd896420a2a6-tmp\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.057185 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.057169    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6de136f9-5cd7-40ad-8820-fd896420a2a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.057304 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.057282    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6de136f9-5cd7-40ad-8820-fd896420a2a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.069174 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.069149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl8jt\" (UniqueName: \"kubernetes.io/projected/6de136f9-5cd7-40ad-8820-fd896420a2a6-kube-api-access-jl8jt\") pod \"opendatahub-operator-controller-manager-64bb544cf8-cccl6\" (UID: \"6de136f9-5cd7-40ad-8820-fd896420a2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.217559 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.217473    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:21.365967 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.365941    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"]
Jul 28 12:57:21.366967 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:57:21.366941    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de136f9_5cd7_40ad_8820_fd896420a2a6.slice/crio-ce6b1d84002768b1ca86a922ce72155047531c98bde80c77adfb073b0d786a9f WatchSource:0}: Error finding container ce6b1d84002768b1ca86a922ce72155047531c98bde80c77adfb073b0d786a9f: Status 404 returned error can't find the container with id ce6b1d84002768b1ca86a922ce72155047531c98bde80c77adfb073b0d786a9f
Jul 28 12:57:21.556550 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.556524    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"]
Jul 28 12:57:21.560919 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.560895    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.571485 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.571433    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 12:57:21.571637 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.571566    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 12:57:21.571997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.571935    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 12:57:21.572131 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.572066    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:57:21.572250 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.572233    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h4ctg\""
Jul 28 12:57:21.577869 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.577851    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 12:57:21.599691 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.599667    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"]
Jul 28 12:57:21.658857 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.658830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d52370c-ef05-43d0-ad8e-699d8c283fad-manager-config\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.659006 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.658884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d52370c-ef05-43d0-ad8e-699d8c283fad-cert\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.659006 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.658913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp8fj\" (UniqueName: \"kubernetes.io/projected/9d52370c-ef05-43d0-ad8e-699d8c283fad-kube-api-access-hp8fj\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.659006 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.658955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d52370c-ef05-43d0-ad8e-699d8c283fad-metrics-cert\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.760215 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.760187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d52370c-ef05-43d0-ad8e-699d8c283fad-manager-config\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.760404 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.760237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d52370c-ef05-43d0-ad8e-699d8c283fad-cert\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.760404 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.760255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp8fj\" (UniqueName: \"kubernetes.io/projected/9d52370c-ef05-43d0-ad8e-699d8c283fad-kube-api-access-hp8fj\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.760404 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.760274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d52370c-ef05-43d0-ad8e-699d8c283fad-metrics-cert\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.760904 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.760875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d52370c-ef05-43d0-ad8e-699d8c283fad-manager-config\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.762888 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.762861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d52370c-ef05-43d0-ad8e-699d8c283fad-cert\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.762999 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.762909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d52370c-ef05-43d0-ad8e-699d8c283fad-metrics-cert\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.774350 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.774328    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp8fj\" (UniqueName: \"kubernetes.io/projected/9d52370c-ef05-43d0-ad8e-699d8c283fad-kube-api-access-hp8fj\") pod \"lws-controller-manager-5fcd6f4d74-pmjhw\" (UID: \"9d52370c-ef05-43d0-ad8e-699d8c283fad\") " pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:21.874662 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:21.874588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:22.032966 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:22.032884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"]
Jul 28 12:57:22.036926 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:57:22.036892    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d52370c_ef05_43d0_ad8e_699d8c283fad.slice/crio-9b75ed373238c2c52869c55df1e19c47506641487632a1910482c0e0a563cde2 WatchSource:0}: Error finding container 9b75ed373238c2c52869c55df1e19c47506641487632a1910482c0e0a563cde2: Status 404 returned error can't find the container with id 9b75ed373238c2c52869c55df1e19c47506641487632a1910482c0e0a563cde2
Jul 28 12:57:22.102511 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:22.102472    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw" event={"ID":"9d52370c-ef05-43d0-ad8e-699d8c283fad","Type":"ContainerStarted","Data":"9b75ed373238c2c52869c55df1e19c47506641487632a1910482c0e0a563cde2"}
Jul 28 12:57:22.104866 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:22.104830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6" event={"ID":"6de136f9-5cd7-40ad-8820-fd896420a2a6","Type":"ContainerStarted","Data":"ce6b1d84002768b1ca86a922ce72155047531c98bde80c77adfb073b0d786a9f"}
Jul 28 12:57:25.123562 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:25.123510    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6" event={"ID":"6de136f9-5cd7-40ad-8820-fd896420a2a6","Type":"ContainerStarted","Data":"19370879a5e7439a703447c10412479d5cbcd6ac57621e1d43504a336cf052e5"}
Jul 28 12:57:26.129844 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:26.129784    2578 generic.go:356] "Generic (PLEG): container finished" podID="6de136f9-5cd7-40ad-8820-fd896420a2a6" containerID="19370879a5e7439a703447c10412479d5cbcd6ac57621e1d43504a336cf052e5" exitCode=0
Jul 28 12:57:26.130341 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:26.129865    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6" event={"ID":"6de136f9-5cd7-40ad-8820-fd896420a2a6","Type":"ContainerDied","Data":"19370879a5e7439a703447c10412479d5cbcd6ac57621e1d43504a336cf052e5"}
Jul 28 12:57:26.132003 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:26.131973    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw" event={"ID":"9d52370c-ef05-43d0-ad8e-699d8c283fad","Type":"ContainerStarted","Data":"a0e95290c061897d6e90830d583d46ec2a687452c12a342dbe9420f6f8f5149b"}
Jul 28 12:57:26.132148 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:26.132031    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:26.180867 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:26.180823    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw" podStartSLOduration=1.205329644 podStartE2EDuration="5.180789368s" totalImagesPullingTime="3.975459724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:57:26.179417741 +0000 UTC m=+381.340185692" watchObservedRunningTime="2026-07-28 12:57:26.180789368 +0000 UTC m=+381.341557301"
Jul 28 12:57:27.138372 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:27.138331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6" event={"ID":"6de136f9-5cd7-40ad-8820-fd896420a2a6","Type":"ContainerStarted","Data":"3490e5b4e29682ad6e8bbfe61d2c9a2d5dd3b33975ddc40ae06c49b458c21e5d"}
Jul 28 12:57:27.179741 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:27.179693    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6" podStartSLOduration=2.626722285 podStartE2EDuration="7.179676961s" totalImagesPullingTime="3.237929912s" totalInitContainerRuntime="1.315024764s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:57:27.177470104 +0000 UTC m=+382.338238037" watchObservedRunningTime="2026-07-28 12:57:27.179676961 +0000 UTC m=+382.340444948"
Jul 28 12:57:28.143007 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:28.142971    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:37.140963 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:37.140916    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5fcd6f4d74-pmjhw"
Jul 28 12:57:39.149793 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:39.149762    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-cccl6"
Jul 28 12:57:53.701473 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.701431    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"]
Jul 28 12:57:53.716761 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.716732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.722247 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.722218    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 12:57:53.722548 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.722526    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 12:57:53.722883 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.722600    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-42gv6\""
Jul 28 12:57:53.722997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.722913    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 12:57:53.722997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.722926    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 12:57:53.725264 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.724875    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"]
Jul 28 12:57:53.844499 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.844463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.844670 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.844512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.844670 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.844548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb43755-0c43-4964-9700-a3d0fd53febb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.844670 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.844566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lqsf\" (UniqueName: \"kubernetes.io/projected/3cb43755-0c43-4964-9700-a3d0fd53febb-kube-api-access-4lqsf\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.844670 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.844590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.844670 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.844610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3cb43755-0c43-4964-9700-a3d0fd53febb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.844911 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.844729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.945792 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.945756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.945961 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.945797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.945961 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.945874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb43755-0c43-4964-9700-a3d0fd53febb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.945961 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.945899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lqsf\" (UniqueName: \"kubernetes.io/projected/3cb43755-0c43-4964-9700-a3d0fd53febb-kube-api-access-4lqsf\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.945961 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.945928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.945961 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.945959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3cb43755-0c43-4964-9700-a3d0fd53febb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.946364 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.946029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.946487 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.946458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.948429 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.948408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.948535 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.948436    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3cb43755-0c43-4964-9700-a3d0fd53febb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.949287 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.949270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb43755-0c43-4964-9700-a3d0fd53febb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.949490 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.949469    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.956427 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.956357    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb43755-0c43-4964-9700-a3d0fd53febb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:53.956613 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:53.956590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lqsf\" (UniqueName: \"kubernetes.io/projected/3cb43755-0c43-4964-9700-a3d0fd53febb-kube-api-access-4lqsf\") pod \"istiod-openshift-gateway-5677ccb49b-mb7fn\" (UID: \"3cb43755-0c43-4964-9700-a3d0fd53febb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:54.028246 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:54.028214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:54.168072 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:54.168047    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"]
Jul 28 12:57:54.170834 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:57:54.170793    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb43755_0c43_4964_9700_a3d0fd53febb.slice/crio-410cc3ab2790aeca0b34d3c3c92efc78a5d3125aad948b0468fc7a83ff078307 WatchSource:0}: Error finding container 410cc3ab2790aeca0b34d3c3c92efc78a5d3125aad948b0468fc7a83ff078307: Status 404 returned error can't find the container with id 410cc3ab2790aeca0b34d3c3c92efc78a5d3125aad948b0468fc7a83ff078307
Jul 28 12:57:54.259108 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:54.259015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn" event={"ID":"3cb43755-0c43-4964-9700-a3d0fd53febb","Type":"ContainerStarted","Data":"410cc3ab2790aeca0b34d3c3c92efc78a5d3125aad948b0468fc7a83ff078307"}
Jul 28 12:57:57.227886 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:57.227847    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 12:57:57.228168 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:57.227915    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 12:57:58.283491 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:58.283450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn" event={"ID":"3cb43755-0c43-4964-9700-a3d0fd53febb","Type":"ContainerStarted","Data":"64eec810cfa35c8dc5008d3db792d51204b46f479b0a9f8a8ade32516e0cf5db"}
Jul 28 12:57:58.283939 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:58.283692    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:58.285466 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:58.285418    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-mb7fn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 12:57:58.285605 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:58.285560    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn" podUID="3cb43755-0c43-4964-9700-a3d0fd53febb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 12:57:59.288541 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:59.288508    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn"
Jul 28 12:57:59.329418 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:57:59.329361    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mb7fn" podStartSLOduration=3.274887426 podStartE2EDuration="6.329343785s" totalImagesPullingTime="3.054456359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:57:58.328155402 +0000 UTC m=+413.488923336" watchObservedRunningTime="2026-07-28 12:57:59.329343785 +0000 UTC m=+414.490111719"
Jul 28 12:59:04.766761 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.766720    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bc999f9c7-fn7k9"]
Jul 28 12:59:04.770896 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.770872    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.782792 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.782770    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc999f9c7-fn7k9"]
Jul 28 12:59:04.847410 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.847374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xdw\" (UniqueName: \"kubernetes.io/projected/4e91ea08-1227-459a-8ee8-0bf1887f6920-kube-api-access-s9xdw\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.847585 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.847429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e91ea08-1227-459a-8ee8-0bf1887f6920-console-oauth-config\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.847585 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.847462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-oauth-serving-cert\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.847585 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.847495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e91ea08-1227-459a-8ee8-0bf1887f6920-console-serving-cert\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.847585 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.847522    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-console-config\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.847585 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.847545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-service-ca\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.847766 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.847578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-trusted-ca-bundle\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.948923 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.948878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xdw\" (UniqueName: \"kubernetes.io/projected/4e91ea08-1227-459a-8ee8-0bf1887f6920-kube-api-access-s9xdw\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.948923 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.948928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e91ea08-1227-459a-8ee8-0bf1887f6920-console-oauth-config\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.949240 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.949047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-oauth-serving-cert\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.949240 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.949090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e91ea08-1227-459a-8ee8-0bf1887f6920-console-serving-cert\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.949240 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.949118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-console-config\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.949240 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.949142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-service-ca\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.949240 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.949163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-trusted-ca-bundle\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.949876 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.949849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-oauth-serving-cert\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.949998 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.949910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-service-ca\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.950090 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.950071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-trusted-ca-bundle\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.950138 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.950088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e91ea08-1227-459a-8ee8-0bf1887f6920-console-config\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.951497 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.951475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e91ea08-1227-459a-8ee8-0bf1887f6920-console-oauth-config\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.951659 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.951641    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e91ea08-1227-459a-8ee8-0bf1887f6920-console-serving-cert\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:04.957622 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:04.957601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xdw\" (UniqueName: \"kubernetes.io/projected/4e91ea08-1227-459a-8ee8-0bf1887f6920-kube-api-access-s9xdw\") pod \"console-7bc999f9c7-fn7k9\" (UID: \"4e91ea08-1227-459a-8ee8-0bf1887f6920\") " pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:05.080777 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:05.080741    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:05.217481 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:05.217436    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc999f9c7-fn7k9"]
Jul 28 12:59:05.220463 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:59:05.220435    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e91ea08_1227_459a_8ee8_0bf1887f6920.slice/crio-bc9c1ce6a390fe6e628d33a899aaff00e551a3c084f417487c9ebd70fbf5f305 WatchSource:0}: Error finding container bc9c1ce6a390fe6e628d33a899aaff00e551a3c084f417487c9ebd70fbf5f305: Status 404 returned error can't find the container with id bc9c1ce6a390fe6e628d33a899aaff00e551a3c084f417487c9ebd70fbf5f305
Jul 28 12:59:05.568254 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:05.568221    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc999f9c7-fn7k9" event={"ID":"4e91ea08-1227-459a-8ee8-0bf1887f6920","Type":"ContainerStarted","Data":"c4a05d23866c71997270affd32c66b07114655dd80161922b94fc84c70ff1dfa"}
Jul 28 12:59:05.568450 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:05.568271    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc999f9c7-fn7k9" event={"ID":"4e91ea08-1227-459a-8ee8-0bf1887f6920","Type":"ContainerStarted","Data":"bc9c1ce6a390fe6e628d33a899aaff00e551a3c084f417487c9ebd70fbf5f305"}
Jul 28 12:59:05.586780 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:05.586731    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bc999f9c7-fn7k9" podStartSLOduration=1.5867168889999999 podStartE2EDuration="1.586716889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:59:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:59:05.585343202 +0000 UTC m=+480.746111162" watchObservedRunningTime="2026-07-28 12:59:05.586716889 +0000 UTC m=+480.747484821"
Jul 28 12:59:15.081499 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:15.081465    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:15.081940 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:15.081527    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:15.086410 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:15.086383    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:15.617220 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:15.617188    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bc999f9c7-fn7k9"
Jul 28 12:59:15.682367 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:15.682335    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-646c96b867-4bccv"]
Jul 28 12:59:40.703771 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:40.703703    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-646c96b867-4bccv" podUID="63d90cb9-c389-4981-8846-92edacf64392" containerName="console" containerID="cri-o://87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a" gracePeriod=15
Jul 28 12:59:40.955556 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:40.955500    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:59:41.062529 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.062498    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-oauth-serving-cert\") pod \"63d90cb9-c389-4981-8846-92edacf64392\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") "
Jul 28 12:59:41.062529 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.062530    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-oauth-config\") pod \"63d90cb9-c389-4981-8846-92edacf64392\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") "
Jul 28 12:59:41.062740 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.062580    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-console-config\") pod \"63d90cb9-c389-4981-8846-92edacf64392\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") "
Jul 28 12:59:41.062740 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.062609    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-serving-cert\") pod \"63d90cb9-c389-4981-8846-92edacf64392\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") "
Jul 28 12:59:41.062740 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.062645    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpqbt\" (UniqueName: \"kubernetes.io/projected/63d90cb9-c389-4981-8846-92edacf64392-kube-api-access-wpqbt\") pod \"63d90cb9-c389-4981-8846-92edacf64392\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") "
Jul 28 12:59:41.062740 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.062710    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-service-ca\") pod \"63d90cb9-c389-4981-8846-92edacf64392\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") "
Jul 28 12:59:41.063034 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.062992    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-trusted-ca-bundle\") pod \"63d90cb9-c389-4981-8846-92edacf64392\" (UID: \"63d90cb9-c389-4981-8846-92edacf64392\") "
Jul 28 12:59:41.063195 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.062993    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "63d90cb9-c389-4981-8846-92edacf64392" (UID: "63d90cb9-c389-4981-8846-92edacf64392"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:59:41.063195 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.063083    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-console-config" (OuterVolumeSpecName: "console-config") pod "63d90cb9-c389-4981-8846-92edacf64392" (UID: "63d90cb9-c389-4981-8846-92edacf64392"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:59:41.063195 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.063088    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-service-ca" (OuterVolumeSpecName: "service-ca") pod "63d90cb9-c389-4981-8846-92edacf64392" (UID: "63d90cb9-c389-4981-8846-92edacf64392"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:59:41.063495 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.063328    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-console-config\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:59:41.063495 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.063346    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:59:41.063495 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.063358    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-oauth-serving-cert\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:59:41.063495 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.063435    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "63d90cb9-c389-4981-8846-92edacf64392" (UID: "63d90cb9-c389-4981-8846-92edacf64392"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:59:41.065179 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.065154    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "63d90cb9-c389-4981-8846-92edacf64392" (UID: "63d90cb9-c389-4981-8846-92edacf64392"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:59:41.065269 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.065213    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d90cb9-c389-4981-8846-92edacf64392-kube-api-access-wpqbt" (OuterVolumeSpecName: "kube-api-access-wpqbt") pod "63d90cb9-c389-4981-8846-92edacf64392" (UID: "63d90cb9-c389-4981-8846-92edacf64392"). InnerVolumeSpecName "kube-api-access-wpqbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:59:41.065269 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.065242    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "63d90cb9-c389-4981-8846-92edacf64392" (UID: "63d90cb9-c389-4981-8846-92edacf64392"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:59:41.164153 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.164121    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-serving-cert\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:59:41.164153 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.164144    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpqbt\" (UniqueName: \"kubernetes.io/projected/63d90cb9-c389-4981-8846-92edacf64392-kube-api-access-wpqbt\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:59:41.164153 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.164154    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d90cb9-c389-4981-8846-92edacf64392-trusted-ca-bundle\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:59:41.164153 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.164162    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63d90cb9-c389-4981-8846-92edacf64392-console-oauth-config\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 12:59:41.725510 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.725420    2578 generic.go:356] "Generic (PLEG): container finished" podID="63d90cb9-c389-4981-8846-92edacf64392" containerID="87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a" exitCode=0
Jul 28 12:59:41.725510 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.725482    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-646c96b867-4bccv"
Jul 28 12:59:41.725970 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.725487    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646c96b867-4bccv" event={"ID":"63d90cb9-c389-4981-8846-92edacf64392","Type":"ContainerDied","Data":"87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a"}
Jul 28 12:59:41.725970 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.725600    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-646c96b867-4bccv" event={"ID":"63d90cb9-c389-4981-8846-92edacf64392","Type":"ContainerDied","Data":"3a296d1fde072de5a2d969ce1e1f2b08ab341f4e6c897e393cdd3e595fdbf642"}
Jul 28 12:59:41.725970 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.725621    2578 scope.go:117] "RemoveContainer" containerID="87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a"
Jul 28 12:59:41.733905 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.733890    2578 scope.go:117] "RemoveContainer" containerID="87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a"
Jul 28 12:59:41.734143 ip-10-0-136-204 kubenswrapper[2578]: E0728 12:59:41.734127    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a\": container with ID starting with 87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a not found: ID does not exist" containerID="87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a"
Jul 28 12:59:41.734193 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.734153    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a"} err="failed to get container status \"87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a\": rpc error: code = NotFound desc = could not find container \"87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a\": container with ID starting with 87a7fe7ff93918c7efd5d1f88fb89930804363b5c0048799a2d95f8c7f8d959a not found: ID does not exist"
Jul 28 12:59:41.755243 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.755217    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-646c96b867-4bccv"]
Jul 28 12:59:41.760729 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:41.760703    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-646c96b867-4bccv"]
Jul 28 12:59:42.946321 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:42.946284    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"]
Jul 28 12:59:42.946671 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:42.946654    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d90cb9-c389-4981-8846-92edacf64392" containerName="console"
Jul 28 12:59:42.946722 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:42.946677    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d90cb9-c389-4981-8846-92edacf64392" containerName="console"
Jul 28 12:59:42.946843 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:42.946830    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d90cb9-c389-4981-8846-92edacf64392" containerName="console"
Jul 28 12:59:42.951320 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:42.951305    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 12:59:42.954392 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:42.954372    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 12:59:42.954646 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:42.954632    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 12:59:42.955916 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:42.955895    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-76vmt\""
Jul 28 12:59:42.982514 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:42.982488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41c4499e-9507-40c1-bc52-d181086c800d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sphk7\" (UID: \"41c4499e-9507-40c1-bc52-d181086c800d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 12:59:42.982657 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:42.982542    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgv98\" (UniqueName: \"kubernetes.io/projected/41c4499e-9507-40c1-bc52-d181086c800d-kube-api-access-dgv98\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sphk7\" (UID: \"41c4499e-9507-40c1-bc52-d181086c800d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 12:59:42.983346 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:42.983318    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"]
Jul 28 12:59:43.083687 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:43.083655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41c4499e-9507-40c1-bc52-d181086c800d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sphk7\" (UID: \"41c4499e-9507-40c1-bc52-d181086c800d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 12:59:43.083858 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:43.083705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgv98\" (UniqueName: \"kubernetes.io/projected/41c4499e-9507-40c1-bc52-d181086c800d-kube-api-access-dgv98\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sphk7\" (UID: \"41c4499e-9507-40c1-bc52-d181086c800d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 12:59:43.084190 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:43.084158    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41c4499e-9507-40c1-bc52-d181086c800d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sphk7\" (UID: \"41c4499e-9507-40c1-bc52-d181086c800d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 12:59:43.103323 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:43.103301    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgv98\" (UniqueName: \"kubernetes.io/projected/41c4499e-9507-40c1-bc52-d181086c800d-kube-api-access-dgv98\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sphk7\" (UID: \"41c4499e-9507-40c1-bc52-d181086c800d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 12:59:43.263348 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:43.263262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 12:59:43.273777 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:43.273749    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63d90cb9-c389-4981-8846-92edacf64392" path="/var/lib/kubelet/pods/63d90cb9-c389-4981-8846-92edacf64392/volumes"
Jul 28 12:59:43.407884 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:43.407855    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"]
Jul 28 12:59:43.410529 ip-10-0-136-204 kubenswrapper[2578]: W0728 12:59:43.410493    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c4499e_9507_40c1_bc52_d181086c800d.slice/crio-9bc03d7315fd0f8e0c081bd70d8af5ab277c5fc11c37770102dd54becb75ddad WatchSource:0}: Error finding container 9bc03d7315fd0f8e0c081bd70d8af5ab277c5fc11c37770102dd54becb75ddad: Status 404 returned error can't find the container with id 9bc03d7315fd0f8e0c081bd70d8af5ab277c5fc11c37770102dd54becb75ddad
Jul 28 12:59:43.737188 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:43.737157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7" event={"ID":"41c4499e-9507-40c1-bc52-d181086c800d","Type":"ContainerStarted","Data":"9bc03d7315fd0f8e0c081bd70d8af5ab277c5fc11c37770102dd54becb75ddad"}
Jul 28 12:59:48.762571 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:48.762536    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7" event={"ID":"41c4499e-9507-40c1-bc52-d181086c800d","Type":"ContainerStarted","Data":"b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d"}
Jul 28 12:59:48.762980 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:48.762659    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 12:59:48.785384 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:48.785312    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7" podStartSLOduration=2.4394864529999998 podStartE2EDuration="6.785295537s" totalImagesPullingTime="4.345809084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:59:48.783600785 +0000 UTC m=+523.944368719" watchObservedRunningTime="2026-07-28 12:59:48.785295537 +0000 UTC m=+523.946063471"
Jul 28 12:59:59.768997 ip-10-0-136-204 kubenswrapper[2578]: I0728 12:59:59.768926    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 13:00:05.952361 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:05.952326    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"]
Jul 28 13:00:05.952742 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:05.952543    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7" podUID="41c4499e-9507-40c1-bc52-d181086c800d" containerName="manager" containerID="cri-o://b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d" gracePeriod=10
Jul 28 13:00:06.200507 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.200481    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 13:00:06.284974 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.284948    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41c4499e-9507-40c1-bc52-d181086c800d-extensions-socket-volume\") pod \"41c4499e-9507-40c1-bc52-d181086c800d\" (UID: \"41c4499e-9507-40c1-bc52-d181086c800d\") "
Jul 28 13:00:06.284974 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.284976    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgv98\" (UniqueName: \"kubernetes.io/projected/41c4499e-9507-40c1-bc52-d181086c800d-kube-api-access-dgv98\") pod \"41c4499e-9507-40c1-bc52-d181086c800d\" (UID: \"41c4499e-9507-40c1-bc52-d181086c800d\") "
Jul 28 13:00:06.285349 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.285318    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41c4499e-9507-40c1-bc52-d181086c800d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "41c4499e-9507-40c1-bc52-d181086c800d" (UID: "41c4499e-9507-40c1-bc52-d181086c800d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:00:06.287353 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.287331    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41c4499e-9507-40c1-bc52-d181086c800d-kube-api-access-dgv98" (OuterVolumeSpecName: "kube-api-access-dgv98") pod "41c4499e-9507-40c1-bc52-d181086c800d" (UID: "41c4499e-9507-40c1-bc52-d181086c800d"). InnerVolumeSpecName "kube-api-access-dgv98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:00:06.385712 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.385675    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41c4499e-9507-40c1-bc52-d181086c800d-extensions-socket-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:00:06.385712 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.385710    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgv98\" (UniqueName: \"kubernetes.io/projected/41c4499e-9507-40c1-bc52-d181086c800d-kube-api-access-dgv98\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:00:06.843229 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.843193    2578 generic.go:356] "Generic (PLEG): container finished" podID="41c4499e-9507-40c1-bc52-d181086c800d" containerID="b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d" exitCode=0
Jul 28 13:00:06.843420 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.843240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7" event={"ID":"41c4499e-9507-40c1-bc52-d181086c800d","Type":"ContainerDied","Data":"b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d"}
Jul 28 13:00:06.843420 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.843256    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"
Jul 28 13:00:06.843420 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.843322    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7" event={"ID":"41c4499e-9507-40c1-bc52-d181086c800d","Type":"ContainerDied","Data":"9bc03d7315fd0f8e0c081bd70d8af5ab277c5fc11c37770102dd54becb75ddad"}
Jul 28 13:00:06.843420 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.843359    2578 scope.go:117] "RemoveContainer" containerID="b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d"
Jul 28 13:00:06.851960 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.851940    2578 scope.go:117] "RemoveContainer" containerID="b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d"
Jul 28 13:00:06.852228 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:00:06.852206    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d\": container with ID starting with b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d not found: ID does not exist" containerID="b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d"
Jul 28 13:00:06.852274 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.852237    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d"} err="failed to get container status \"b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d\": rpc error: code = NotFound desc = could not find container \"b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d\": container with ID starting with b05582a86b6a9a88986bc80d8a1a250d644a7347e76902faba42ea922ef11e0d not found: ID does not exist"
Jul 28 13:00:06.890347 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.890326    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"]
Jul 28 13:00:06.911815 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:06.911786    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sphk7"]
Jul 28 13:00:07.272022 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:07.271991    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41c4499e-9507-40c1-bc52-d181086c800d" path="/var/lib/kubelet/pods/41c4499e-9507-40c1-bc52-d181086c800d/volumes"
Jul 28 13:00:25.271396 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.271358    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"]
Jul 28 13:00:25.272001 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.271769    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41c4499e-9507-40c1-bc52-d181086c800d" containerName="manager"
Jul 28 13:00:25.272001 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.271786    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41c4499e-9507-40c1-bc52-d181086c800d" containerName="manager"
Jul 28 13:00:25.272001 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.271908    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="41c4499e-9507-40c1-bc52-d181086c800d" containerName="manager"
Jul 28 13:00:25.276104 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.276083    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:25.279799 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.279776    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 13:00:25.279932 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.279843    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 13:00:25.280873 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.280856    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kwnnr\""
Jul 28 13:00:25.280926 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.280872    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 13:00:25.284114 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.284095    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"]
Jul 28 13:00:25.347424 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.347394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-config-file\") pod \"limitador-limitador-64c94fd64f-4kpvv\" (UID: \"b9f05697-c0e8-4c35-9714-22c2ef28ffc0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:25.347603 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.347503    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fptv6\" (UniqueName: \"kubernetes.io/projected/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-kube-api-access-fptv6\") pod \"limitador-limitador-64c94fd64f-4kpvv\" (UID: \"b9f05697-c0e8-4c35-9714-22c2ef28ffc0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:25.374096 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.374062    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"]
Jul 28 13:00:25.447955 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.447914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fptv6\" (UniqueName: \"kubernetes.io/projected/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-kube-api-access-fptv6\") pod \"limitador-limitador-64c94fd64f-4kpvv\" (UID: \"b9f05697-c0e8-4c35-9714-22c2ef28ffc0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:25.448132 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.447985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-config-file\") pod \"limitador-limitador-64c94fd64f-4kpvv\" (UID: \"b9f05697-c0e8-4c35-9714-22c2ef28ffc0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:25.448645 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.448623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-config-file\") pod \"limitador-limitador-64c94fd64f-4kpvv\" (UID: \"b9f05697-c0e8-4c35-9714-22c2ef28ffc0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:25.456556 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.456532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fptv6\" (UniqueName: \"kubernetes.io/projected/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-kube-api-access-fptv6\") pod \"limitador-limitador-64c94fd64f-4kpvv\" (UID: \"b9f05697-c0e8-4c35-9714-22c2ef28ffc0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:25.587334 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.587240    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:25.731651 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.731573    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"]
Jul 28 13:00:25.733928 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:00:25.733902    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f05697_c0e8_4c35_9714_22c2ef28ffc0.slice/crio-e8735d8a2be1c2f3ab398009b72430a6e03fb421fa2c0fda1672735dd4192dc0 WatchSource:0}: Error finding container e8735d8a2be1c2f3ab398009b72430a6e03fb421fa2c0fda1672735dd4192dc0: Status 404 returned error can't find the container with id e8735d8a2be1c2f3ab398009b72430a6e03fb421fa2c0fda1672735dd4192dc0
Jul 28 13:00:25.929889 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:25.929776    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv" event={"ID":"b9f05697-c0e8-4c35-9714-22c2ef28ffc0","Type":"ContainerStarted","Data":"e8735d8a2be1c2f3ab398009b72430a6e03fb421fa2c0fda1672735dd4192dc0"}
Jul 28 13:00:28.947061 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:28.947030    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv" event={"ID":"b9f05697-c0e8-4c35-9714-22c2ef28ffc0","Type":"ContainerStarted","Data":"5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e"}
Jul 28 13:00:28.947473 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:28.947144    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:28.967386 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:28.967336    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv" podStartSLOduration=0.836789594 podStartE2EDuration="3.967321107s" totalImagesPullingTime="3.130531513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:00:28.966568188 +0000 UTC m=+564.127336146" watchObservedRunningTime="2026-07-28 13:00:28.967321107 +0000 UTC m=+564.128089041"
Jul 28 13:00:39.953156 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:39.953125    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:40.840751 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:40.840717    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"]
Jul 28 13:00:40.840972 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:40.840934    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv" podUID="b9f05697-c0e8-4c35-9714-22c2ef28ffc0" containerName="limitador" containerID="cri-o://5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e" gracePeriod=30
Jul 28 13:00:41.394654 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:41.394631    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:41.486608 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:41.486515    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fptv6\" (UniqueName: \"kubernetes.io/projected/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-kube-api-access-fptv6\") pod \"b9f05697-c0e8-4c35-9714-22c2ef28ffc0\" (UID: \"b9f05697-c0e8-4c35-9714-22c2ef28ffc0\") "
Jul 28 13:00:41.486608 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:41.486581    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-config-file\") pod \"b9f05697-c0e8-4c35-9714-22c2ef28ffc0\" (UID: \"b9f05697-c0e8-4c35-9714-22c2ef28ffc0\") "
Jul 28 13:00:41.486969 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:41.486940    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-config-file" (OuterVolumeSpecName: "config-file") pod "b9f05697-c0e8-4c35-9714-22c2ef28ffc0" (UID: "b9f05697-c0e8-4c35-9714-22c2ef28ffc0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:00:41.488782 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:41.488760    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-kube-api-access-fptv6" (OuterVolumeSpecName: "kube-api-access-fptv6") pod "b9f05697-c0e8-4c35-9714-22c2ef28ffc0" (UID: "b9f05697-c0e8-4c35-9714-22c2ef28ffc0"). InnerVolumeSpecName "kube-api-access-fptv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:00:41.587632 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:41.587591    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-config-file\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:00:41.587632 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:41.587623    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fptv6\" (UniqueName: \"kubernetes.io/projected/b9f05697-c0e8-4c35-9714-22c2ef28ffc0-kube-api-access-fptv6\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:00:42.004042 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:42.004009    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9f05697-c0e8-4c35-9714-22c2ef28ffc0" containerID="5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e" exitCode=0
Jul 28 13:00:42.004209 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:42.004050    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"
Jul 28 13:00:42.004209 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:42.004090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv" event={"ID":"b9f05697-c0e8-4c35-9714-22c2ef28ffc0","Type":"ContainerDied","Data":"5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e"}
Jul 28 13:00:42.004209 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:42.004143    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4kpvv" event={"ID":"b9f05697-c0e8-4c35-9714-22c2ef28ffc0","Type":"ContainerDied","Data":"e8735d8a2be1c2f3ab398009b72430a6e03fb421fa2c0fda1672735dd4192dc0"}
Jul 28 13:00:42.004209 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:42.004165    2578 scope.go:117] "RemoveContainer" containerID="5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e"
Jul 28 13:00:42.012969 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:42.012953    2578 scope.go:117] "RemoveContainer" containerID="5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e"
Jul 28 13:00:42.013210 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:00:42.013188    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e\": container with ID starting with 5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e not found: ID does not exist" containerID="5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e"
Jul 28 13:00:42.013262 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:42.013219    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e"} err="failed to get container status \"5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e\": rpc error: code = NotFound desc = could not find container \"5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e\": container with ID starting with 5be0f90145700e2ce5184a322d8bf58d7282ecd86eb7ba0825bedac585c2320e not found: ID does not exist"
Jul 28 13:00:42.031177 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:42.031147    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"]
Jul 28 13:00:42.032500 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:42.032478    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4kpvv"]
Jul 28 13:00:43.271158 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:43.271127    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f05697-c0e8-4c35-9714-22c2ef28ffc0" path="/var/lib/kubelet/pods/b9f05697-c0e8-4c35-9714-22c2ef28ffc0/volumes"
Jul 28 13:00:47.135896 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.135863    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"]
Jul 28 13:00:47.136363 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.136185    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f05697-c0e8-4c35-9714-22c2ef28ffc0" containerName="limitador"
Jul 28 13:00:47.136363 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.136198    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f05697-c0e8-4c35-9714-22c2ef28ffc0" containerName="limitador"
Jul 28 13:00:47.136363 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.136261    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f05697-c0e8-4c35-9714-22c2ef28ffc0" containerName="limitador"
Jul 28 13:00:47.140578 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.140555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"
Jul 28 13:00:47.143582 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.143561    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 13:00:47.143983 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.143947    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 28 13:00:47.143983 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.143976    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 13:00:47.144151 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.144072    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9hw8b\""
Jul 28 13:00:47.152866 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.152841    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"]
Jul 28 13:00:47.235537 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.235505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xrvf\" (UniqueName: \"kubernetes.io/projected/58007ecf-900f-4475-ba1a-33c0fb17cb34-kube-api-access-2xrvf\") pod \"postgres-69fb4594cf-fh99n\" (UID: \"58007ecf-900f-4475-ba1a-33c0fb17cb34\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"
Jul 28 13:00:47.235705 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.235545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/58007ecf-900f-4475-ba1a-33c0fb17cb34-data\") pod \"postgres-69fb4594cf-fh99n\" (UID: \"58007ecf-900f-4475-ba1a-33c0fb17cb34\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"
Jul 28 13:00:47.336620 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.336586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xrvf\" (UniqueName: \"kubernetes.io/projected/58007ecf-900f-4475-ba1a-33c0fb17cb34-kube-api-access-2xrvf\") pod \"postgres-69fb4594cf-fh99n\" (UID: \"58007ecf-900f-4475-ba1a-33c0fb17cb34\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"
Jul 28 13:00:47.336620 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.336633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/58007ecf-900f-4475-ba1a-33c0fb17cb34-data\") pod \"postgres-69fb4594cf-fh99n\" (UID: \"58007ecf-900f-4475-ba1a-33c0fb17cb34\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"
Jul 28 13:00:47.337086 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.337067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/58007ecf-900f-4475-ba1a-33c0fb17cb34-data\") pod \"postgres-69fb4594cf-fh99n\" (UID: \"58007ecf-900f-4475-ba1a-33c0fb17cb34\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"
Jul 28 13:00:47.345869 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.345846    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xrvf\" (UniqueName: \"kubernetes.io/projected/58007ecf-900f-4475-ba1a-33c0fb17cb34-kube-api-access-2xrvf\") pod \"postgres-69fb4594cf-fh99n\" (UID: \"58007ecf-900f-4475-ba1a-33c0fb17cb34\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"
Jul 28 13:00:47.451589 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.451504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"
Jul 28 13:00:47.589926 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:47.589832    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"]
Jul 28 13:00:47.592232 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:00:47.592202    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58007ecf_900f_4475_ba1a_33c0fb17cb34.slice/crio-7044f1257c1afe217038ae319dcf156c015c2a00295f61fce1a59df097240253 WatchSource:0}: Error finding container 7044f1257c1afe217038ae319dcf156c015c2a00295f61fce1a59df097240253: Status 404 returned error can't find the container with id 7044f1257c1afe217038ae319dcf156c015c2a00295f61fce1a59df097240253
Jul 28 13:00:48.030584 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:48.030548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n" event={"ID":"58007ecf-900f-4475-ba1a-33c0fb17cb34","Type":"ContainerStarted","Data":"7044f1257c1afe217038ae319dcf156c015c2a00295f61fce1a59df097240253"}
Jul 28 13:00:53.058909 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:53.058870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n" event={"ID":"58007ecf-900f-4475-ba1a-33c0fb17cb34","Type":"ContainerStarted","Data":"48a41f194bf8a0236e9c0081640f13cbf19225b2b777c26b82177a88c5521a78"}
Jul 28 13:00:53.059433 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:53.059046    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"
Jul 28 13:00:53.077827 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:53.077767    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n" podStartSLOduration=1.049807397 podStartE2EDuration="6.077750363s" totalImagesPullingTime="5.027942966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:00:53.076605137 +0000 UTC m=+588.237373073" watchObservedRunningTime="2026-07-28 13:00:53.077750363 +0000 UTC m=+588.238518324"
Jul 28 13:00:59.094024 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:00:59.093987    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fh99n"
Jul 28 13:01:05.198562 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:05.198528    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:01:05.201570 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:05.201538    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:01:05.206527 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:05.206504    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:01:05.209433 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:05.209414    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:01:10.294989 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.294954    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f5c7b4cb8-9jgdd"]
Jul 28 13:01:10.303912 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.303890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:10.306510 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.306481    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 13:01:10.306662 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.306635    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 13:01:10.306832 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.306747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-99hmh\""
Jul 28 13:01:10.307442 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.307424    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f5c7b4cb8-9jgdd"]
Jul 28 13:01:10.437110 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.437075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7fk6\" (UniqueName: \"kubernetes.io/projected/dc68089d-97c2-4809-bfec-65626e77cd73-kube-api-access-w7fk6\") pod \"maas-controller-f5c7b4cb8-9jgdd\" (UID: \"dc68089d-97c2-4809-bfec-65626e77cd73\") " pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:10.437297 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.437121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc68089d-97c2-4809-bfec-65626e77cd73-webhook-cert\") pod \"maas-controller-f5c7b4cb8-9jgdd\" (UID: \"dc68089d-97c2-4809-bfec-65626e77cd73\") " pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:10.483565 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.483535    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bb96bdcb-jznzg"]
Jul 28 13:01:10.487242 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.487227    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:01:10.499006 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.498979    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-jznzg"]
Jul 28 13:01:10.537925 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.537890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7fk6\" (UniqueName: \"kubernetes.io/projected/dc68089d-97c2-4809-bfec-65626e77cd73-kube-api-access-w7fk6\") pod \"maas-controller-f5c7b4cb8-9jgdd\" (UID: \"dc68089d-97c2-4809-bfec-65626e77cd73\") " pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:10.538092 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.537939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc68089d-97c2-4809-bfec-65626e77cd73-webhook-cert\") pod \"maas-controller-f5c7b4cb8-9jgdd\" (UID: \"dc68089d-97c2-4809-bfec-65626e77cd73\") " pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:10.540462 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.540433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc68089d-97c2-4809-bfec-65626e77cd73-webhook-cert\") pod \"maas-controller-f5c7b4cb8-9jgdd\" (UID: \"dc68089d-97c2-4809-bfec-65626e77cd73\") " pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:10.546355 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.546293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7fk6\" (UniqueName: \"kubernetes.io/projected/dc68089d-97c2-4809-bfec-65626e77cd73-kube-api-access-w7fk6\") pod \"maas-controller-f5c7b4cb8-9jgdd\" (UID: \"dc68089d-97c2-4809-bfec-65626e77cd73\") " pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:10.616417 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.616384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:10.638919 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.638891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f3daae1-1b29-496b-ae2a-8285edf77b24-webhook-cert\") pod \"maas-controller-bb96bdcb-jznzg\" (UID: \"2f3daae1-1b29-496b-ae2a-8285edf77b24\") " pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:01:10.639050 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.638941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p69w\" (UniqueName: \"kubernetes.io/projected/2f3daae1-1b29-496b-ae2a-8285edf77b24-kube-api-access-6p69w\") pod \"maas-controller-bb96bdcb-jznzg\" (UID: \"2f3daae1-1b29-496b-ae2a-8285edf77b24\") " pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:01:10.739994 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.739962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f3daae1-1b29-496b-ae2a-8285edf77b24-webhook-cert\") pod \"maas-controller-bb96bdcb-jznzg\" (UID: \"2f3daae1-1b29-496b-ae2a-8285edf77b24\") " pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:01:10.740146 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.740005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p69w\" (UniqueName: \"kubernetes.io/projected/2f3daae1-1b29-496b-ae2a-8285edf77b24-kube-api-access-6p69w\") pod \"maas-controller-bb96bdcb-jznzg\" (UID: \"2f3daae1-1b29-496b-ae2a-8285edf77b24\") " pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:01:10.742427 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.742400    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f3daae1-1b29-496b-ae2a-8285edf77b24-webhook-cert\") pod \"maas-controller-bb96bdcb-jznzg\" (UID: \"2f3daae1-1b29-496b-ae2a-8285edf77b24\") " pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:01:10.748281 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.748250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p69w\" (UniqueName: \"kubernetes.io/projected/2f3daae1-1b29-496b-ae2a-8285edf77b24-kube-api-access-6p69w\") pod \"maas-controller-bb96bdcb-jznzg\" (UID: \"2f3daae1-1b29-496b-ae2a-8285edf77b24\") " pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:01:10.796733 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.796645    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:01:10.930252 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.930229    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-jznzg"]
Jul 28 13:01:10.933276 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:01:10.933253    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3daae1_1b29_496b_ae2a_8285edf77b24.slice/crio-aba6f355f926cd26e09dab308bf78703dd34826660e1ee7d9e12d7fd2b42f636 WatchSource:0}: Error finding container aba6f355f926cd26e09dab308bf78703dd34826660e1ee7d9e12d7fd2b42f636: Status 404 returned error can't find the container with id aba6f355f926cd26e09dab308bf78703dd34826660e1ee7d9e12d7fd2b42f636
Jul 28 13:01:10.957398 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:10.957376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f5c7b4cb8-9jgdd"]
Jul 28 13:01:10.959299 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:01:10.959269    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc68089d_97c2_4809_bfec_65626e77cd73.slice/crio-8b23b9ce2be25c67e68512de8068e010ff171016d669c6136e8cd46af8e84d12 WatchSource:0}: Error finding container 8b23b9ce2be25c67e68512de8068e010ff171016d669c6136e8cd46af8e84d12: Status 404 returned error can't find the container with id 8b23b9ce2be25c67e68512de8068e010ff171016d669c6136e8cd46af8e84d12
Jul 28 13:01:11.140774 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:11.140674    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96bdcb-jznzg" event={"ID":"2f3daae1-1b29-496b-ae2a-8285edf77b24","Type":"ContainerStarted","Data":"aba6f355f926cd26e09dab308bf78703dd34826660e1ee7d9e12d7fd2b42f636"}
Jul 28 13:01:11.141883 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:11.141863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd" event={"ID":"dc68089d-97c2-4809-bfec-65626e77cd73","Type":"ContainerStarted","Data":"8b23b9ce2be25c67e68512de8068e010ff171016d669c6136e8cd46af8e84d12"}
Jul 28 13:01:14.160945 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:14.160906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96bdcb-jznzg" event={"ID":"2f3daae1-1b29-496b-ae2a-8285edf77b24","Type":"ContainerStarted","Data":"f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82"}
Jul 28 13:01:14.161400 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:14.161038    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:01:14.162462 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:14.162436    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd" event={"ID":"dc68089d-97c2-4809-bfec-65626e77cd73","Type":"ContainerStarted","Data":"19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3"}
Jul 28 13:01:14.162577 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:14.162559    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:14.181965 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:14.181922    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bb96bdcb-jznzg" podStartSLOduration=1.5519165560000001 podStartE2EDuration="4.181908886s" totalImagesPullingTime="2.62999233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:01:14.180119453 +0000 UTC m=+609.340887404" watchObservedRunningTime="2026-07-28 13:01:14.181908886 +0000 UTC m=+609.342676820"
Jul 28 13:01:14.201816 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:14.201760    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd" podStartSLOduration=1.608153026 podStartE2EDuration="4.201745854s" totalImagesPullingTime="2.593592828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:01:14.200226672 +0000 UTC m=+609.360994631" watchObservedRunningTime="2026-07-28 13:01:14.201745854 +0000 UTC m=+609.362513788"
Jul 28 13:01:25.170306 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:25.170267    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:01:25.170704 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:25.170445    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:25.235499 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:25.235458    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f5c7b4cb8-9jgdd"]
Jul 28 13:01:25.235681 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:25.235646    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd" podUID="dc68089d-97c2-4809-bfec-65626e77cd73" containerName="manager" containerID="cri-o://19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3" gracePeriod=30
Jul 28 13:01:25.490691 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:25.490663    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:25.568827 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:25.568765    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc68089d-97c2-4809-bfec-65626e77cd73-webhook-cert\") pod \"dc68089d-97c2-4809-bfec-65626e77cd73\" (UID: \"dc68089d-97c2-4809-bfec-65626e77cd73\") "
Jul 28 13:01:25.569007 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:25.568910    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7fk6\" (UniqueName: \"kubernetes.io/projected/dc68089d-97c2-4809-bfec-65626e77cd73-kube-api-access-w7fk6\") pod \"dc68089d-97c2-4809-bfec-65626e77cd73\" (UID: \"dc68089d-97c2-4809-bfec-65626e77cd73\") "
Jul 28 13:01:25.571273 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:25.571244    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc68089d-97c2-4809-bfec-65626e77cd73-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dc68089d-97c2-4809-bfec-65626e77cd73" (UID: "dc68089d-97c2-4809-bfec-65626e77cd73"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:01:25.571273 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:25.571247    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc68089d-97c2-4809-bfec-65626e77cd73-kube-api-access-w7fk6" (OuterVolumeSpecName: "kube-api-access-w7fk6") pod "dc68089d-97c2-4809-bfec-65626e77cd73" (UID: "dc68089d-97c2-4809-bfec-65626e77cd73"). InnerVolumeSpecName "kube-api-access-w7fk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:01:25.669941 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:25.669900    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7fk6\" (UniqueName: \"kubernetes.io/projected/dc68089d-97c2-4809-bfec-65626e77cd73-kube-api-access-w7fk6\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:01:25.669941 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:25.669934    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc68089d-97c2-4809-bfec-65626e77cd73-webhook-cert\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:01:26.217166 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:26.217084    2578 generic.go:356] "Generic (PLEG): container finished" podID="dc68089d-97c2-4809-bfec-65626e77cd73" containerID="19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3" exitCode=0
Jul 28 13:01:26.217166 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:26.217126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd" event={"ID":"dc68089d-97c2-4809-bfec-65626e77cd73","Type":"ContainerDied","Data":"19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3"}
Jul 28 13:01:26.217166 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:26.217150    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd"
Jul 28 13:01:26.217681 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:26.217200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5c7b4cb8-9jgdd" event={"ID":"dc68089d-97c2-4809-bfec-65626e77cd73","Type":"ContainerDied","Data":"8b23b9ce2be25c67e68512de8068e010ff171016d669c6136e8cd46af8e84d12"}
Jul 28 13:01:26.217681 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:26.217237    2578 scope.go:117] "RemoveContainer" containerID="19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3"
Jul 28 13:01:26.226463 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:26.226441    2578 scope.go:117] "RemoveContainer" containerID="19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3"
Jul 28 13:01:26.226727 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:01:26.226710    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3\": container with ID starting with 19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3 not found: ID does not exist" containerID="19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3"
Jul 28 13:01:26.226782 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:26.226736    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3"} err="failed to get container status \"19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3\": rpc error: code = NotFound desc = could not find container \"19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3\": container with ID starting with 19a605b90ddf38c02c4fe66f87c8cf31ea9dcb9a2d98efea2c8877be048510f3 not found: ID does not exist"
Jul 28 13:01:26.240135 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:26.240105    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f5c7b4cb8-9jgdd"]
Jul 28 13:01:26.245128 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:26.245103    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f5c7b4cb8-9jgdd"]
Jul 28 13:01:27.271374 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:27.271334    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc68089d-97c2-4809-bfec-65626e77cd73" path="/var/lib/kubelet/pods/dc68089d-97c2-4809-bfec-65626e77cd73/volumes"
Jul 28 13:01:46.094321 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.094283    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"]
Jul 28 13:01:46.094739 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.094622    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc68089d-97c2-4809-bfec-65626e77cd73" containerName="manager"
Jul 28 13:01:46.094739 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.094633    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc68089d-97c2-4809-bfec-65626e77cd73" containerName="manager"
Jul 28 13:01:46.094739 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.094703    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc68089d-97c2-4809-bfec-65626e77cd73" containerName="manager"
Jul 28 13:01:46.098075 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.098055    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:46.100895 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.100871    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 28 13:01:46.109489 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.109468    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"]
Jul 28 13:01:46.146711 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.146679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9f5eba1-f3a5-4888-be95-37121dd02dcf-maas-api-tls\") pod \"maas-api-654d46db6b-hj2ks\" (UID: \"a9f5eba1-f3a5-4888-be95-37121dd02dcf\") " pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:46.146891 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.146732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f6zf\" (UniqueName: \"kubernetes.io/projected/a9f5eba1-f3a5-4888-be95-37121dd02dcf-kube-api-access-9f6zf\") pod \"maas-api-654d46db6b-hj2ks\" (UID: \"a9f5eba1-f3a5-4888-be95-37121dd02dcf\") " pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:46.146891 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.146798    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f5eba1-f3a5-4888-be95-37121dd02dcf-openshift-service-ca\") pod \"maas-api-654d46db6b-hj2ks\" (UID: \"a9f5eba1-f3a5-4888-be95-37121dd02dcf\") " pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:46.248066 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.248031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f5eba1-f3a5-4888-be95-37121dd02dcf-openshift-service-ca\") pod \"maas-api-654d46db6b-hj2ks\" (UID: \"a9f5eba1-f3a5-4888-be95-37121dd02dcf\") " pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:46.248227 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.248095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9f5eba1-f3a5-4888-be95-37121dd02dcf-maas-api-tls\") pod \"maas-api-654d46db6b-hj2ks\" (UID: \"a9f5eba1-f3a5-4888-be95-37121dd02dcf\") " pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:46.248227 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.248137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f6zf\" (UniqueName: \"kubernetes.io/projected/a9f5eba1-f3a5-4888-be95-37121dd02dcf-kube-api-access-9f6zf\") pod \"maas-api-654d46db6b-hj2ks\" (UID: \"a9f5eba1-f3a5-4888-be95-37121dd02dcf\") " pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:46.248677 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.248656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f5eba1-f3a5-4888-be95-37121dd02dcf-openshift-service-ca\") pod \"maas-api-654d46db6b-hj2ks\" (UID: \"a9f5eba1-f3a5-4888-be95-37121dd02dcf\") " pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:46.250729 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.250711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9f5eba1-f3a5-4888-be95-37121dd02dcf-maas-api-tls\") pod \"maas-api-654d46db6b-hj2ks\" (UID: \"a9f5eba1-f3a5-4888-be95-37121dd02dcf\") " pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:46.258335 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.258305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f6zf\" (UniqueName: \"kubernetes.io/projected/a9f5eba1-f3a5-4888-be95-37121dd02dcf-kube-api-access-9f6zf\") pod \"maas-api-654d46db6b-hj2ks\" (UID: \"a9f5eba1-f3a5-4888-be95-37121dd02dcf\") " pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:46.409915 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.409791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:46.559127 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.559091    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"]
Jul 28 13:01:46.563243 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:01:46.563209    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f5eba1_f3a5_4888_be95_37121dd02dcf.slice/crio-716a172c6b9e7094720b3cedb08199efcb02f1613930a1892897543b22b9fc48 WatchSource:0}: Error finding container 716a172c6b9e7094720b3cedb08199efcb02f1613930a1892897543b22b9fc48: Status 404 returned error can't find the container with id 716a172c6b9e7094720b3cedb08199efcb02f1613930a1892897543b22b9fc48
Jul 28 13:01:46.564438 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.564418    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:01:46.705007 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.704931    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-f4qlw"]
Jul 28 13:01:46.709908 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.709892    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw"
Jul 28 13:01:46.714251 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.714227    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 13:01:46.714377 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.714288    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9jmhs\""
Jul 28 13:01:46.722787 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.722761    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-f4qlw"]
Jul 28 13:01:46.853620 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.853586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q4sz\" (UniqueName: \"kubernetes.io/projected/62fe0f32-e037-45b9-a596-4e7c7e4987b9-kube-api-access-5q4sz\") pod \"payload-processing-5cc6cd444b-f4qlw\" (UID: \"62fe0f32-e037-45b9-a596-4e7c7e4987b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw"
Jul 28 13:01:46.853758 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.853676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62fe0f32-e037-45b9-a596-4e7c7e4987b9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-f4qlw\" (UID: \"62fe0f32-e037-45b9-a596-4e7c7e4987b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw"
Jul 28 13:01:46.954170 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.954129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62fe0f32-e037-45b9-a596-4e7c7e4987b9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-f4qlw\" (UID: \"62fe0f32-e037-45b9-a596-4e7c7e4987b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw"
Jul 28 13:01:46.954170 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.954176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q4sz\" (UniqueName: \"kubernetes.io/projected/62fe0f32-e037-45b9-a596-4e7c7e4987b9-kube-api-access-5q4sz\") pod \"payload-processing-5cc6cd444b-f4qlw\" (UID: \"62fe0f32-e037-45b9-a596-4e7c7e4987b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw"
Jul 28 13:01:46.955083 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.954995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62fe0f32-e037-45b9-a596-4e7c7e4987b9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-f4qlw\" (UID: \"62fe0f32-e037-45b9-a596-4e7c7e4987b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw"
Jul 28 13:01:46.963056 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:46.963032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q4sz\" (UniqueName: \"kubernetes.io/projected/62fe0f32-e037-45b9-a596-4e7c7e4987b9-kube-api-access-5q4sz\") pod \"payload-processing-5cc6cd444b-f4qlw\" (UID: \"62fe0f32-e037-45b9-a596-4e7c7e4987b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw"
Jul 28 13:01:47.020499 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:47.020462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw"
Jul 28 13:01:47.159296 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:47.159261    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-f4qlw"]
Jul 28 13:01:47.163340 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:01:47.163312    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62fe0f32_e037_45b9_a596_4e7c7e4987b9.slice/crio-7e8c049474fe02635af36b133dee4339c6eb4f63b9df2421c59537f1a9fe3b64 WatchSource:0}: Error finding container 7e8c049474fe02635af36b133dee4339c6eb4f63b9df2421c59537f1a9fe3b64: Status 404 returned error can't find the container with id 7e8c049474fe02635af36b133dee4339c6eb4f63b9df2421c59537f1a9fe3b64
Jul 28 13:01:47.309618 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:47.309571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw" event={"ID":"62fe0f32-e037-45b9-a596-4e7c7e4987b9","Type":"ContainerStarted","Data":"7e8c049474fe02635af36b133dee4339c6eb4f63b9df2421c59537f1a9fe3b64"}
Jul 28 13:01:47.310940 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:47.310909    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks" event={"ID":"a9f5eba1-f3a5-4888-be95-37121dd02dcf","Type":"ContainerStarted","Data":"716a172c6b9e7094720b3cedb08199efcb02f1613930a1892897543b22b9fc48"}
Jul 28 13:01:48.318789 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:48.318695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks" event={"ID":"a9f5eba1-f3a5-4888-be95-37121dd02dcf","Type":"ContainerStarted","Data":"6bfddae2cbb7c9b3a5c5b45d6ab490e597ded7700403cbbcf7bb595ec768879d"}
Jul 28 13:01:48.319484 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:48.319460    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:01:48.339163 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:48.339099    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks" podStartSLOduration=0.85655911 podStartE2EDuration="2.339076949s" totalImagesPullingTime="1.482517839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:01:48.337306343 +0000 UTC m=+643.498074279" watchObservedRunningTime="2026-07-28 13:01:48.339076949 +0000 UTC m=+643.499844885"
Jul 28 13:01:49.325785 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:49.325740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw" event={"ID":"62fe0f32-e037-45b9-a596-4e7c7e4987b9","Type":"ContainerStarted","Data":"ec1390dc2fb8eab6ecf6624ead2d63cd1419d5024e801324ddc85ca2abcaba1d"}
Jul 28 13:01:49.326188 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:49.325971    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw"
Jul 28 13:01:49.344586 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:49.344514    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw" podStartSLOduration=1.396373163 podStartE2EDuration="3.344491227s" totalImagesPullingTime="1.948118064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:01:49.343928573 +0000 UTC m=+644.504696526" watchObservedRunningTime="2026-07-28 13:01:49.344491227 +0000 UTC m=+644.505259162"
Jul 28 13:01:55.336917 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:01:55.336881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-654d46db6b-hj2ks"
Jul 28 13:02:00.333025 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:00.332992    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-f4qlw"
Jul 28 13:02:14.790002 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.789967    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"]
Jul 28 13:02:14.794536 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.794520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.797521 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.797501    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 28 13:02:14.797640 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.797532    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 13:02:14.798421 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.798400    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-llgkj\""
Jul 28 13:02:14.798515 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.798440    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 13:02:14.803642 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.803618    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"]
Jul 28 13:02:14.888642 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.888607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.888642 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.888642    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.888901 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.888669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.888901 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.888719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f46jz\" (UniqueName: \"kubernetes.io/projected/e4d368ad-8854-408f-b71d-a002524139cc-kube-api-access-f46jz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.888901 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.888771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.888901 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.888817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4d368ad-8854-408f-b71d-a002524139cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.989852 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.989814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.989852 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.989857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.990081 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.989883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.990081 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.989901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f46jz\" (UniqueName: \"kubernetes.io/projected/e4d368ad-8854-408f-b71d-a002524139cc-kube-api-access-f46jz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.990081 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.989930    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.990081 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.989954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4d368ad-8854-408f-b71d-a002524139cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.990341 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.990318    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.990408 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.990325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.990408 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.990387    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.992400 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.992381    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4d368ad-8854-408f-b71d-a002524139cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:14.992671 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:14.992652    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4d368ad-8854-408f-b71d-a002524139cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:15.000940 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:15.000913    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f46jz\" (UniqueName: \"kubernetes.io/projected/e4d368ad-8854-408f-b71d-a002524139cc-kube-api-access-f46jz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg\" (UID: \"e4d368ad-8854-408f-b71d-a002524139cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:15.106005 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:15.105917    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:15.249469 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:15.249443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"]
Jul 28 13:02:15.251515 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:02:15.251483    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d368ad_8854_408f_b71d_a002524139cc.slice/crio-19a956cef69769759dd10da6d3b3ba80d054b038cd2c984bb2b623b588e5deae WatchSource:0}: Error finding container 19a956cef69769759dd10da6d3b3ba80d054b038cd2c984bb2b623b588e5deae: Status 404 returned error can't find the container with id 19a956cef69769759dd10da6d3b3ba80d054b038cd2c984bb2b623b588e5deae
Jul 28 13:02:15.446291 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:15.446206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg" event={"ID":"e4d368ad-8854-408f-b71d-a002524139cc","Type":"ContainerStarted","Data":"19a956cef69769759dd10da6d3b3ba80d054b038cd2c984bb2b623b588e5deae"}
Jul 28 13:02:17.456840 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:17.456784    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg" event={"ID":"e4d368ad-8854-408f-b71d-a002524139cc","Type":"ContainerStarted","Data":"9baec8a754b384adfd52aa5bc87dc5681489e57892ed1f59024f6ceb46ed54bf"}
Jul 28 13:02:17.475244 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:17.475194    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg" podStartSLOduration=2.28036685 podStartE2EDuration="3.475177717s" totalImagesPullingTime="1.194810867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:02:17.473427871 +0000 UTC m=+672.634195805" watchObservedRunningTime="2026-07-28 13:02:17.475177717 +0000 UTC m=+672.635945651"
Jul 28 13:02:25.106612 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:25.106574    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:25.107162 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:25.106646    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:25.119218 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:25.119191    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:25.506615 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:25.506537    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg"
Jul 28 13:02:44.706108 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.706074    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"]
Jul 28 13:02:44.709569 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.709549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.712585 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.712566    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 28 13:02:44.721204 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.721179    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"]
Jul 28 13:02:44.859871 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.859841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.860049 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.859883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.860049 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.859934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.860049 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.860004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4wll\" (UniqueName: \"kubernetes.io/projected/8fda14f4-69b2-43f0-8c90-3df68e355bc7-kube-api-access-t4wll\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.860184 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.860049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fda14f4-69b2-43f0-8c90-3df68e355bc7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.860184 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.860078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.960947 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.960850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.961120 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.960935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.961120 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.961042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.961120 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.961091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4wll\" (UniqueName: \"kubernetes.io/projected/8fda14f4-69b2-43f0-8c90-3df68e355bc7-kube-api-access-t4wll\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.961280 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.961145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fda14f4-69b2-43f0-8c90-3df68e355bc7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.961280 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.961193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.961380 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.961299    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.961380 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.961311    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.961498 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.961413    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.963683 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.963661    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fda14f4-69b2-43f0-8c90-3df68e355bc7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.963925 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.963901    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fda14f4-69b2-43f0-8c90-3df68e355bc7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:44.971791 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:44.971761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4wll\" (UniqueName: \"kubernetes.io/projected/8fda14f4-69b2-43f0-8c90-3df68e355bc7-kube-api-access-t4wll\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fhhr4\" (UID: \"8fda14f4-69b2-43f0-8c90-3df68e355bc7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:45.020631 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:45.020597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:45.158089 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:45.158062    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"]
Jul 28 13:02:45.159958 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:02:45.159928    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fda14f4_69b2_43f0_8c90_3df68e355bc7.slice/crio-30a7a34192b102a413c65c5548aeca37edbe4d5da1c92364281c5fde465eb1f2 WatchSource:0}: Error finding container 30a7a34192b102a413c65c5548aeca37edbe4d5da1c92364281c5fde465eb1f2: Status 404 returned error can't find the container with id 30a7a34192b102a413c65c5548aeca37edbe4d5da1c92364281c5fde465eb1f2
Jul 28 13:02:45.586157 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:45.586068    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4" event={"ID":"8fda14f4-69b2-43f0-8c90-3df68e355bc7","Type":"ContainerStarted","Data":"5fd52c6a169170406976d9f7cffc2ec1f029191cdbb7710299f32256242dc699"}
Jul 28 13:02:45.586157 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:45.586124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4" event={"ID":"8fda14f4-69b2-43f0-8c90-3df68e355bc7","Type":"ContainerStarted","Data":"30a7a34192b102a413c65c5548aeca37edbe4d5da1c92364281c5fde465eb1f2"}
Jul 28 13:02:45.606259 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:45.606215    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4" podStartSLOduration=1.342418532 podStartE2EDuration="1.606197566s" totalImagesPullingTime="263.779034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:02:45.604409268 +0000 UTC m=+700.765177201" watchObservedRunningTime="2026-07-28 13:02:45.606197566 +0000 UTC m=+700.766965499"
Jul 28 13:02:55.020987 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:55.020951    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:55.021507 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:55.021021    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:55.033595 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:55.033567    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:55.647981 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:55.647952    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fhhr4"
Jul 28 13:02:59.590065 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.590029    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"]
Jul 28 13:02:59.593554 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.593531    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.596364 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.596344    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 28 13:02:59.607960 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.607939    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"]
Jul 28 13:02:59.699082 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.699050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.699243 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.699120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.699243 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.699186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.699243 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.699214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1043c521-a944-438d-a3b1-709f4c8262b1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.699243 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.699234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.699379 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.699261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj8c4\" (UniqueName: \"kubernetes.io/projected/1043c521-a944-438d-a3b1-709f4c8262b1-kube-api-access-cj8c4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.800420 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.800380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.800420 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.800426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.800646 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.800445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1043c521-a944-438d-a3b1-709f4c8262b1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.800646 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.800472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.800646 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.800513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj8c4\" (UniqueName: \"kubernetes.io/projected/1043c521-a944-438d-a3b1-709f4c8262b1-kube-api-access-cj8c4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.800646 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.800544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.800856 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.800836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.800973 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.800954    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.801034 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.801001    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.802884 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.802853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1043c521-a944-438d-a3b1-709f4c8262b1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.803117 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.803101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1043c521-a944-438d-a3b1-709f4c8262b1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.808640 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.808620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj8c4\" (UniqueName: \"kubernetes.io/projected/1043c521-a944-438d-a3b1-709f4c8262b1-kube-api-access-cj8c4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pntgp\" (UID: \"1043c521-a944-438d-a3b1-709f4c8262b1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:02:59.904018 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:02:59.903924    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:03:00.045102 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:03:00.045074    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"]
Jul 28 13:03:00.047002 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:03:00.046975    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1043c521_a944_438d_a3b1_709f4c8262b1.slice/crio-97ccf0850996cdf76a32f8979c7db4cc303eeed12eab5c29472d8a886db9668d WatchSource:0}: Error finding container 97ccf0850996cdf76a32f8979c7db4cc303eeed12eab5c29472d8a886db9668d: Status 404 returned error can't find the container with id 97ccf0850996cdf76a32f8979c7db4cc303eeed12eab5c29472d8a886db9668d
Jul 28 13:03:00.661491 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:03:00.661456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp" event={"ID":"1043c521-a944-438d-a3b1-709f4c8262b1","Type":"ContainerStarted","Data":"8708fab7921e8284bc6a259b3923e32cd5357990803244f3527ab5d64091cde1"}
Jul 28 13:03:00.661891 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:03:00.661509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp" event={"ID":"1043c521-a944-438d-a3b1-709f4c8262b1","Type":"ContainerStarted","Data":"97ccf0850996cdf76a32f8979c7db4cc303eeed12eab5c29472d8a886db9668d"}
Jul 28 13:03:09.904966 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:03:09.904920    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:03:09.905411 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:03:09.905026    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:03:09.917767 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:03:09.917735    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:03:09.936031 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:03:09.935954    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp" podStartSLOduration=10.493280857 podStartE2EDuration="10.935932271s" totalImagesPullingTime="442.651414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:03:00.693356577 +0000 UTC m=+715.854124493" watchObservedRunningTime="2026-07-28 13:03:09.935932271 +0000 UTC m=+725.096700206"
Jul 28 13:03:10.716658 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:03:10.716628    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pntgp"
Jul 28 13:04:40.350434 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:40.350402    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-jznzg"]
Jul 28 13:04:40.351038 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:40.350589    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bb96bdcb-jznzg" podUID="2f3daae1-1b29-496b-ae2a-8285edf77b24" containerName="manager" containerID="cri-o://f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82" gracePeriod=30
Jul 28 13:04:40.609429 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:40.609374    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:04:40.699436 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:40.699403    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p69w\" (UniqueName: \"kubernetes.io/projected/2f3daae1-1b29-496b-ae2a-8285edf77b24-kube-api-access-6p69w\") pod \"2f3daae1-1b29-496b-ae2a-8285edf77b24\" (UID: \"2f3daae1-1b29-496b-ae2a-8285edf77b24\") "
Jul 28 13:04:40.699592 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:40.699451    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f3daae1-1b29-496b-ae2a-8285edf77b24-webhook-cert\") pod \"2f3daae1-1b29-496b-ae2a-8285edf77b24\" (UID: \"2f3daae1-1b29-496b-ae2a-8285edf77b24\") "
Jul 28 13:04:40.701590 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:40.701556    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f3daae1-1b29-496b-ae2a-8285edf77b24-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2f3daae1-1b29-496b-ae2a-8285edf77b24" (UID: "2f3daae1-1b29-496b-ae2a-8285edf77b24"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:04:40.701590 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:40.701557    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3daae1-1b29-496b-ae2a-8285edf77b24-kube-api-access-6p69w" (OuterVolumeSpecName: "kube-api-access-6p69w") pod "2f3daae1-1b29-496b-ae2a-8285edf77b24" (UID: "2f3daae1-1b29-496b-ae2a-8285edf77b24"). InnerVolumeSpecName "kube-api-access-6p69w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:04:40.801062 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:40.801033    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p69w\" (UniqueName: \"kubernetes.io/projected/2f3daae1-1b29-496b-ae2a-8285edf77b24-kube-api-access-6p69w\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:04:40.801062 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:40.801058    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f3daae1-1b29-496b-ae2a-8285edf77b24-webhook-cert\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:04:41.130919 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:41.130886    2578 generic.go:356] "Generic (PLEG): container finished" podID="2f3daae1-1b29-496b-ae2a-8285edf77b24" containerID="f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82" exitCode=0
Jul 28 13:04:41.131095 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:41.130961    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96bdcb-jznzg"
Jul 28 13:04:41.131095 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:41.130982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96bdcb-jznzg" event={"ID":"2f3daae1-1b29-496b-ae2a-8285edf77b24","Type":"ContainerDied","Data":"f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82"}
Jul 28 13:04:41.131095 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:41.131039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96bdcb-jznzg" event={"ID":"2f3daae1-1b29-496b-ae2a-8285edf77b24","Type":"ContainerDied","Data":"aba6f355f926cd26e09dab308bf78703dd34826660e1ee7d9e12d7fd2b42f636"}
Jul 28 13:04:41.131095 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:41.131079    2578 scope.go:117] "RemoveContainer" containerID="f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82"
Jul 28 13:04:41.142488 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:41.142468    2578 scope.go:117] "RemoveContainer" containerID="f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82"
Jul 28 13:04:41.142760 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:04:41.142740    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82\": container with ID starting with f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82 not found: ID does not exist" containerID="f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82"
Jul 28 13:04:41.142842 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:41.142768    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82"} err="failed to get container status \"f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82\": rpc error: code = NotFound desc = could not find container \"f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82\": container with ID starting with f96f07fb6569fafbe869236f1dee662e80230d060a771491a66cffe4e5627e82 not found: ID does not exist"
Jul 28 13:04:41.156007 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:41.155987    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-jznzg"]
Jul 28 13:04:41.160202 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:41.160177    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-jznzg"]
Jul 28 13:04:41.271635 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:04:41.271601    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f3daae1-1b29-496b-ae2a-8285edf77b24" path="/var/lib/kubelet/pods/2f3daae1-1b29-496b-ae2a-8285edf77b24/volumes"
Jul 28 13:05:41.960072 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:41.960032    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bb96bdcb-hwp7j"]
Jul 28 13:05:41.960562 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:41.960415    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3daae1-1b29-496b-ae2a-8285edf77b24" containerName="manager"
Jul 28 13:05:41.960562 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:41.960427    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3daae1-1b29-496b-ae2a-8285edf77b24" containerName="manager"
Jul 28 13:05:41.960562 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:41.960495    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3daae1-1b29-496b-ae2a-8285edf77b24" containerName="manager"
Jul 28 13:05:41.963471 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:41.963455    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:41.967343 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:41.967322    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-99hmh\""
Jul 28 13:05:41.967465 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:41.967323    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 13:05:41.967465 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:41.967323    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 13:05:41.972617 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:41.972591    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-hwp7j"]
Jul 28 13:05:42.045395 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:42.045355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/359b3008-29c1-4af2-9781-e8c3fd74b4a2-webhook-cert\") pod \"maas-controller-bb96bdcb-hwp7j\" (UID: \"359b3008-29c1-4af2-9781-e8c3fd74b4a2\") " pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:42.045574 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:42.045430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8fjl\" (UniqueName: \"kubernetes.io/projected/359b3008-29c1-4af2-9781-e8c3fd74b4a2-kube-api-access-l8fjl\") pod \"maas-controller-bb96bdcb-hwp7j\" (UID: \"359b3008-29c1-4af2-9781-e8c3fd74b4a2\") " pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:42.146733 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:42.146698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/359b3008-29c1-4af2-9781-e8c3fd74b4a2-webhook-cert\") pod \"maas-controller-bb96bdcb-hwp7j\" (UID: \"359b3008-29c1-4af2-9781-e8c3fd74b4a2\") " pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:42.146948 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:42.146757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8fjl\" (UniqueName: \"kubernetes.io/projected/359b3008-29c1-4af2-9781-e8c3fd74b4a2-kube-api-access-l8fjl\") pod \"maas-controller-bb96bdcb-hwp7j\" (UID: \"359b3008-29c1-4af2-9781-e8c3fd74b4a2\") " pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:42.149572 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:42.149535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/359b3008-29c1-4af2-9781-e8c3fd74b4a2-webhook-cert\") pod \"maas-controller-bb96bdcb-hwp7j\" (UID: \"359b3008-29c1-4af2-9781-e8c3fd74b4a2\") " pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:42.155583 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:42.155556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8fjl\" (UniqueName: \"kubernetes.io/projected/359b3008-29c1-4af2-9781-e8c3fd74b4a2-kube-api-access-l8fjl\") pod \"maas-controller-bb96bdcb-hwp7j\" (UID: \"359b3008-29c1-4af2-9781-e8c3fd74b4a2\") " pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:42.274882 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:42.274856    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:42.411068 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:42.411044    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-hwp7j"]
Jul 28 13:05:42.413222 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:05:42.413196    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359b3008_29c1_4af2_9781_e8c3fd74b4a2.slice/crio-476e047be15ac96bae11ae79875a88908c6fb6b8349c8b3a7cb92d43803dfffe WatchSource:0}: Error finding container 476e047be15ac96bae11ae79875a88908c6fb6b8349c8b3a7cb92d43803dfffe: Status 404 returned error can't find the container with id 476e047be15ac96bae11ae79875a88908c6fb6b8349c8b3a7cb92d43803dfffe
Jul 28 13:05:43.419176 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:43.419142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96bdcb-hwp7j" event={"ID":"359b3008-29c1-4af2-9781-e8c3fd74b4a2","Type":"ContainerStarted","Data":"0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe"}
Jul 28 13:05:43.419546 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:43.419198    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96bdcb-hwp7j" event={"ID":"359b3008-29c1-4af2-9781-e8c3fd74b4a2","Type":"ContainerStarted","Data":"476e047be15ac96bae11ae79875a88908c6fb6b8349c8b3a7cb92d43803dfffe"}
Jul 28 13:05:43.419546 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:43.419228    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:43.437727 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:43.437676    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bb96bdcb-hwp7j" podStartSLOduration=1.963326036 podStartE2EDuration="2.437659202s" totalImagesPullingTime="474.333166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:05:43.437607842 +0000 UTC m=+878.598375777" watchObservedRunningTime="2026-07-28 13:05:43.437659202 +0000 UTC m=+878.598427138"
Jul 28 13:05:54.426548 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:54.426512    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:59.122643 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.122567    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-hwp7j"]
Jul 28 13:05:59.123041 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.122756    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bb96bdcb-hwp7j" podUID="359b3008-29c1-4af2-9781-e8c3fd74b4a2" containerName="manager" containerID="cri-o://0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe" gracePeriod=30
Jul 28 13:05:59.385239 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.385184    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:59.493850 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.493781    2578 generic.go:356] "Generic (PLEG): container finished" podID="359b3008-29c1-4af2-9781-e8c3fd74b4a2" containerID="0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe" exitCode=0
Jul 28 13:05:59.493850 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.493851    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96bdcb-hwp7j"
Jul 28 13:05:59.494054 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.493875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96bdcb-hwp7j" event={"ID":"359b3008-29c1-4af2-9781-e8c3fd74b4a2","Type":"ContainerDied","Data":"0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe"}
Jul 28 13:05:59.494054 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.493930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96bdcb-hwp7j" event={"ID":"359b3008-29c1-4af2-9781-e8c3fd74b4a2","Type":"ContainerDied","Data":"476e047be15ac96bae11ae79875a88908c6fb6b8349c8b3a7cb92d43803dfffe"}
Jul 28 13:05:59.494054 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.493951    2578 scope.go:117] "RemoveContainer" containerID="0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe"
Jul 28 13:05:59.502287 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.502256    2578 scope.go:117] "RemoveContainer" containerID="0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe"
Jul 28 13:05:59.502536 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:05:59.502518    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe\": container with ID starting with 0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe not found: ID does not exist" containerID="0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe"
Jul 28 13:05:59.502579 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.502549    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe"} err="failed to get container status \"0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe\": rpc error: code = NotFound desc = could not find container \"0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe\": container with ID starting with 0b29aeef14a34062c2d693431c5a36b0130abbefd264f3eb55662578557003fe not found: ID does not exist"
Jul 28 13:05:59.510850 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.510828    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8fjl\" (UniqueName: \"kubernetes.io/projected/359b3008-29c1-4af2-9781-e8c3fd74b4a2-kube-api-access-l8fjl\") pod \"359b3008-29c1-4af2-9781-e8c3fd74b4a2\" (UID: \"359b3008-29c1-4af2-9781-e8c3fd74b4a2\") "
Jul 28 13:05:59.510976 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.510964    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/359b3008-29c1-4af2-9781-e8c3fd74b4a2-webhook-cert\") pod \"359b3008-29c1-4af2-9781-e8c3fd74b4a2\" (UID: \"359b3008-29c1-4af2-9781-e8c3fd74b4a2\") "
Jul 28 13:05:59.512995 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.512966    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/359b3008-29c1-4af2-9781-e8c3fd74b4a2-kube-api-access-l8fjl" (OuterVolumeSpecName: "kube-api-access-l8fjl") pod "359b3008-29c1-4af2-9781-e8c3fd74b4a2" (UID: "359b3008-29c1-4af2-9781-e8c3fd74b4a2"). InnerVolumeSpecName "kube-api-access-l8fjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:05:59.513251 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.513231    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/359b3008-29c1-4af2-9781-e8c3fd74b4a2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "359b3008-29c1-4af2-9781-e8c3fd74b4a2" (UID: "359b3008-29c1-4af2-9781-e8c3fd74b4a2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:05:59.612059 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.612024    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/359b3008-29c1-4af2-9781-e8c3fd74b4a2-webhook-cert\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:05:59.612059 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.612053    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8fjl\" (UniqueName: \"kubernetes.io/projected/359b3008-29c1-4af2-9781-e8c3fd74b4a2-kube-api-access-l8fjl\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:05:59.816784 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.816749    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-hwp7j"]
Jul 28 13:05:59.821252 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:05:59.821226    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-hwp7j"]
Jul 28 13:06:00.637077 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.634283    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bb96bdcb-hlgqg"]
Jul 28 13:06:00.637077 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.635152    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="359b3008-29c1-4af2-9781-e8c3fd74b4a2" containerName="manager"
Jul 28 13:06:00.637077 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.635172    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="359b3008-29c1-4af2-9781-e8c3fd74b4a2" containerName="manager"
Jul 28 13:06:00.637077 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.635380    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="359b3008-29c1-4af2-9781-e8c3fd74b4a2" containerName="manager"
Jul 28 13:06:00.640611 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.640581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96bdcb-hlgqg"
Jul 28 13:06:00.644540 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.644502    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 13:06:00.644540 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.644531    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 13:06:00.644759 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.644502    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-99hmh\""
Jul 28 13:06:00.647130 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.647090    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-hlgqg"]
Jul 28 13:06:00.722395 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.722355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6f6s\" (UniqueName: \"kubernetes.io/projected/ba80b53c-17ca-41a6-9505-bf7d11a71961-kube-api-access-z6f6s\") pod \"maas-controller-bb96bdcb-hlgqg\" (UID: \"ba80b53c-17ca-41a6-9505-bf7d11a71961\") " pod="opendatahub/maas-controller-bb96bdcb-hlgqg"
Jul 28 13:06:00.722582 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.722414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba80b53c-17ca-41a6-9505-bf7d11a71961-webhook-cert\") pod \"maas-controller-bb96bdcb-hlgqg\" (UID: \"ba80b53c-17ca-41a6-9505-bf7d11a71961\") " pod="opendatahub/maas-controller-bb96bdcb-hlgqg"
Jul 28 13:06:00.823164 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.823124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6f6s\" (UniqueName: \"kubernetes.io/projected/ba80b53c-17ca-41a6-9505-bf7d11a71961-kube-api-access-z6f6s\") pod \"maas-controller-bb96bdcb-hlgqg\" (UID: \"ba80b53c-17ca-41a6-9505-bf7d11a71961\") " pod="opendatahub/maas-controller-bb96bdcb-hlgqg"
Jul 28 13:06:00.823302 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.823180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba80b53c-17ca-41a6-9505-bf7d11a71961-webhook-cert\") pod \"maas-controller-bb96bdcb-hlgqg\" (UID: \"ba80b53c-17ca-41a6-9505-bf7d11a71961\") " pod="opendatahub/maas-controller-bb96bdcb-hlgqg"
Jul 28 13:06:00.825861 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.825836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba80b53c-17ca-41a6-9505-bf7d11a71961-webhook-cert\") pod \"maas-controller-bb96bdcb-hlgqg\" (UID: \"ba80b53c-17ca-41a6-9505-bf7d11a71961\") " pod="opendatahub/maas-controller-bb96bdcb-hlgqg"
Jul 28 13:06:00.832511 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.832484    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6f6s\" (UniqueName: \"kubernetes.io/projected/ba80b53c-17ca-41a6-9505-bf7d11a71961-kube-api-access-z6f6s\") pod \"maas-controller-bb96bdcb-hlgqg\" (UID: \"ba80b53c-17ca-41a6-9505-bf7d11a71961\") " pod="opendatahub/maas-controller-bb96bdcb-hlgqg"
Jul 28 13:06:00.952678 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:00.952579    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb96bdcb-hlgqg"
Jul 28 13:06:01.272668 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:01.272631    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="359b3008-29c1-4af2-9781-e8c3fd74b4a2" path="/var/lib/kubelet/pods/359b3008-29c1-4af2-9781-e8c3fd74b4a2/volumes"
Jul 28 13:06:01.298843 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:01.298795    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb96bdcb-hlgqg"]
Jul 28 13:06:01.300559 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:06:01.300534    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba80b53c_17ca_41a6_9505_bf7d11a71961.slice/crio-2223a5b9d9430d82555534c7522e879509537d806f3760b1db838f7ea5421471 WatchSource:0}: Error finding container 2223a5b9d9430d82555534c7522e879509537d806f3760b1db838f7ea5421471: Status 404 returned error can't find the container with id 2223a5b9d9430d82555534c7522e879509537d806f3760b1db838f7ea5421471
Jul 28 13:06:01.504584 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:01.504546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96bdcb-hlgqg" event={"ID":"ba80b53c-17ca-41a6-9505-bf7d11a71961","Type":"ContainerStarted","Data":"2223a5b9d9430d82555534c7522e879509537d806f3760b1db838f7ea5421471"}
Jul 28 13:06:02.511455 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:02.511409    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb96bdcb-hlgqg" event={"ID":"ba80b53c-17ca-41a6-9505-bf7d11a71961","Type":"ContainerStarted","Data":"4996cc3915173f25e2310449faa279586a3113d9695806de143c3825746609c1"}
Jul 28 13:06:02.511952 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:02.511535    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bb96bdcb-hlgqg"
Jul 28 13:06:02.531559 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:02.531511    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bb96bdcb-hlgqg" podStartSLOduration=2.03867566 podStartE2EDuration="2.53149609s" totalImagesPullingTime="492.82043ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:06:02.529274445 +0000 UTC m=+897.690042379" watchObservedRunningTime="2026-07-28 13:06:02.53149609 +0000 UTC m=+897.692264024"
Jul 28 13:06:05.232508 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:05.232474    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:06:05.234326 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:05.234299    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:06:05.240960 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:05.240942    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:06:05.243093 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:05.243074    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:06:13.518371 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:06:13.518344    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bb96bdcb-hlgqg"
Jul 28 13:11:05.261357 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:11:05.261329    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:11:05.263898 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:11:05.261621    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:11:05.273575 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:11:05.273543    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:11:05.273696 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:11:05.273642    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:16:05.293890 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:16:05.293858    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:16:05.296184 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:16:05.294839    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:16:05.302083 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:16:05.302061    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:16:05.303068 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:16:05.303049    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:19:23.759593 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:23.759560    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"]
Jul 28 13:19:23.763458 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:23.763428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:23.766236 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:23.766217    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0142f26b-serving-cert\""
Jul 28 13:19:23.766353 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:23.766321    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j6zj5\""
Jul 28 13:19:23.779723 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:23.779697    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"]
Jul 28 13:19:23.903140 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:23.903094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-maas-api-tls\") pod \"maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:23.903321 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:23.903153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wkjf\" (UniqueName: \"kubernetes.io/projected/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-kube-api-access-4wkjf\") pod \"maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:23.903321 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:23.903234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-openshift-service-ca\") pod \"maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:24.004414 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:24.004378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-openshift-service-ca\") pod \"maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:24.004628 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:24.004472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-maas-api-tls\") pod \"maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:24.004628 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:24.004511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wkjf\" (UniqueName: \"kubernetes.io/projected/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-kube-api-access-4wkjf\") pod \"maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:24.005229 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:24.005208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-openshift-service-ca\") pod \"maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:24.007186 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:24.007166    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-maas-api-tls\") pod \"maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:24.012836 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:24.012757    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wkjf\" (UniqueName: \"kubernetes.io/projected/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-kube-api-access-4wkjf\") pod \"maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:24.074934 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:24.074905    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:24.216837 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:24.216793    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"]
Jul 28 13:19:24.218915 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:19:24.218887    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f98f1d_91af_41a3_b5e0_5a2e5c6825f6.slice/crio-d60e36a4cc8065299063a0bb09a563091c7b6fa76df5316621aadc1250d8d5a0 WatchSource:0}: Error finding container d60e36a4cc8065299063a0bb09a563091c7b6fa76df5316621aadc1250d8d5a0: Status 404 returned error can't find the container with id d60e36a4cc8065299063a0bb09a563091c7b6fa76df5316621aadc1250d8d5a0
Jul 28 13:19:24.220218 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:24.220201    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:19:24.238751 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:24.238723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h" event={"ID":"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6","Type":"ContainerStarted","Data":"d60e36a4cc8065299063a0bb09a563091c7b6fa76df5316621aadc1250d8d5a0"}
Jul 28 13:19:25.244706 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:25.244673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h" event={"ID":"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6","Type":"ContainerStarted","Data":"80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5"}
Jul 28 13:19:25.245141 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:25.244789    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:19:25.263790 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:25.263736    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h" podStartSLOduration=1.389386371 podStartE2EDuration="2.263718985s" totalImagesPullingTime="874.332614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:19:25.262730923 +0000 UTC m=+1700.423498856" watchObservedRunningTime="2026-07-28 13:19:25.263718985 +0000 UTC m=+1700.424486943"
Jul 28 13:19:31.257135 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:19:31.257106    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:20:14.382668 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.382632    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"]
Jul 28 13:20:14.383299 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.382899    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h" podUID="84f98f1d-91af-41a3-b5e0-5a2e5c6825f6" containerName="maas-api" containerID="cri-o://80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5" gracePeriod=30
Jul 28 13:20:14.641379 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.641318    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:20:14.769977 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.769949    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wkjf\" (UniqueName: \"kubernetes.io/projected/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-kube-api-access-4wkjf\") pod \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") "
Jul 28 13:20:14.770164 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.770013    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-openshift-service-ca\") pod \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") "
Jul 28 13:20:14.770164 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.770070    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-maas-api-tls\") pod \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\" (UID: \"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6\") "
Jul 28 13:20:14.770377 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.770352    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84f98f1d-91af-41a3-b5e0-5a2e5c6825f6" (UID: "84f98f1d-91af-41a3-b5e0-5a2e5c6825f6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:20:14.772301 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.772277    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84f98f1d-91af-41a3-b5e0-5a2e5c6825f6" (UID: "84f98f1d-91af-41a3-b5e0-5a2e5c6825f6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:20:14.772301 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.772291    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-kube-api-access-4wkjf" (OuterVolumeSpecName: "kube-api-access-4wkjf") pod "84f98f1d-91af-41a3-b5e0-5a2e5c6825f6" (UID: "84f98f1d-91af-41a3-b5e0-5a2e5c6825f6"). InnerVolumeSpecName "kube-api-access-4wkjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:20:14.871738 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.871529    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wkjf\" (UniqueName: \"kubernetes.io/projected/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-kube-api-access-4wkjf\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:20:14.871738 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.871555    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:20:14.871738 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:14.871567    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:20:15.481564 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:15.481536    2578 generic.go:356] "Generic (PLEG): container finished" podID="84f98f1d-91af-41a3-b5e0-5a2e5c6825f6" containerID="80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5" exitCode=0
Jul 28 13:20:15.482060 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:15.481588    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"
Jul 28 13:20:15.482060 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:15.481631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h" event={"ID":"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6","Type":"ContainerDied","Data":"80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5"}
Jul 28 13:20:15.482060 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:15.481690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h" event={"ID":"84f98f1d-91af-41a3-b5e0-5a2e5c6825f6","Type":"ContainerDied","Data":"d60e36a4cc8065299063a0bb09a563091c7b6fa76df5316621aadc1250d8d5a0"}
Jul 28 13:20:15.482060 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:15.481723    2578 scope.go:117] "RemoveContainer" containerID="80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5"
Jul 28 13:20:15.491140 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:15.491122    2578 scope.go:117] "RemoveContainer" containerID="80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5"
Jul 28 13:20:15.491411 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:20:15.491393    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5\": container with ID starting with 80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5 not found: ID does not exist" containerID="80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5"
Jul 28 13:20:15.491476 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:15.491423    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5"} err="failed to get container status \"80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5\": rpc error: code = NotFound desc = could not find container \"80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5\": container with ID starting with 80eb6db356e34c4f6e284f8e07b1dfa4290fa7520b35a135e9d484d3d8c0f2e5 not found: ID does not exist"
Jul 28 13:20:15.505183 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:15.505149    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"]
Jul 28 13:20:15.509654 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:15.509626    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0142f26b-59d5f8ccb8-twk7h"]
Jul 28 13:20:17.271907 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:17.271867    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84f98f1d-91af-41a3-b5e0-5a2e5c6825f6" path="/var/lib/kubelet/pods/84f98f1d-91af-41a3-b5e0-5a2e5c6825f6/volumes"
Jul 28 13:20:18.319978 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.319947    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"]
Jul 28 13:20:18.320345 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.320299    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f98f1d-91af-41a3-b5e0-5a2e5c6825f6" containerName="maas-api"
Jul 28 13:20:18.320345 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.320310    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f98f1d-91af-41a3-b5e0-5a2e5c6825f6" containerName="maas-api"
Jul 28 13:20:18.320462 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.320384    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="84f98f1d-91af-41a3-b5e0-5a2e5c6825f6" containerName="maas-api"
Jul 28 13:20:18.324696 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.324674    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:18.327245 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.327224    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-d771891a-serving-cert\""
Jul 28 13:20:18.327414 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.327390    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j6zj5\""
Jul 28 13:20:18.334064 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.334029    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"]
Jul 28 13:20:18.403285 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.403250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp5gs\" (UniqueName: \"kubernetes.io/projected/663d6f72-7b74-4267-a644-17bc284402bc-kube-api-access-kp5gs\") pod \"maas-api-e2e-migrate-d771891a-78875585f6-d95rw\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:18.403483 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.403323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/663d6f72-7b74-4267-a644-17bc284402bc-openshift-service-ca\") pod \"maas-api-e2e-migrate-d771891a-78875585f6-d95rw\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:18.403483 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.403361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663d6f72-7b74-4267-a644-17bc284402bc-maas-api-tls\") pod \"maas-api-e2e-migrate-d771891a-78875585f6-d95rw\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:18.503944 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.503914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp5gs\" (UniqueName: \"kubernetes.io/projected/663d6f72-7b74-4267-a644-17bc284402bc-kube-api-access-kp5gs\") pod \"maas-api-e2e-migrate-d771891a-78875585f6-d95rw\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:18.504122 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.503964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/663d6f72-7b74-4267-a644-17bc284402bc-openshift-service-ca\") pod \"maas-api-e2e-migrate-d771891a-78875585f6-d95rw\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:18.504122 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.503998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663d6f72-7b74-4267-a644-17bc284402bc-maas-api-tls\") pod \"maas-api-e2e-migrate-d771891a-78875585f6-d95rw\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:18.504122 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:20:18.504091    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-serving-cert: secret "maas-api-e2e-migrate-d771891a-serving-cert" not found
Jul 28 13:20:18.504307 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:20:18.504153    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/663d6f72-7b74-4267-a644-17bc284402bc-maas-api-tls podName:663d6f72-7b74-4267-a644-17bc284402bc nodeName:}" failed. No retries permitted until 2026-07-28 13:20:19.004137084 +0000 UTC m=+1754.164904996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/663d6f72-7b74-4267-a644-17bc284402bc-maas-api-tls") pod "maas-api-e2e-migrate-d771891a-78875585f6-d95rw" (UID: "663d6f72-7b74-4267-a644-17bc284402bc") : secret "maas-api-e2e-migrate-d771891a-serving-cert" not found
Jul 28 13:20:18.504586 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.504565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/663d6f72-7b74-4267-a644-17bc284402bc-openshift-service-ca\") pod \"maas-api-e2e-migrate-d771891a-78875585f6-d95rw\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:18.515180 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.515145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp5gs\" (UniqueName: \"kubernetes.io/projected/663d6f72-7b74-4267-a644-17bc284402bc-kube-api-access-kp5gs\") pod \"maas-api-e2e-migrate-d771891a-78875585f6-d95rw\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:18.941109 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.941071    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"]
Jul 28 13:20:18.944732 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.944711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:18.947771 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.947747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d771891a-dockercfg-jfxl9\""
Jul 28 13:20:18.947990 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.947972    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d771891a\""
Jul 28 13:20:18.955575 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.955549    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"]
Jul 28 13:20:18.975914 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.975883    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"]
Jul 28 13:20:18.979258 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.979242    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:18.989719 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:18.989686    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"]
Jul 28 13:20:19.009471 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.009441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663d6f72-7b74-4267-a644-17bc284402bc-maas-api-tls\") pod \"maas-api-e2e-migrate-d771891a-78875585f6-d95rw\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:19.012046 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.012021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663d6f72-7b74-4267-a644-17bc284402bc-maas-api-tls\") pod \"maas-api-e2e-migrate-d771891a-78875585f6-d95rw\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:19.110873 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.110839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11304da4-70db-462e-9a04-76abcff3f9c6-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4\" (UID: \"11304da4-70db-462e-9a04-76abcff3f9c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:19.111053 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.110884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzmb9\" (UniqueName: \"kubernetes.io/projected/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-kube-api-access-lzmb9\") pod \"payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf\" (UID: \"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:19.111053 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.110963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf\" (UID: \"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:19.111053 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.111014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgt87\" (UniqueName: \"kubernetes.io/projected/11304da4-70db-462e-9a04-76abcff3f9c6-kube-api-access-hgt87\") pod \"payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4\" (UID: \"11304da4-70db-462e-9a04-76abcff3f9c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:19.212336 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.212233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11304da4-70db-462e-9a04-76abcff3f9c6-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4\" (UID: \"11304da4-70db-462e-9a04-76abcff3f9c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:19.212336 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.212280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmb9\" (UniqueName: \"kubernetes.io/projected/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-kube-api-access-lzmb9\") pod \"payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf\" (UID: \"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:19.212336 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.212324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf\" (UID: \"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:19.212626 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.212353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgt87\" (UniqueName: \"kubernetes.io/projected/11304da4-70db-462e-9a04-76abcff3f9c6-kube-api-access-hgt87\") pod \"payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4\" (UID: \"11304da4-70db-462e-9a04-76abcff3f9c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:19.213107 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.213083    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf\" (UID: \"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:19.213486 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.213464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11304da4-70db-462e-9a04-76abcff3f9c6-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4\" (UID: \"11304da4-70db-462e-9a04-76abcff3f9c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:19.221389 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.221357    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgt87\" (UniqueName: \"kubernetes.io/projected/11304da4-70db-462e-9a04-76abcff3f9c6-kube-api-access-hgt87\") pod \"payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4\" (UID: \"11304da4-70db-462e-9a04-76abcff3f9c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:19.221494 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.221438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzmb9\" (UniqueName: \"kubernetes.io/projected/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-kube-api-access-lzmb9\") pod \"payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf\" (UID: \"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:19.237893 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.237874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:19.255959 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.255932    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:19.290789 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.290759    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:19.406547 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.406465    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"]
Jul 28 13:20:19.409832 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:20:19.409757    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663d6f72_7b74_4267_a644_17bc284402bc.slice/crio-b3f220f54d6dd0afb8c7c7a3a6ebb8b51691eb57d4d6263aca13ea4cbfbc99bd WatchSource:0}: Error finding container b3f220f54d6dd0afb8c7c7a3a6ebb8b51691eb57d4d6263aca13ea4cbfbc99bd: Status 404 returned error can't find the container with id b3f220f54d6dd0afb8c7c7a3a6ebb8b51691eb57d4d6263aca13ea4cbfbc99bd
Jul 28 13:20:19.437521 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.437485    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"]
Jul 28 13:20:19.439294 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:20:19.439270    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bdaf12e_22e3_4a3f_9a11_e0c38c7d429d.slice/crio-452b77410e9f119819b00e70a83ed90b24e7b57c4a7dc7820be4abd33354059c WatchSource:0}: Error finding container 452b77410e9f119819b00e70a83ed90b24e7b57c4a7dc7820be4abd33354059c: Status 404 returned error can't find the container with id 452b77410e9f119819b00e70a83ed90b24e7b57c4a7dc7820be4abd33354059c
Jul 28 13:20:19.466669 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.466647    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"]
Jul 28 13:20:19.482039 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:20:19.482014    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11304da4_70db_462e_9a04_76abcff3f9c6.slice/crio-77de115f41617c7a7a616d0e1377c1680f7d043faeff7effa58a4f39ea71f048 WatchSource:0}: Error finding container 77de115f41617c7a7a616d0e1377c1680f7d043faeff7effa58a4f39ea71f048: Status 404 returned error can't find the container with id 77de115f41617c7a7a616d0e1377c1680f7d043faeff7effa58a4f39ea71f048
Jul 28 13:20:19.506236 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.506210    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf" event={"ID":"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d","Type":"ContainerStarted","Data":"452b77410e9f119819b00e70a83ed90b24e7b57c4a7dc7820be4abd33354059c"}
Jul 28 13:20:19.507560 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.507536    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw" event={"ID":"663d6f72-7b74-4267-a644-17bc284402bc","Type":"ContainerStarted","Data":"b3f220f54d6dd0afb8c7c7a3a6ebb8b51691eb57d4d6263aca13ea4cbfbc99bd"}
Jul 28 13:20:19.508940 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:19.508915    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4" event={"ID":"11304da4-70db-462e-9a04-76abcff3f9c6","Type":"ContainerStarted","Data":"77de115f41617c7a7a616d0e1377c1680f7d043faeff7effa58a4f39ea71f048"}
Jul 28 13:20:20.517034 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:20.517004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf" event={"ID":"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d","Type":"ContainerStarted","Data":"10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565"}
Jul 28 13:20:20.517437 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:20.517124    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:20.518604 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:20.518583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4" event={"ID":"11304da4-70db-462e-9a04-76abcff3f9c6","Type":"ContainerStarted","Data":"a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56"}
Jul 28 13:20:20.518708 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:20.518624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:20.538209 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:20.538164    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf" podStartSLOduration=2.538149566 podStartE2EDuration="2.538149566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:20:20.535998986 +0000 UTC m=+1755.696766929" watchObservedRunningTime="2026-07-28 13:20:20.538149566 +0000 UTC m=+1755.698917499"
Jul 28 13:20:20.554434 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:20.554349    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4" podStartSLOduration=2.554328662 podStartE2EDuration="2.554328662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:20:20.552991524 +0000 UTC m=+1755.713759458" watchObservedRunningTime="2026-07-28 13:20:20.554328662 +0000 UTC m=+1755.715096578"
Jul 28 13:20:21.524927 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:21.524868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw" event={"ID":"663d6f72-7b74-4267-a644-17bc284402bc","Type":"ContainerStarted","Data":"ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908"}
Jul 28 13:20:21.525372 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:21.525111    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:21.544569 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:21.544520    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw" podStartSLOduration=2.46171364 podStartE2EDuration="3.544503669s" totalImagesPullingTime="1.082790029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:20:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:20:21.543867779 +0000 UTC m=+1756.704635733" watchObservedRunningTime="2026-07-28 13:20:21.544503669 +0000 UTC m=+1756.705271603"
Jul 28 13:20:27.535620 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:27.535584    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:31.527240 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:31.527212    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:31.527693 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:31.527286    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:48.989685 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:48.989635    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"]
Jul 28 13:20:48.990259 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:48.989979    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw" podUID="663d6f72-7b74-4267-a644-17bc284402bc" containerName="maas-api" containerID="cri-o://ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908" gracePeriod=30
Jul 28 13:20:49.052775 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.052739    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"]
Jul 28 13:20:49.053063 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.053033    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4" podUID="11304da4-70db-462e-9a04-76abcff3f9c6" containerName="payload-processing" containerID="cri-o://a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56" gracePeriod=30
Jul 28 13:20:49.069200 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.069151    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"]
Jul 28 13:20:49.069732 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.069700    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf" podUID="2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d" containerName="payload-pre-processing" containerID="cri-o://10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565" gracePeriod=30
Jul 28 13:20:49.395369 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.395345    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:49.398154 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.398134    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:49.401649 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.401630    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:49.507681 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.507643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11304da4-70db-462e-9a04-76abcff3f9c6-plugins-config-volume\") pod \"11304da4-70db-462e-9a04-76abcff3f9c6\" (UID: \"11304da4-70db-462e-9a04-76abcff3f9c6\") "
Jul 28 13:20:49.507887 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.507706    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663d6f72-7b74-4267-a644-17bc284402bc-maas-api-tls\") pod \"663d6f72-7b74-4267-a644-17bc284402bc\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") "
Jul 28 13:20:49.507887 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.507734    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/663d6f72-7b74-4267-a644-17bc284402bc-openshift-service-ca\") pod \"663d6f72-7b74-4267-a644-17bc284402bc\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") "
Jul 28 13:20:49.507887 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.507767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgt87\" (UniqueName: \"kubernetes.io/projected/11304da4-70db-462e-9a04-76abcff3f9c6-kube-api-access-hgt87\") pod \"11304da4-70db-462e-9a04-76abcff3f9c6\" (UID: \"11304da4-70db-462e-9a04-76abcff3f9c6\") "
Jul 28 13:20:49.507887 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.507851    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzmb9\" (UniqueName: \"kubernetes.io/projected/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-kube-api-access-lzmb9\") pod \"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d\" (UID: \"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d\") "
Jul 28 13:20:49.508121 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.507896    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-plugins-config-volume\") pod \"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d\" (UID: \"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d\") "
Jul 28 13:20:49.508121 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.507956    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp5gs\" (UniqueName: \"kubernetes.io/projected/663d6f72-7b74-4267-a644-17bc284402bc-kube-api-access-kp5gs\") pod \"663d6f72-7b74-4267-a644-17bc284402bc\" (UID: \"663d6f72-7b74-4267-a644-17bc284402bc\") "
Jul 28 13:20:49.508121 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.508072    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11304da4-70db-462e-9a04-76abcff3f9c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "11304da4-70db-462e-9a04-76abcff3f9c6" (UID: "11304da4-70db-462e-9a04-76abcff3f9c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:20:49.508282 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.508134    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/663d6f72-7b74-4267-a644-17bc284402bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "663d6f72-7b74-4267-a644-17bc284402bc" (UID: "663d6f72-7b74-4267-a644-17bc284402bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:20:49.508353 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.508323    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d" (UID: "2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:20:49.508433 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.508417    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:20:49.508470 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.508438    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11304da4-70db-462e-9a04-76abcff3f9c6-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:20:49.508470 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.508448    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/663d6f72-7b74-4267-a644-17bc284402bc-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:20:49.510497 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.510475    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/663d6f72-7b74-4267-a644-17bc284402bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "663d6f72-7b74-4267-a644-17bc284402bc" (UID: "663d6f72-7b74-4267-a644-17bc284402bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:20:49.510577 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.510518    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11304da4-70db-462e-9a04-76abcff3f9c6-kube-api-access-hgt87" (OuterVolumeSpecName: "kube-api-access-hgt87") pod "11304da4-70db-462e-9a04-76abcff3f9c6" (UID: "11304da4-70db-462e-9a04-76abcff3f9c6"). InnerVolumeSpecName "kube-api-access-hgt87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:20:49.510732 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.510707    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-kube-api-access-lzmb9" (OuterVolumeSpecName: "kube-api-access-lzmb9") pod "2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d" (UID: "2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d"). InnerVolumeSpecName "kube-api-access-lzmb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:20:49.510837 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.510712    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/663d6f72-7b74-4267-a644-17bc284402bc-kube-api-access-kp5gs" (OuterVolumeSpecName: "kube-api-access-kp5gs") pod "663d6f72-7b74-4267-a644-17bc284402bc" (UID: "663d6f72-7b74-4267-a644-17bc284402bc"). InnerVolumeSpecName "kube-api-access-kp5gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:20:49.609596 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.609516    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzmb9\" (UniqueName: \"kubernetes.io/projected/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d-kube-api-access-lzmb9\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:20:49.609596 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.609544    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp5gs\" (UniqueName: \"kubernetes.io/projected/663d6f72-7b74-4267-a644-17bc284402bc-kube-api-access-kp5gs\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:20:49.609596 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.609556    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663d6f72-7b74-4267-a644-17bc284402bc-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:20:49.609596 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.609565    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgt87\" (UniqueName: \"kubernetes.io/projected/11304da4-70db-462e-9a04-76abcff3f9c6-kube-api-access-hgt87\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:20:49.665975 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.665935    2578 generic.go:356] "Generic (PLEG): container finished" podID="11304da4-70db-462e-9a04-76abcff3f9c6" containerID="a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56" exitCode=0
Jul 28 13:20:49.666149 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.665983    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"
Jul 28 13:20:49.666149 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.666029    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4" event={"ID":"11304da4-70db-462e-9a04-76abcff3f9c6","Type":"ContainerDied","Data":"a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56"}
Jul 28 13:20:49.666149 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.666090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4" event={"ID":"11304da4-70db-462e-9a04-76abcff3f9c6","Type":"ContainerDied","Data":"77de115f41617c7a7a616d0e1377c1680f7d043faeff7effa58a4f39ea71f048"}
Jul 28 13:20:49.666149 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.666124    2578 scope.go:117] "RemoveContainer" containerID="a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56"
Jul 28 13:20:49.667673 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.667651    2578 generic.go:356] "Generic (PLEG): container finished" podID="2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d" containerID="10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565" exitCode=0
Jul 28 13:20:49.667783 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.667701    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"
Jul 28 13:20:49.667783 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.667721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf" event={"ID":"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d","Type":"ContainerDied","Data":"10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565"}
Jul 28 13:20:49.667783 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.667753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf" event={"ID":"2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d","Type":"ContainerDied","Data":"452b77410e9f119819b00e70a83ed90b24e7b57c4a7dc7820be4abd33354059c"}
Jul 28 13:20:49.669096 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.669072    2578 generic.go:356] "Generic (PLEG): container finished" podID="663d6f72-7b74-4267-a644-17bc284402bc" containerID="ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908" exitCode=0
Jul 28 13:20:49.669297 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.669105    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"
Jul 28 13:20:49.669297 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.669141    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw" event={"ID":"663d6f72-7b74-4267-a644-17bc284402bc","Type":"ContainerDied","Data":"ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908"}
Jul 28 13:20:49.669297 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.669181    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw" event={"ID":"663d6f72-7b74-4267-a644-17bc284402bc","Type":"ContainerDied","Data":"b3f220f54d6dd0afb8c7c7a3a6ebb8b51691eb57d4d6263aca13ea4cbfbc99bd"}
Jul 28 13:20:49.676139 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.676120    2578 scope.go:117] "RemoveContainer" containerID="a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56"
Jul 28 13:20:49.676460 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:20:49.676434    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56\": container with ID starting with a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56 not found: ID does not exist" containerID="a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56"
Jul 28 13:20:49.676562 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.676471    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56"} err="failed to get container status \"a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56\": rpc error: code = NotFound desc = could not find container \"a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56\": container with ID starting with a5c863bff3863a82cb9a0403c417be9acd997276dd6573c7fb7f6751dbd61b56 not found: ID does not exist"
Jul 28 13:20:49.676562 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.676494    2578 scope.go:117] "RemoveContainer" containerID="10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565"
Jul 28 13:20:49.687939 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.687923    2578 scope.go:117] "RemoveContainer" containerID="10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565"
Jul 28 13:20:49.688191 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:20:49.688174    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565\": container with ID starting with 10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565 not found: ID does not exist" containerID="10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565"
Jul 28 13:20:49.688241 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.688198    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565"} err="failed to get container status \"10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565\": rpc error: code = NotFound desc = could not find container \"10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565\": container with ID starting with 10f1ef67c7ec5ad8cc9bb9bf4195a21f4217a9989a5f4757aa0dc561eeb97565 not found: ID does not exist"
Jul 28 13:20:49.688241 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.688213    2578 scope.go:117] "RemoveContainer" containerID="ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908"
Jul 28 13:20:49.694071 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.694046    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"]
Jul 28 13:20:49.697262 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.697238    2578 scope.go:117] "RemoveContainer" containerID="ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908"
Jul 28 13:20:49.697524 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:20:49.697504    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908\": container with ID starting with ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908 not found: ID does not exist" containerID="ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908"
Jul 28 13:20:49.697570 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.697532    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908"} err="failed to get container status \"ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908\": rpc error: code = NotFound desc = could not find container \"ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908\": container with ID starting with ae9d9d172e202477dbc96d3fc5e341cfa6bece6e0e7dbd7f86680bcbdae09908 not found: ID does not exist"
Jul 28 13:20:49.698276 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.698258    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d771891a-78666c9d77-fjvq4"]
Jul 28 13:20:49.716116 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.716089    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"]
Jul 28 13:20:49.720169 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.720148    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d771891a-78875585f6-d95rw"]
Jul 28 13:20:49.730965 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.730945    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"]
Jul 28 13:20:49.734355 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:49.734332    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d771891a-c76c57776-w7hxf"]
Jul 28 13:20:51.271252 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:51.271216    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11304da4-70db-462e-9a04-76abcff3f9c6" path="/var/lib/kubelet/pods/11304da4-70db-462e-9a04-76abcff3f9c6/volumes"
Jul 28 13:20:51.271596 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:51.271561    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d" path="/var/lib/kubelet/pods/2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d/volumes"
Jul 28 13:20:51.271920 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:51.271906    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="663d6f72-7b74-4267-a644-17bc284402bc" path="/var/lib/kubelet/pods/663d6f72-7b74-4267-a644-17bc284402bc/volumes"
Jul 28 13:20:52.248137 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.248096    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"]
Jul 28 13:20:52.248675 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.248658    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d" containerName="payload-pre-processing"
Jul 28 13:20:52.248724 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.248680    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d" containerName="payload-pre-processing"
Jul 28 13:20:52.248724 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.248699    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11304da4-70db-462e-9a04-76abcff3f9c6" containerName="payload-processing"
Jul 28 13:20:52.248724 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.248709    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="11304da4-70db-462e-9a04-76abcff3f9c6" containerName="payload-processing"
Jul 28 13:20:52.248835 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.248733    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663d6f72-7b74-4267-a644-17bc284402bc" containerName="maas-api"
Jul 28 13:20:52.248835 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.248744    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="663d6f72-7b74-4267-a644-17bc284402bc" containerName="maas-api"
Jul 28 13:20:52.248902 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.248851    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="663d6f72-7b74-4267-a644-17bc284402bc" containerName="maas-api"
Jul 28 13:20:52.248902 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.248865    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="11304da4-70db-462e-9a04-76abcff3f9c6" containerName="payload-processing"
Jul 28 13:20:52.248902 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.248875    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bdaf12e-22e3-4a3f-9a11-e0c38c7d429d" containerName="payload-pre-processing"
Jul 28 13:20:52.253915 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.253897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:52.256698 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.256674    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j6zj5\""
Jul 28 13:20:52.256874 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.256678    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-72ce9b01-serving-cert\""
Jul 28 13:20:52.262080 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.262058    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"]
Jul 28 13:20:52.334717 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.334682    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c10067c9-bd48-46a2-a306-debbd55a907e-openshift-service-ca\") pod \"maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:52.335208 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.334761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82bcb\" (UniqueName: \"kubernetes.io/projected/c10067c9-bd48-46a2-a306-debbd55a907e-kube-api-access-82bcb\") pod \"maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:52.335208 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.334830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c10067c9-bd48-46a2-a306-debbd55a907e-maas-api-tls\") pod \"maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:52.436268 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.436230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c10067c9-bd48-46a2-a306-debbd55a907e-openshift-service-ca\") pod \"maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:52.436474 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.436297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82bcb\" (UniqueName: \"kubernetes.io/projected/c10067c9-bd48-46a2-a306-debbd55a907e-kube-api-access-82bcb\") pod \"maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:52.436474 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.436332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c10067c9-bd48-46a2-a306-debbd55a907e-maas-api-tls\") pod \"maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:52.437147 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.437067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c10067c9-bd48-46a2-a306-debbd55a907e-openshift-service-ca\") pod \"maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:52.438912 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.438892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c10067c9-bd48-46a2-a306-debbd55a907e-maas-api-tls\") pod \"maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:52.447646 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.447626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82bcb\" (UniqueName: \"kubernetes.io/projected/c10067c9-bd48-46a2-a306-debbd55a907e-kube-api-access-82bcb\") pod \"maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:52.567321 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.567286    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:52.708785 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.708722    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"]
Jul 28 13:20:52.711251 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:20:52.711225    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10067c9_bd48_46a2_a306_debbd55a907e.slice/crio-87bec15cf4a2a2ff2bdd87d705c89c377ee9a918964e4ed983c891f23e3ecde1 WatchSource:0}: Error finding container 87bec15cf4a2a2ff2bdd87d705c89c377ee9a918964e4ed983c891f23e3ecde1: Status 404 returned error can't find the container with id 87bec15cf4a2a2ff2bdd87d705c89c377ee9a918964e4ed983c891f23e3ecde1
Jul 28 13:20:52.980323 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.980240    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"]
Jul 28 13:20:52.984871 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.984852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:20:52.987460 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.987439    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-72ce9b01-dockercfg-rj6r6\""
Jul 28 13:20:52.987557 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.987439    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-72ce9b01\""
Jul 28 13:20:52.995409 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.995362    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"]
Jul 28 13:20:52.997794 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:52.997772    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"]
Jul 28 13:20:53.001168 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.001148    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:20:53.014540 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.014520    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"]
Jul 28 13:20:53.042178 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.042143    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54559a17-4737-44c8-a6d9-cfc3253b6b2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69\" (UID: \"54559a17-4737-44c8-a6d9-cfc3253b6b2c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:20:53.042352 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.042213    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptsft\" (UniqueName: \"kubernetes.io/projected/54559a17-4737-44c8-a6d9-cfc3253b6b2c-kube-api-access-ptsft\") pod \"payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69\" (UID: \"54559a17-4737-44c8-a6d9-cfc3253b6b2c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:20:53.143211 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.143168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54559a17-4737-44c8-a6d9-cfc3253b6b2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69\" (UID: \"54559a17-4737-44c8-a6d9-cfc3253b6b2c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:20:53.143389 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.143244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-plugins-config-volume\") pod \"payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx\" (UID: \"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467\") " pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:20:53.143389 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.143286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7chr\" (UniqueName: \"kubernetes.io/projected/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-kube-api-access-v7chr\") pod \"payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx\" (UID: \"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467\") " pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:20:53.143389 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.143318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptsft\" (UniqueName: \"kubernetes.io/projected/54559a17-4737-44c8-a6d9-cfc3253b6b2c-kube-api-access-ptsft\") pod \"payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69\" (UID: \"54559a17-4737-44c8-a6d9-cfc3253b6b2c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:20:53.143974 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.143947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54559a17-4737-44c8-a6d9-cfc3253b6b2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69\" (UID: \"54559a17-4737-44c8-a6d9-cfc3253b6b2c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:20:53.163853 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.163798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptsft\" (UniqueName: \"kubernetes.io/projected/54559a17-4737-44c8-a6d9-cfc3253b6b2c-kube-api-access-ptsft\") pod \"payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69\" (UID: \"54559a17-4737-44c8-a6d9-cfc3253b6b2c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:20:53.244163 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.244133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-plugins-config-volume\") pod \"payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx\" (UID: \"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467\") " pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:20:53.244291 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.244194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7chr\" (UniqueName: \"kubernetes.io/projected/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-kube-api-access-v7chr\") pod \"payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx\" (UID: \"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467\") " pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:20:53.244819 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.244779    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-plugins-config-volume\") pod \"payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx\" (UID: \"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467\") " pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:20:53.257431 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.257406    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7chr\" (UniqueName: \"kubernetes.io/projected/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-kube-api-access-v7chr\") pod \"payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx\" (UID: \"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467\") " pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:20:53.296856 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.296822    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:20:53.314917 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.314889    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:20:53.448142 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.448060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"]
Jul 28 13:20:53.477335 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.477294    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"]
Jul 28 13:20:53.483244 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:20:53.483209    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc238bd5_68b1_4f5f_9cfa_5c9f1e18c467.slice/crio-0424d328d556cdd2e7a8ee8a8bfae1a6137b0281d04f934f38bcbaa4a986cfa1 WatchSource:0}: Error finding container 0424d328d556cdd2e7a8ee8a8bfae1a6137b0281d04f934f38bcbaa4a986cfa1: Status 404 returned error can't find the container with id 0424d328d556cdd2e7a8ee8a8bfae1a6137b0281d04f934f38bcbaa4a986cfa1
Jul 28 13:20:53.696301 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.696261    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69" event={"ID":"54559a17-4737-44c8-a6d9-cfc3253b6b2c","Type":"ContainerStarted","Data":"ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac"}
Jul 28 13:20:53.696495 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.696330    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69" event={"ID":"54559a17-4737-44c8-a6d9-cfc3253b6b2c","Type":"ContainerStarted","Data":"7af11ed60cccb9897b12fbc6b111b57141c8290a9cc32ef0bbb9eebf61c59df2"}
Jul 28 13:20:53.696495 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.696364    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:20:53.698025 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.698000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx" event={"ID":"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467","Type":"ContainerStarted","Data":"bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f"}
Jul 28 13:20:53.698171 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.698045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx" event={"ID":"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467","Type":"ContainerStarted","Data":"0424d328d556cdd2e7a8ee8a8bfae1a6137b0281d04f934f38bcbaa4a986cfa1"}
Jul 28 13:20:53.698171 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.698067    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:20:53.699434 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.699400    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2" event={"ID":"c10067c9-bd48-46a2-a306-debbd55a907e","Type":"ContainerStarted","Data":"fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9"}
Jul 28 13:20:53.699536 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.699458    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2" event={"ID":"c10067c9-bd48-46a2-a306-debbd55a907e","Type":"ContainerStarted","Data":"87bec15cf4a2a2ff2bdd87d705c89c377ee9a918964e4ed983c891f23e3ecde1"}
Jul 28 13:20:53.699536 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.699490    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:20:53.730626 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.730566    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69" podStartSLOduration=1.730548124 podStartE2EDuration="1.730548124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:20:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:20:53.729902834 +0000 UTC m=+1788.890670789" watchObservedRunningTime="2026-07-28 13:20:53.730548124 +0000 UTC m=+1788.891316058"
Jul 28 13:20:53.755280 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.755146    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx" podStartSLOduration=1.7551253020000002 podStartE2EDuration="1.755125302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:20:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:20:53.754454773 +0000 UTC m=+1788.915222719" watchObservedRunningTime="2026-07-28 13:20:53.755125302 +0000 UTC m=+1788.915893237"
Jul 28 13:20:53.781280 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:53.781202    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2" podStartSLOduration=1.270229825 podStartE2EDuration="1.781183859s" totalImagesPullingTime="510.954034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:20:53.777848072 +0000 UTC m=+1788.938616032" watchObservedRunningTime="2026-07-28 13:20:53.781183859 +0000 UTC m=+1788.941951793"
Jul 28 13:20:59.709864 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:20:59.709827    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:21:04.706997 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:04.706963    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:21:04.707454 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:04.707369    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:21:05.322658 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:05.322556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:21:05.342276 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:05.325340    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:21:05.342276 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:05.331015    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:21:05.342276 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:05.334096    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:21:22.830968 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:22.830926    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"]
Jul 28 13:21:22.831505 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:22.831234    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2" podUID="c10067c9-bd48-46a2-a306-debbd55a907e" containerName="maas-api" containerID="cri-o://fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9" gracePeriod=30
Jul 28 13:21:22.909398 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:22.909360    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"]
Jul 28 13:21:22.909635 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:22.909603    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx" podUID="bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467" containerName="payload-processing" containerID="cri-o://bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f" gracePeriod=30
Jul 28 13:21:22.916965 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:22.916926    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"]
Jul 28 13:21:22.918416 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:22.917202    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69" podUID="54559a17-4737-44c8-a6d9-cfc3253b6b2c" containerName="payload-pre-processing" containerID="cri-o://ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac" gracePeriod=30
Jul 28 13:21:23.197773 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.197749    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:21:23.200122 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.200098    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:21:23.220652 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.220623    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:21:23.223397 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.223375    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-plugins-config-volume\") pod \"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467\" (UID: \"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467\") "
Jul 28 13:21:23.223532 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.223434    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7chr\" (UniqueName: \"kubernetes.io/projected/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-kube-api-access-v7chr\") pod \"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467\" (UID: \"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467\") "
Jul 28 13:21:23.223874 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.223844    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467" (UID: "bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:21:23.225671 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.225647    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-kube-api-access-v7chr" (OuterVolumeSpecName: "kube-api-access-v7chr") pod "bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467" (UID: "bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467"). InnerVolumeSpecName "kube-api-access-v7chr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:21:23.323992 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.323957    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptsft\" (UniqueName: \"kubernetes.io/projected/54559a17-4737-44c8-a6d9-cfc3253b6b2c-kube-api-access-ptsft\") pod \"54559a17-4737-44c8-a6d9-cfc3253b6b2c\" (UID: \"54559a17-4737-44c8-a6d9-cfc3253b6b2c\") "
Jul 28 13:21:23.324207 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.324020    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c10067c9-bd48-46a2-a306-debbd55a907e-openshift-service-ca\") pod \"c10067c9-bd48-46a2-a306-debbd55a907e\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") "
Jul 28 13:21:23.324207 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.324064    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54559a17-4737-44c8-a6d9-cfc3253b6b2c-plugins-config-volume\") pod \"54559a17-4737-44c8-a6d9-cfc3253b6b2c\" (UID: \"54559a17-4737-44c8-a6d9-cfc3253b6b2c\") "
Jul 28 13:21:23.324207 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.324109    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c10067c9-bd48-46a2-a306-debbd55a907e-maas-api-tls\") pod \"c10067c9-bd48-46a2-a306-debbd55a907e\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") "
Jul 28 13:21:23.324207 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.324137    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82bcb\" (UniqueName: \"kubernetes.io/projected/c10067c9-bd48-46a2-a306-debbd55a907e-kube-api-access-82bcb\") pod \"c10067c9-bd48-46a2-a306-debbd55a907e\" (UID: \"c10067c9-bd48-46a2-a306-debbd55a907e\") "
Jul 28 13:21:23.324429 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.324344    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:23.324429 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.324364    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7chr\" (UniqueName: \"kubernetes.io/projected/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467-kube-api-access-v7chr\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:23.324520 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.324433    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c10067c9-bd48-46a2-a306-debbd55a907e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c10067c9-bd48-46a2-a306-debbd55a907e" (UID: "c10067c9-bd48-46a2-a306-debbd55a907e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:21:23.324520 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.324459    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54559a17-4737-44c8-a6d9-cfc3253b6b2c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54559a17-4737-44c8-a6d9-cfc3253b6b2c" (UID: "54559a17-4737-44c8-a6d9-cfc3253b6b2c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:21:23.326471 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.326438    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c10067c9-bd48-46a2-a306-debbd55a907e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c10067c9-bd48-46a2-a306-debbd55a907e" (UID: "c10067c9-bd48-46a2-a306-debbd55a907e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:21:23.326578 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.326508    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c10067c9-bd48-46a2-a306-debbd55a907e-kube-api-access-82bcb" (OuterVolumeSpecName: "kube-api-access-82bcb") pod "c10067c9-bd48-46a2-a306-debbd55a907e" (UID: "c10067c9-bd48-46a2-a306-debbd55a907e"). InnerVolumeSpecName "kube-api-access-82bcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:21:23.326578 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.326529    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54559a17-4737-44c8-a6d9-cfc3253b6b2c-kube-api-access-ptsft" (OuterVolumeSpecName: "kube-api-access-ptsft") pod "54559a17-4737-44c8-a6d9-cfc3253b6b2c" (UID: "54559a17-4737-44c8-a6d9-cfc3253b6b2c"). InnerVolumeSpecName "kube-api-access-ptsft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:21:23.425215 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.425133    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54559a17-4737-44c8-a6d9-cfc3253b6b2c-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:23.425215 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.425168    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c10067c9-bd48-46a2-a306-debbd55a907e-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:23.425215 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.425180    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82bcb\" (UniqueName: \"kubernetes.io/projected/c10067c9-bd48-46a2-a306-debbd55a907e-kube-api-access-82bcb\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:23.425215 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.425189    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptsft\" (UniqueName: \"kubernetes.io/projected/54559a17-4737-44c8-a6d9-cfc3253b6b2c-kube-api-access-ptsft\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:23.425215 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.425199    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c10067c9-bd48-46a2-a306-debbd55a907e-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:23.851246 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.851208    2578 generic.go:356] "Generic (PLEG): container finished" podID="bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467" containerID="bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f" exitCode=0
Jul 28 13:21:23.851676 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.851270    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"
Jul 28 13:21:23.851676 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.851297    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx" event={"ID":"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467","Type":"ContainerDied","Data":"bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f"}
Jul 28 13:21:23.851676 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.851355    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx" event={"ID":"bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467","Type":"ContainerDied","Data":"0424d328d556cdd2e7a8ee8a8bfae1a6137b0281d04f934f38bcbaa4a986cfa1"}
Jul 28 13:21:23.851676 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.851390    2578 scope.go:117] "RemoveContainer" containerID="bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f"
Jul 28 13:21:23.852665 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.852643    2578 generic.go:356] "Generic (PLEG): container finished" podID="c10067c9-bd48-46a2-a306-debbd55a907e" containerID="fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9" exitCode=0
Jul 28 13:21:23.853126 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.852705    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"
Jul 28 13:21:23.853126 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.852696    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2" event={"ID":"c10067c9-bd48-46a2-a306-debbd55a907e","Type":"ContainerDied","Data":"fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9"}
Jul 28 13:21:23.853126 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.852848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2" event={"ID":"c10067c9-bd48-46a2-a306-debbd55a907e","Type":"ContainerDied","Data":"87bec15cf4a2a2ff2bdd87d705c89c377ee9a918964e4ed983c891f23e3ecde1"}
Jul 28 13:21:23.854498 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.854468    2578 generic.go:356] "Generic (PLEG): container finished" podID="54559a17-4737-44c8-a6d9-cfc3253b6b2c" containerID="ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac" exitCode=0
Jul 28 13:21:23.854593 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.854495    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69" event={"ID":"54559a17-4737-44c8-a6d9-cfc3253b6b2c","Type":"ContainerDied","Data":"ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac"}
Jul 28 13:21:23.854593 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.854544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69" event={"ID":"54559a17-4737-44c8-a6d9-cfc3253b6b2c","Type":"ContainerDied","Data":"7af11ed60cccb9897b12fbc6b111b57141c8290a9cc32ef0bbb9eebf61c59df2"}
Jul 28 13:21:23.854593 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.854577    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"
Jul 28 13:21:23.863163 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.863139    2578 scope.go:117] "RemoveContainer" containerID="bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f"
Jul 28 13:21:23.863623 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:21:23.863597    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f\": container with ID starting with bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f not found: ID does not exist" containerID="bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f"
Jul 28 13:21:23.863698 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.863637    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f"} err="failed to get container status \"bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f\": rpc error: code = NotFound desc = could not find container \"bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f\": container with ID starting with bae399158922be079c3c8596ec51be9cbde5f0ac38c0cc40c4243b97022e259f not found: ID does not exist"
Jul 28 13:21:23.863698 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.863664    2578 scope.go:117] "RemoveContainer" containerID="fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9"
Jul 28 13:21:23.872891 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.872825    2578 scope.go:117] "RemoveContainer" containerID="fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9"
Jul 28 13:21:23.873146 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:21:23.873114    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9\": container with ID starting with fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9 not found: ID does not exist" containerID="fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9"
Jul 28 13:21:23.873244 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.873155    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9"} err="failed to get container status \"fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9\": rpc error: code = NotFound desc = could not find container \"fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9\": container with ID starting with fd55d8ade7c58a941bf037c548da8b3072e6c40d50dce4f5a6aab1e6dd704ab9 not found: ID does not exist"
Jul 28 13:21:23.873244 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.873173    2578 scope.go:117] "RemoveContainer" containerID="ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac"
Jul 28 13:21:23.881463 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.881443    2578 scope.go:117] "RemoveContainer" containerID="ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac"
Jul 28 13:21:23.881748 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:21:23.881726    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac\": container with ID starting with ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac not found: ID does not exist" containerID="ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac"
Jul 28 13:21:23.881798 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.881758    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac"} err="failed to get container status \"ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac\": rpc error: code = NotFound desc = could not find container \"ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac\": container with ID starting with ad567f7ec828f0d98bfcef822e2746124558661b085ddc1cb5a81a20953702ac not found: ID does not exist"
Jul 28 13:21:23.886339 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.886313    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"]
Jul 28 13:21:23.894254 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.894229    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-72ce9b01-5b8f6bcb54-2qrlx"]
Jul 28 13:21:23.908702 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.908676    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"]
Jul 28 13:21:23.913020 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.912997    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72ce9b01-85d5f5fc56-xpfr2"]
Jul 28 13:21:23.923738 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.923713    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"]
Jul 28 13:21:23.928051 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:23.928029    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-72ce9b01-5c99685bd8-d9s69"]
Jul 28 13:21:25.271650 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:25.271617    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54559a17-4737-44c8-a6d9-cfc3253b6b2c" path="/var/lib/kubelet/pods/54559a17-4737-44c8-a6d9-cfc3253b6b2c/volumes"
Jul 28 13:21:25.272108 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:25.271977    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467" path="/var/lib/kubelet/pods/bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467/volumes"
Jul 28 13:21:25.272312 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:25.272300    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c10067c9-bd48-46a2-a306-debbd55a907e" path="/var/lib/kubelet/pods/c10067c9-bd48-46a2-a306-debbd55a907e/volumes"
Jul 28 13:21:27.485245 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.485211    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"]
Jul 28 13:21:27.485639 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.485586    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c10067c9-bd48-46a2-a306-debbd55a907e" containerName="maas-api"
Jul 28 13:21:27.485639 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.485598    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c10067c9-bd48-46a2-a306-debbd55a907e" containerName="maas-api"
Jul 28 13:21:27.485639 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.485607    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54559a17-4737-44c8-a6d9-cfc3253b6b2c" containerName="payload-pre-processing"
Jul 28 13:21:27.485639 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.485613    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54559a17-4737-44c8-a6d9-cfc3253b6b2c" containerName="payload-pre-processing"
Jul 28 13:21:27.485639 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.485626    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467" containerName="payload-processing"
Jul 28 13:21:27.485639 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.485632    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467" containerName="payload-processing"
Jul 28 13:21:27.485874 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.485688    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc238bd5-68b1-4f5f-9cfa-5c9f1e18c467" containerName="payload-processing"
Jul 28 13:21:27.485874 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.485698    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c10067c9-bd48-46a2-a306-debbd55a907e" containerName="maas-api"
Jul 28 13:21:27.485874 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.485704    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54559a17-4737-44c8-a6d9-cfc3253b6b2c" containerName="payload-pre-processing"
Jul 28 13:21:27.490395 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.490374    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:27.495585 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.495557    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-0c0ab0cc-serving-cert\""
Jul 28 13:21:27.495761 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.495735    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j6zj5\""
Jul 28 13:21:27.501765 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.501739    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"]
Jul 28 13:21:27.561790 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.561757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkkrk\" (UniqueName: \"kubernetes.io/projected/07e9afe9-6312-41dc-830d-c2b6d2ff9609-kube-api-access-xkkrk\") pod \"maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:27.562023 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.561795    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07e9afe9-6312-41dc-830d-c2b6d2ff9609-openshift-service-ca\") pod \"maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:27.562023 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.561924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07e9afe9-6312-41dc-830d-c2b6d2ff9609-maas-api-tls\") pod \"maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:27.663321 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.663277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkkrk\" (UniqueName: \"kubernetes.io/projected/07e9afe9-6312-41dc-830d-c2b6d2ff9609-kube-api-access-xkkrk\") pod \"maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:27.663321 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.663323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07e9afe9-6312-41dc-830d-c2b6d2ff9609-openshift-service-ca\") pod \"maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:27.663605 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.663373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07e9afe9-6312-41dc-830d-c2b6d2ff9609-maas-api-tls\") pod \"maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:27.663605 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:21:27.663488    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-serving-cert: secret "maas-api-e2e-derive-0c0ab0cc-serving-cert" not found
Jul 28 13:21:27.663605 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:21:27.663554    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07e9afe9-6312-41dc-830d-c2b6d2ff9609-maas-api-tls podName:07e9afe9-6312-41dc-830d-c2b6d2ff9609 nodeName:}" failed. No retries permitted until 2026-07-28 13:21:28.163537178 +0000 UTC m=+1823.324305091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/07e9afe9-6312-41dc-830d-c2b6d2ff9609-maas-api-tls") pod "maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc" (UID: "07e9afe9-6312-41dc-830d-c2b6d2ff9609") : secret "maas-api-e2e-derive-0c0ab0cc-serving-cert" not found
Jul 28 13:21:27.664197 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.664171    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07e9afe9-6312-41dc-830d-c2b6d2ff9609-openshift-service-ca\") pod \"maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:27.673754 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:27.673728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkkrk\" (UniqueName: \"kubernetes.io/projected/07e9afe9-6312-41dc-830d-c2b6d2ff9609-kube-api-access-xkkrk\") pod \"maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:28.167904 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.167857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07e9afe9-6312-41dc-830d-c2b6d2ff9609-maas-api-tls\") pod \"maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:28.170473 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.170442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07e9afe9-6312-41dc-830d-c2b6d2ff9609-maas-api-tls\") pod \"maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:28.399528 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.399490    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"]
Jul 28 13:21:28.401862 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.401843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:28.403127 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.403113    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:28.405905 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.405889    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0c0ab0cc-dockercfg-nkpmk\""
Jul 28 13:21:28.406131 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.406116    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0c0ab0cc\""
Jul 28 13:21:28.413986 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.413958    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"]
Jul 28 13:21:28.444734 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.444697    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"]
Jul 28 13:21:28.449559 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.449534    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:28.461532 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.460481    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"]
Jul 28 13:21:28.474006 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.472419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b358b6-f57d-41c1-a946-e62e1681a8e4-plugins-config-volume\") pod \"payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7\" (UID: \"94b358b6-f57d-41c1-a946-e62e1681a8e4\") " pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:28.474006 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.472467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rws77\" (UniqueName: \"kubernetes.io/projected/94b358b6-f57d-41c1-a946-e62e1681a8e4-kube-api-access-rws77\") pod \"payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7\" (UID: \"94b358b6-f57d-41c1-a946-e62e1681a8e4\") " pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:28.566389 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.566358    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"]
Jul 28 13:21:28.567862 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:21:28.567832    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e9afe9_6312_41dc_830d_c2b6d2ff9609.slice/crio-10f6d0731b19ce3ea289edc812e758d4b30108fe7be4d87f7f3a113a7e5d8306 WatchSource:0}: Error finding container 10f6d0731b19ce3ea289edc812e758d4b30108fe7be4d87f7f3a113a7e5d8306: Status 404 returned error can't find the container with id 10f6d0731b19ce3ea289edc812e758d4b30108fe7be4d87f7f3a113a7e5d8306
Jul 28 13:21:28.573238 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.573211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rws77\" (UniqueName: \"kubernetes.io/projected/94b358b6-f57d-41c1-a946-e62e1681a8e4-kube-api-access-rws77\") pod \"payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7\" (UID: \"94b358b6-f57d-41c1-a946-e62e1681a8e4\") " pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:28.573356 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.573246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5ea763-71cd-4ad7-8280-b9082f28434c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt\" (UID: \"4b5ea763-71cd-4ad7-8280-b9082f28434c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:28.573356 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.573325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzf4l\" (UniqueName: \"kubernetes.io/projected/4b5ea763-71cd-4ad7-8280-b9082f28434c-kube-api-access-lzf4l\") pod \"payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt\" (UID: \"4b5ea763-71cd-4ad7-8280-b9082f28434c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:28.573477 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.573404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b358b6-f57d-41c1-a946-e62e1681a8e4-plugins-config-volume\") pod \"payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7\" (UID: \"94b358b6-f57d-41c1-a946-e62e1681a8e4\") " pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:28.574040 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.574021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b358b6-f57d-41c1-a946-e62e1681a8e4-plugins-config-volume\") pod \"payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7\" (UID: \"94b358b6-f57d-41c1-a946-e62e1681a8e4\") " pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:28.587198 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.587170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rws77\" (UniqueName: \"kubernetes.io/projected/94b358b6-f57d-41c1-a946-e62e1681a8e4-kube-api-access-rws77\") pod \"payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7\" (UID: \"94b358b6-f57d-41c1-a946-e62e1681a8e4\") " pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:28.674218 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.674180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzf4l\" (UniqueName: \"kubernetes.io/projected/4b5ea763-71cd-4ad7-8280-b9082f28434c-kube-api-access-lzf4l\") pod \"payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt\" (UID: \"4b5ea763-71cd-4ad7-8280-b9082f28434c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:28.674420 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.674236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5ea763-71cd-4ad7-8280-b9082f28434c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt\" (UID: \"4b5ea763-71cd-4ad7-8280-b9082f28434c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:28.675004 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.674977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5ea763-71cd-4ad7-8280-b9082f28434c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt\" (UID: \"4b5ea763-71cd-4ad7-8280-b9082f28434c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:28.684966 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.684893    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzf4l\" (UniqueName: \"kubernetes.io/projected/4b5ea763-71cd-4ad7-8280-b9082f28434c-kube-api-access-lzf4l\") pod \"payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt\" (UID: \"4b5ea763-71cd-4ad7-8280-b9082f28434c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:28.736400 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.736364    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:28.765436 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.765398    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:28.883494 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.883453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc" event={"ID":"07e9afe9-6312-41dc-830d-c2b6d2ff9609","Type":"ContainerStarted","Data":"10f6d0731b19ce3ea289edc812e758d4b30108fe7be4d87f7f3a113a7e5d8306"}
Jul 28 13:21:28.896889 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.896768    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"]
Jul 28 13:21:28.898389 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:21:28.898353    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b358b6_f57d_41c1_a946_e62e1681a8e4.slice/crio-f6ff0b30e1eec727171f431a40af2a0f6962489ed567b9a4e0b746fad1ecf88d WatchSource:0}: Error finding container f6ff0b30e1eec727171f431a40af2a0f6962489ed567b9a4e0b746fad1ecf88d: Status 404 returned error can't find the container with id f6ff0b30e1eec727171f431a40af2a0f6962489ed567b9a4e0b746fad1ecf88d
Jul 28 13:21:28.924597 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:28.924569    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"]
Jul 28 13:21:28.926220 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:21:28.926194    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5ea763_71cd_4ad7_8280_b9082f28434c.slice/crio-b321d6e2b0ccdbb7f6f85189c3c41c3ff2e9913e68f959b3c8349f7fb5a30d84 WatchSource:0}: Error finding container b321d6e2b0ccdbb7f6f85189c3c41c3ff2e9913e68f959b3c8349f7fb5a30d84: Status 404 returned error can't find the container with id b321d6e2b0ccdbb7f6f85189c3c41c3ff2e9913e68f959b3c8349f7fb5a30d84
Jul 28 13:21:29.889997 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:29.889960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7" event={"ID":"94b358b6-f57d-41c1-a946-e62e1681a8e4","Type":"ContainerStarted","Data":"4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e"}
Jul 28 13:21:29.890671 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:29.890028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7" event={"ID":"94b358b6-f57d-41c1-a946-e62e1681a8e4","Type":"ContainerStarted","Data":"f6ff0b30e1eec727171f431a40af2a0f6962489ed567b9a4e0b746fad1ecf88d"}
Jul 28 13:21:29.890671 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:29.890056    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:29.891555 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:29.891524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt" event={"ID":"4b5ea763-71cd-4ad7-8280-b9082f28434c","Type":"ContainerStarted","Data":"bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea"}
Jul 28 13:21:29.891716 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:29.891583    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:29.891716 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:29.891610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt" event={"ID":"4b5ea763-71cd-4ad7-8280-b9082f28434c","Type":"ContainerStarted","Data":"b321d6e2b0ccdbb7f6f85189c3c41c3ff2e9913e68f959b3c8349f7fb5a30d84"}
Jul 28 13:21:29.892977 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:29.892954    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc" event={"ID":"07e9afe9-6312-41dc-830d-c2b6d2ff9609","Type":"ContainerStarted","Data":"a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d"}
Jul 28 13:21:29.893091 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:29.893003    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:29.920722 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:29.920671    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7" podStartSLOduration=1.9206561070000001 podStartE2EDuration="1.920656107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:21:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:21:29.917875631 +0000 UTC m=+1825.078643565" watchObservedRunningTime="2026-07-28 13:21:29.920656107 +0000 UTC m=+1825.081424035"
Jul 28 13:21:29.944912 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:29.944861    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc" podStartSLOduration=2.427177581 podStartE2EDuration="2.944841194s" totalImagesPullingTime="517.663613ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:21:29.942938346 +0000 UTC m=+1825.103706304" watchObservedRunningTime="2026-07-28 13:21:29.944841194 +0000 UTC m=+1825.105609128"
Jul 28 13:21:29.966726 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:29.966674    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt" podStartSLOduration=1.966655458 podStartE2EDuration="1.966655458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:21:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:21:29.964318131 +0000 UTC m=+1825.125086068" watchObservedRunningTime="2026-07-28 13:21:29.966655458 +0000 UTC m=+1825.127423394"
Jul 28 13:21:35.904046 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:35.904009    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:40.900798 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:40.900757    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:40.901206 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:40.900865    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:58.051829 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.051779    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"]
Jul 28 13:21:58.052393 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.052051    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc" podUID="07e9afe9-6312-41dc-830d-c2b6d2ff9609" containerName="maas-api" containerID="cri-o://a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d" gracePeriod=30
Jul 28 13:21:58.115102 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.115010    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"]
Jul 28 13:21:58.115424 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.115361    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7" podUID="94b358b6-f57d-41c1-a946-e62e1681a8e4" containerName="payload-processing" containerID="cri-o://4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e" gracePeriod=30
Jul 28 13:21:58.124074 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.122929    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"]
Jul 28 13:21:58.124074 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.123164    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt" podUID="4b5ea763-71cd-4ad7-8280-b9082f28434c" containerName="payload-pre-processing" containerID="cri-o://bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea" gracePeriod=30
Jul 28 13:21:58.411557 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.411530    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:58.433415 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.433387    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:58.444754 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.444728    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:58.454745 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.454718    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rws77\" (UniqueName: \"kubernetes.io/projected/94b358b6-f57d-41c1-a946-e62e1681a8e4-kube-api-access-rws77\") pod \"94b358b6-f57d-41c1-a946-e62e1681a8e4\" (UID: \"94b358b6-f57d-41c1-a946-e62e1681a8e4\") "
Jul 28 13:21:58.454889 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.454753    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b358b6-f57d-41c1-a946-e62e1681a8e4-plugins-config-volume\") pod \"94b358b6-f57d-41c1-a946-e62e1681a8e4\" (UID: \"94b358b6-f57d-41c1-a946-e62e1681a8e4\") "
Jul 28 13:21:58.454889 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.454790    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5ea763-71cd-4ad7-8280-b9082f28434c-plugins-config-volume\") pod \"4b5ea763-71cd-4ad7-8280-b9082f28434c\" (UID: \"4b5ea763-71cd-4ad7-8280-b9082f28434c\") "
Jul 28 13:21:58.454889 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.454841    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07e9afe9-6312-41dc-830d-c2b6d2ff9609-maas-api-tls\") pod \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") "
Jul 28 13:21:58.454889 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.454885    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkkrk\" (UniqueName: \"kubernetes.io/projected/07e9afe9-6312-41dc-830d-c2b6d2ff9609-kube-api-access-xkkrk\") pod \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") "
Jul 28 13:21:58.455126 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.454935    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07e9afe9-6312-41dc-830d-c2b6d2ff9609-openshift-service-ca\") pod \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\" (UID: \"07e9afe9-6312-41dc-830d-c2b6d2ff9609\") "
Jul 28 13:21:58.455126 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.454962    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzf4l\" (UniqueName: \"kubernetes.io/projected/4b5ea763-71cd-4ad7-8280-b9082f28434c-kube-api-access-lzf4l\") pod \"4b5ea763-71cd-4ad7-8280-b9082f28434c\" (UID: \"4b5ea763-71cd-4ad7-8280-b9082f28434c\") "
Jul 28 13:21:58.455234 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.455181    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94b358b6-f57d-41c1-a946-e62e1681a8e4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94b358b6-f57d-41c1-a946-e62e1681a8e4" (UID: "94b358b6-f57d-41c1-a946-e62e1681a8e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:21:58.455283 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.455220    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b5ea763-71cd-4ad7-8280-b9082f28434c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b5ea763-71cd-4ad7-8280-b9082f28434c" (UID: "4b5ea763-71cd-4ad7-8280-b9082f28434c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:21:58.455336 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.455279    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b358b6-f57d-41c1-a946-e62e1681a8e4-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:58.455900 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.455752    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e9afe9-6312-41dc-830d-c2b6d2ff9609-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "07e9afe9-6312-41dc-830d-c2b6d2ff9609" (UID: "07e9afe9-6312-41dc-830d-c2b6d2ff9609"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:21:58.457298 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.457277    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e9afe9-6312-41dc-830d-c2b6d2ff9609-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "07e9afe9-6312-41dc-830d-c2b6d2ff9609" (UID: "07e9afe9-6312-41dc-830d-c2b6d2ff9609"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:21:58.457298 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.457286    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b358b6-f57d-41c1-a946-e62e1681a8e4-kube-api-access-rws77" (OuterVolumeSpecName: "kube-api-access-rws77") pod "94b358b6-f57d-41c1-a946-e62e1681a8e4" (UID: "94b358b6-f57d-41c1-a946-e62e1681a8e4"). InnerVolumeSpecName "kube-api-access-rws77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:21:58.457418 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.457323    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b5ea763-71cd-4ad7-8280-b9082f28434c-kube-api-access-lzf4l" (OuterVolumeSpecName: "kube-api-access-lzf4l") pod "4b5ea763-71cd-4ad7-8280-b9082f28434c" (UID: "4b5ea763-71cd-4ad7-8280-b9082f28434c"). InnerVolumeSpecName "kube-api-access-lzf4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:21:58.457508 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.457493    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e9afe9-6312-41dc-830d-c2b6d2ff9609-kube-api-access-xkkrk" (OuterVolumeSpecName: "kube-api-access-xkkrk") pod "07e9afe9-6312-41dc-830d-c2b6d2ff9609" (UID: "07e9afe9-6312-41dc-830d-c2b6d2ff9609"). InnerVolumeSpecName "kube-api-access-xkkrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:21:58.556509 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.556473    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07e9afe9-6312-41dc-830d-c2b6d2ff9609-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:58.556509 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.556504    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzf4l\" (UniqueName: \"kubernetes.io/projected/4b5ea763-71cd-4ad7-8280-b9082f28434c-kube-api-access-lzf4l\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:58.556509 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.556514    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rws77\" (UniqueName: \"kubernetes.io/projected/94b358b6-f57d-41c1-a946-e62e1681a8e4-kube-api-access-rws77\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:58.556761 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.556523    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5ea763-71cd-4ad7-8280-b9082f28434c-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:58.556761 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.556533    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07e9afe9-6312-41dc-830d-c2b6d2ff9609-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:58.556761 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:58.556540    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkkrk\" (UniqueName: \"kubernetes.io/projected/07e9afe9-6312-41dc-830d-c2b6d2ff9609-kube-api-access-xkkrk\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:21:59.040952 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.040915    2578 generic.go:356] "Generic (PLEG): container finished" podID="94b358b6-f57d-41c1-a946-e62e1681a8e4" containerID="4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e" exitCode=0
Jul 28 13:21:59.041146 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.040961    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"
Jul 28 13:21:59.041146 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.041009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7" event={"ID":"94b358b6-f57d-41c1-a946-e62e1681a8e4","Type":"ContainerDied","Data":"4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e"}
Jul 28 13:21:59.041146 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.041066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7" event={"ID":"94b358b6-f57d-41c1-a946-e62e1681a8e4","Type":"ContainerDied","Data":"f6ff0b30e1eec727171f431a40af2a0f6962489ed567b9a4e0b746fad1ecf88d"}
Jul 28 13:21:59.041146 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.041090    2578 scope.go:117] "RemoveContainer" containerID="4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e"
Jul 28 13:21:59.042306 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.042276    2578 generic.go:356] "Generic (PLEG): container finished" podID="4b5ea763-71cd-4ad7-8280-b9082f28434c" containerID="bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea" exitCode=0
Jul 28 13:21:59.042399 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.042320    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"
Jul 28 13:21:59.042399 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.042325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt" event={"ID":"4b5ea763-71cd-4ad7-8280-b9082f28434c","Type":"ContainerDied","Data":"bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea"}
Jul 28 13:21:59.042399 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.042368    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt" event={"ID":"4b5ea763-71cd-4ad7-8280-b9082f28434c","Type":"ContainerDied","Data":"b321d6e2b0ccdbb7f6f85189c3c41c3ff2e9913e68f959b3c8349f7fb5a30d84"}
Jul 28 13:21:59.043846 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.043798    2578 generic.go:356] "Generic (PLEG): container finished" podID="07e9afe9-6312-41dc-830d-c2b6d2ff9609" containerID="a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d" exitCode=0
Jul 28 13:21:59.043952 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.043835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc" event={"ID":"07e9afe9-6312-41dc-830d-c2b6d2ff9609","Type":"ContainerDied","Data":"a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d"}
Jul 28 13:21:59.043952 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.043857    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"
Jul 28 13:21:59.043952 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.043888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc" event={"ID":"07e9afe9-6312-41dc-830d-c2b6d2ff9609","Type":"ContainerDied","Data":"10f6d0731b19ce3ea289edc812e758d4b30108fe7be4d87f7f3a113a7e5d8306"}
Jul 28 13:21:59.051214 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.051195    2578 scope.go:117] "RemoveContainer" containerID="4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e"
Jul 28 13:21:59.051557 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:21:59.051497    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e\": container with ID starting with 4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e not found: ID does not exist" containerID="4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e"
Jul 28 13:21:59.051557 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.051539    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e"} err="failed to get container status \"4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e\": rpc error: code = NotFound desc = could not find container \"4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e\": container with ID starting with 4bde7523ca3b92943f685ba48be8537788453147097155f41ce87482104d508e not found: ID does not exist"
Jul 28 13:21:59.051694 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.051563    2578 scope.go:117] "RemoveContainer" containerID="bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea"
Jul 28 13:21:59.060636 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.060619    2578 scope.go:117] "RemoveContainer" containerID="bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea"
Jul 28 13:21:59.060983 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:21:59.060964    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea\": container with ID starting with bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea not found: ID does not exist" containerID="bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea"
Jul 28 13:21:59.061028 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.060992    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea"} err="failed to get container status \"bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea\": rpc error: code = NotFound desc = could not find container \"bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea\": container with ID starting with bf137f7bdc7fb5f034974da788e66fa78df5ca8c7077c6bea3d3841da3b69bea not found: ID does not exist"
Jul 28 13:21:59.061028 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.061010    2578 scope.go:117] "RemoveContainer" containerID="a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d"
Jul 28 13:21:59.067922 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.067892    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"]
Jul 28 13:21:59.069830 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.069798    2578 scope.go:117] "RemoveContainer" containerID="a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d"
Jul 28 13:21:59.070097 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:21:59.070074    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d\": container with ID starting with a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d not found: ID does not exist" containerID="a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d"
Jul 28 13:21:59.070176 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.070103    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d"} err="failed to get container status \"a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d\": rpc error: code = NotFound desc = could not find container \"a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d\": container with ID starting with a0a1538e2642dec613138b59bef6eb6b135957bd5c28228e6bb9321d8287573d not found: ID does not exist"
Jul 28 13:21:59.073476 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.073453    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0c0ab0cc-7555d9d46-cvqn7"]
Jul 28 13:21:59.086578 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.086549    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"]
Jul 28 13:21:59.090905 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.090880    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0c0ab0cc-5c978bb45b-2pvmc"]
Jul 28 13:21:59.102928 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.102899    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"]
Jul 28 13:21:59.109585 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.109554    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0c0ab0cc-84fdbb887b-t7rlt"]
Jul 28 13:21:59.272750 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.272716    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e9afe9-6312-41dc-830d-c2b6d2ff9609" path="/var/lib/kubelet/pods/07e9afe9-6312-41dc-830d-c2b6d2ff9609/volumes"
Jul 28 13:21:59.273104 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.273090    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b5ea763-71cd-4ad7-8280-b9082f28434c" path="/var/lib/kubelet/pods/4b5ea763-71cd-4ad7-8280-b9082f28434c/volumes"
Jul 28 13:21:59.273418 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:21:59.273405    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94b358b6-f57d-41c1-a946-e62e1681a8e4" path="/var/lib/kubelet/pods/94b358b6-f57d-41c1-a946-e62e1681a8e4/volumes"
Jul 28 13:23:46.891594 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.891551    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"]
Jul 28 13:23:46.892242 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.892130    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b358b6-f57d-41c1-a946-e62e1681a8e4" containerName="payload-processing"
Jul 28 13:23:46.892242 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.892148    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b358b6-f57d-41c1-a946-e62e1681a8e4" containerName="payload-processing"
Jul 28 13:23:46.892242 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.892161    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e9afe9-6312-41dc-830d-c2b6d2ff9609" containerName="maas-api"
Jul 28 13:23:46.892242 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.892170    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e9afe9-6312-41dc-830d-c2b6d2ff9609" containerName="maas-api"
Jul 28 13:23:46.892242 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.892180    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b5ea763-71cd-4ad7-8280-b9082f28434c" containerName="payload-pre-processing"
Jul 28 13:23:46.892242 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.892189    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b5ea763-71cd-4ad7-8280-b9082f28434c" containerName="payload-pre-processing"
Jul 28 13:23:46.892649 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.892284    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e9afe9-6312-41dc-830d-c2b6d2ff9609" containerName="maas-api"
Jul 28 13:23:46.892649 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.892296    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b5ea763-71cd-4ad7-8280-b9082f28434c" containerName="payload-pre-processing"
Jul 28 13:23:46.892649 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.892307    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="94b358b6-f57d-41c1-a946-e62e1681a8e4" containerName="payload-processing"
Jul 28 13:23:46.895917 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.895895    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:46.898846 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.898794    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a757517a-serving-cert\""
Jul 28 13:23:46.898986 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.898869    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j6zj5\""
Jul 28 13:23:46.908058 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:46.908034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"]
Jul 28 13:23:47.028619 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.028587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-maas-api-tls\") pod \"maas-api-e2e-mt-a757517a-646946678b-6nwq5\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:47.028799 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.028663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blvg2\" (UniqueName: \"kubernetes.io/projected/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-kube-api-access-blvg2\") pod \"maas-api-e2e-mt-a757517a-646946678b-6nwq5\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:47.028799 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.028714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-openshift-service-ca\") pod \"maas-api-e2e-mt-a757517a-646946678b-6nwq5\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:47.129974 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.129942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-openshift-service-ca\") pod \"maas-api-e2e-mt-a757517a-646946678b-6nwq5\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:47.130165 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.129994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-maas-api-tls\") pod \"maas-api-e2e-mt-a757517a-646946678b-6nwq5\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:47.130165 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.130069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blvg2\" (UniqueName: \"kubernetes.io/projected/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-kube-api-access-blvg2\") pod \"maas-api-e2e-mt-a757517a-646946678b-6nwq5\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:47.130558 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.130534    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-openshift-service-ca\") pod \"maas-api-e2e-mt-a757517a-646946678b-6nwq5\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:47.132654 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.132632    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-maas-api-tls\") pod \"maas-api-e2e-mt-a757517a-646946678b-6nwq5\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:47.139379 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.139351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blvg2\" (UniqueName: \"kubernetes.io/projected/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-kube-api-access-blvg2\") pod \"maas-api-e2e-mt-a757517a-646946678b-6nwq5\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:47.208215 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.208111    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:47.348591 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.348562    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"]
Jul 28 13:23:47.350402 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:23:47.350368    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67b6b40_4bb6_4bd9_bcbb_b9a28664d10c.slice/crio-95fc567d15f00022f95d022265e4a905bc22aaa57df1d76c39056a276b3b1d93 WatchSource:0}: Error finding container 95fc567d15f00022f95d022265e4a905bc22aaa57df1d76c39056a276b3b1d93: Status 404 returned error can't find the container with id 95fc567d15f00022f95d022265e4a905bc22aaa57df1d76c39056a276b3b1d93
Jul 28 13:23:47.555281 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.555236    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5" event={"ID":"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c","Type":"ContainerStarted","Data":"95fc567d15f00022f95d022265e4a905bc22aaa57df1d76c39056a276b3b1d93"}
Jul 28 13:23:47.727034 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.726999    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"]
Jul 28 13:23:47.731598 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.731581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:23:47.734406 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.734382    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a757517a-dockercfg-v6v2n\""
Jul 28 13:23:47.734548 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.734419    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a757517a\""
Jul 28 13:23:47.740416 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.740394    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"]
Jul 28 13:23:47.835068 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.834971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jtfj\" (UniqueName: \"kubernetes.io/projected/adf88382-ffea-4cf2-8db0-6b260aed67f4-kube-api-access-2jtfj\") pod \"payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7\" (UID: \"adf88382-ffea-4cf2-8db0-6b260aed67f4\") " pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:23:47.835068 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.835017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adf88382-ffea-4cf2-8db0-6b260aed67f4-plugins-config-volume\") pod \"payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7\" (UID: \"adf88382-ffea-4cf2-8db0-6b260aed67f4\") " pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:23:47.936186 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.936148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jtfj\" (UniqueName: \"kubernetes.io/projected/adf88382-ffea-4cf2-8db0-6b260aed67f4-kube-api-access-2jtfj\") pod \"payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7\" (UID: \"adf88382-ffea-4cf2-8db0-6b260aed67f4\") " pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:23:47.936599 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.936197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adf88382-ffea-4cf2-8db0-6b260aed67f4-plugins-config-volume\") pod \"payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7\" (UID: \"adf88382-ffea-4cf2-8db0-6b260aed67f4\") " pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:23:47.936895 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.936875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adf88382-ffea-4cf2-8db0-6b260aed67f4-plugins-config-volume\") pod \"payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7\" (UID: \"adf88382-ffea-4cf2-8db0-6b260aed67f4\") " pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:23:47.944536 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:47.944509    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jtfj\" (UniqueName: \"kubernetes.io/projected/adf88382-ffea-4cf2-8db0-6b260aed67f4-kube-api-access-2jtfj\") pod \"payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7\" (UID: \"adf88382-ffea-4cf2-8db0-6b260aed67f4\") " pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:23:48.043722 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:48.043697    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:23:48.210951 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:23:48.210922    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf88382_ffea_4cf2_8db0_6b260aed67f4.slice/crio-07d4d83d4527fba722618ee44128ea80a512f022e4ee74806e30e7abfd40b877 WatchSource:0}: Error finding container 07d4d83d4527fba722618ee44128ea80a512f022e4ee74806e30e7abfd40b877: Status 404 returned error can't find the container with id 07d4d83d4527fba722618ee44128ea80a512f022e4ee74806e30e7abfd40b877
Jul 28 13:23:48.212650 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:48.212627    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"]
Jul 28 13:23:48.562591 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:48.562552    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7" event={"ID":"adf88382-ffea-4cf2-8db0-6b260aed67f4","Type":"ContainerStarted","Data":"6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f"}
Jul 28 13:23:48.562793 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:48.562613    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:23:48.562793 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:48.562639    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7" event={"ID":"adf88382-ffea-4cf2-8db0-6b260aed67f4","Type":"ContainerStarted","Data":"07d4d83d4527fba722618ee44128ea80a512f022e4ee74806e30e7abfd40b877"}
Jul 28 13:23:48.564276 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:48.564250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5" event={"ID":"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c","Type":"ContainerStarted","Data":"2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d"}
Jul 28 13:23:48.564412 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:48.564294    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:48.580037 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:48.579992    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7" podStartSLOduration=1.579977155 podStartE2EDuration="1.579977155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:23:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:23:48.578493801 +0000 UTC m=+1963.739261734" watchObservedRunningTime="2026-07-28 13:23:48.579977155 +0000 UTC m=+1963.740745089"
Jul 28 13:23:48.595588 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:48.595538    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5" podStartSLOduration=1.985265469 podStartE2EDuration="2.595522176s" totalImagesPullingTime="610.256707ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:23:48.594799227 +0000 UTC m=+1963.755567195" watchObservedRunningTime="2026-07-28 13:23:48.595522176 +0000 UTC m=+1963.756290150"
Jul 28 13:23:54.574760 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:54.574731    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:23:59.571986 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:23:59.571896    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:24:29.941787 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:29.941751    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"]
Jul 28 13:24:29.942398 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:29.942003    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5" podUID="f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c" containerName="maas-api" containerID="cri-o://2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d" gracePeriod=30
Jul 28 13:24:29.997726 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:29.997691    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"]
Jul 28 13:24:29.998042 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:29.997995    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7" podUID="adf88382-ffea-4cf2-8db0-6b260aed67f4" containerName="payload-processing" containerID="cri-o://6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f" gracePeriod=30
Jul 28 13:24:30.276007 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.275982    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:24:30.278939 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.278918    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:24:30.310559 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.310461    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-maas-api-tls\") pod \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") "
Jul 28 13:24:30.310559 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.310544    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blvg2\" (UniqueName: \"kubernetes.io/projected/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-kube-api-access-blvg2\") pod \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") "
Jul 28 13:24:30.310788 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.310592    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-openshift-service-ca\") pod \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\" (UID: \"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c\") "
Jul 28 13:24:30.310788 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.310634    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adf88382-ffea-4cf2-8db0-6b260aed67f4-plugins-config-volume\") pod \"adf88382-ffea-4cf2-8db0-6b260aed67f4\" (UID: \"adf88382-ffea-4cf2-8db0-6b260aed67f4\") "
Jul 28 13:24:30.310788 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.310684    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jtfj\" (UniqueName: \"kubernetes.io/projected/adf88382-ffea-4cf2-8db0-6b260aed67f4-kube-api-access-2jtfj\") pod \"adf88382-ffea-4cf2-8db0-6b260aed67f4\" (UID: \"adf88382-ffea-4cf2-8db0-6b260aed67f4\") "
Jul 28 13:24:30.311180 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.311111    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c" (UID: "f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:24:30.311285 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.311192    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf88382-ffea-4cf2-8db0-6b260aed67f4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "adf88382-ffea-4cf2-8db0-6b260aed67f4" (UID: "adf88382-ffea-4cf2-8db0-6b260aed67f4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:24:30.313205 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.313183    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-kube-api-access-blvg2" (OuterVolumeSpecName: "kube-api-access-blvg2") pod "f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c" (UID: "f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c"). InnerVolumeSpecName "kube-api-access-blvg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:24:30.313588 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.313567    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c" (UID: "f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:24:30.313657 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.313599    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf88382-ffea-4cf2-8db0-6b260aed67f4-kube-api-access-2jtfj" (OuterVolumeSpecName: "kube-api-access-2jtfj") pod "adf88382-ffea-4cf2-8db0-6b260aed67f4" (UID: "adf88382-ffea-4cf2-8db0-6b260aed67f4"). InnerVolumeSpecName "kube-api-access-2jtfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:24:30.412298 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.412261    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blvg2\" (UniqueName: \"kubernetes.io/projected/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-kube-api-access-blvg2\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:24:30.412298 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.412290    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:24:30.412298 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.412300    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adf88382-ffea-4cf2-8db0-6b260aed67f4-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:24:30.412298 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.412308    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jtfj\" (UniqueName: \"kubernetes.io/projected/adf88382-ffea-4cf2-8db0-6b260aed67f4-kube-api-access-2jtfj\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:24:30.412576 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.412317    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:24:30.765735 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.765694    2578 generic.go:356] "Generic (PLEG): container finished" podID="f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c" containerID="2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d" exitCode=0
Jul 28 13:24:30.765735 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.765738    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"
Jul 28 13:24:30.766013 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.765777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5" event={"ID":"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c","Type":"ContainerDied","Data":"2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d"}
Jul 28 13:24:30.766013 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.765849    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5" event={"ID":"f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c","Type":"ContainerDied","Data":"95fc567d15f00022f95d022265e4a905bc22aaa57df1d76c39056a276b3b1d93"}
Jul 28 13:24:30.766013 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.765882    2578 scope.go:117] "RemoveContainer" containerID="2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d"
Jul 28 13:24:30.767159 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.767127    2578 generic.go:356] "Generic (PLEG): container finished" podID="adf88382-ffea-4cf2-8db0-6b260aed67f4" containerID="6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f" exitCode=0
Jul 28 13:24:30.767159 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.767158    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7" event={"ID":"adf88382-ffea-4cf2-8db0-6b260aed67f4","Type":"ContainerDied","Data":"6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f"}
Jul 28 13:24:30.767294 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.767177    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"
Jul 28 13:24:30.767294 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.767187    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7" event={"ID":"adf88382-ffea-4cf2-8db0-6b260aed67f4","Type":"ContainerDied","Data":"07d4d83d4527fba722618ee44128ea80a512f022e4ee74806e30e7abfd40b877"}
Jul 28 13:24:30.776834 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.776791    2578 scope.go:117] "RemoveContainer" containerID="2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d"
Jul 28 13:24:30.777152 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:24:30.777071    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d\": container with ID starting with 2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d not found: ID does not exist" containerID="2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d"
Jul 28 13:24:30.777152 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.777108    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d"} err="failed to get container status \"2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d\": rpc error: code = NotFound desc = could not find container \"2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d\": container with ID starting with 2227bc66ba566aabb587e0ce2527b8ce844b635042c48e5071c3f1eb1f27b79d not found: ID does not exist"
Jul 28 13:24:30.777152 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.777128    2578 scope.go:117] "RemoveContainer" containerID="6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f"
Jul 28 13:24:30.784888 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.784868    2578 scope.go:117] "RemoveContainer" containerID="6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f"
Jul 28 13:24:30.785111 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:24:30.785095    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f\": container with ID starting with 6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f not found: ID does not exist" containerID="6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f"
Jul 28 13:24:30.785162 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.785118    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f"} err="failed to get container status \"6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f\": rpc error: code = NotFound desc = could not find container \"6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f\": container with ID starting with 6894525bae7208a4bd8e0b3f4d8e93e5b9b0cad73a05a7fc6052086ee416ad1f not found: ID does not exist"
Jul 28 13:24:30.788899 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.788876    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"]
Jul 28 13:24:30.792053 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.792030    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a757517a-646946678b-6nwq5"]
Jul 28 13:24:30.801852 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.801831    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"]
Jul 28 13:24:30.811059 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:30.807602    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a757517a-579fb7bfb6-7wpt7"]
Jul 28 13:24:31.272842 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:31.272787    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf88382-ffea-4cf2-8db0-6b260aed67f4" path="/var/lib/kubelet/pods/adf88382-ffea-4cf2-8db0-6b260aed67f4/volumes"
Jul 28 13:24:31.273229 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:24:31.273214    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c" path="/var/lib/kubelet/pods/f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c/volumes"
Jul 28 13:25:00.354099 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.354064    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"]
Jul 28 13:25:00.354531 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.354511    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c" containerName="maas-api"
Jul 28 13:25:00.354578 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.354537    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c" containerName="maas-api"
Jul 28 13:25:00.354578 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.354573    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf88382-ffea-4cf2-8db0-6b260aed67f4" containerName="payload-processing"
Jul 28 13:25:00.354644 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.354583    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf88382-ffea-4cf2-8db0-6b260aed67f4" containerName="payload-processing"
Jul 28 13:25:00.354686 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.354675    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf88382-ffea-4cf2-8db0-6b260aed67f4" containerName="payload-processing"
Jul 28 13:25:00.354721 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.354689    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f67b6b40-4bb6-4bd9-bcbb-b9a28664d10c" containerName="maas-api"
Jul 28 13:25:00.357818 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.357792    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:00.360875 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.360850    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-11cb60ac-serving-cert\""
Jul 28 13:25:00.360875 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.360864    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j6zj5\""
Jul 28 13:25:00.369879 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.369860    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"]
Jul 28 13:25:00.488116 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.488081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/691c28df-0c56-4f1b-a245-3376e8a69312-maas-api-tls\") pod \"maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:00.488291 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.488166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/691c28df-0c56-4f1b-a245-3376e8a69312-openshift-service-ca\") pod \"maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:00.488291 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.488225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsdkg\" (UniqueName: \"kubernetes.io/projected/691c28df-0c56-4f1b-a245-3376e8a69312-kube-api-access-wsdkg\") pod \"maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:00.589027 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.588980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/691c28df-0c56-4f1b-a245-3376e8a69312-openshift-service-ca\") pod \"maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:00.589215 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.589058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsdkg\" (UniqueName: \"kubernetes.io/projected/691c28df-0c56-4f1b-a245-3376e8a69312-kube-api-access-wsdkg\") pod \"maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:00.589215 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.589133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/691c28df-0c56-4f1b-a245-3376e8a69312-maas-api-tls\") pod \"maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:00.589301 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:25:00.589281    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-serving-cert: secret "maas-api-e2e-mt-11cb60ac-serving-cert" not found
Jul 28 13:25:00.589364 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:25:00.589352    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/691c28df-0c56-4f1b-a245-3376e8a69312-maas-api-tls podName:691c28df-0c56-4f1b-a245-3376e8a69312 nodeName:}" failed. No retries permitted until 2026-07-28 13:25:01.089333782 +0000 UTC m=+2036.250101695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/691c28df-0c56-4f1b-a245-3376e8a69312-maas-api-tls") pod "maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk" (UID: "691c28df-0c56-4f1b-a245-3376e8a69312") : secret "maas-api-e2e-mt-11cb60ac-serving-cert" not found
Jul 28 13:25:00.589703 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.589685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/691c28df-0c56-4f1b-a245-3376e8a69312-openshift-service-ca\") pod \"maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:00.598375 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:00.598344    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsdkg\" (UniqueName: \"kubernetes.io/projected/691c28df-0c56-4f1b-a245-3376e8a69312-kube-api-access-wsdkg\") pod \"maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:01.093712 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.093659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/691c28df-0c56-4f1b-a245-3376e8a69312-maas-api-tls\") pod \"maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:01.096473 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.096446    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/691c28df-0c56-4f1b-a245-3376e8a69312-maas-api-tls\") pod \"maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:01.268375 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.268345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:01.288876 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.288843    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"]
Jul 28 13:25:01.292491 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.292470    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:25:01.295306 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.295280    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-11cb60ac-dockercfg-v2sfg\""
Jul 28 13:25:01.295435 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.295323    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-11cb60ac\""
Jul 28 13:25:01.302113 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.302089    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"]
Jul 28 13:25:01.395700 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.395667    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86kqx\" (UniqueName: \"kubernetes.io/projected/2afc61ea-fc3b-46b2-a06d-8045cf314168-kube-api-access-86kqx\") pod \"payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8\" (UID: \"2afc61ea-fc3b-46b2-a06d-8045cf314168\") " pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:25:01.396100 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.395847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2afc61ea-fc3b-46b2-a06d-8045cf314168-plugins-config-volume\") pod \"payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8\" (UID: \"2afc61ea-fc3b-46b2-a06d-8045cf314168\") " pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:25:01.414316 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.414290    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"]
Jul 28 13:25:01.417035 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:25:01.416995    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691c28df_0c56_4f1b_a245_3376e8a69312.slice/crio-39e194838853d866b2082e5ddadc551b71450c14511bcff4b7fb5f59dd0c10ef WatchSource:0}: Error finding container 39e194838853d866b2082e5ddadc551b71450c14511bcff4b7fb5f59dd0c10ef: Status 404 returned error can't find the container with id 39e194838853d866b2082e5ddadc551b71450c14511bcff4b7fb5f59dd0c10ef
Jul 28 13:25:01.418393 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.418371    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:25:01.497125 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.497090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86kqx\" (UniqueName: \"kubernetes.io/projected/2afc61ea-fc3b-46b2-a06d-8045cf314168-kube-api-access-86kqx\") pod \"payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8\" (UID: \"2afc61ea-fc3b-46b2-a06d-8045cf314168\") " pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:25:01.497353 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.497210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2afc61ea-fc3b-46b2-a06d-8045cf314168-plugins-config-volume\") pod \"payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8\" (UID: \"2afc61ea-fc3b-46b2-a06d-8045cf314168\") " pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:25:01.497948 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.497924    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2afc61ea-fc3b-46b2-a06d-8045cf314168-plugins-config-volume\") pod \"payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8\" (UID: \"2afc61ea-fc3b-46b2-a06d-8045cf314168\") " pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:25:01.505864 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.505843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86kqx\" (UniqueName: \"kubernetes.io/projected/2afc61ea-fc3b-46b2-a06d-8045cf314168-kube-api-access-86kqx\") pod \"payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8\" (UID: \"2afc61ea-fc3b-46b2-a06d-8045cf314168\") " pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:25:01.605938 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.605904    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:25:01.747355 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.747330    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"]
Jul 28 13:25:01.749656 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:25:01.749626    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2afc61ea_fc3b_46b2_a06d_8045cf314168.slice/crio-838bae1adaf0edd7e8cb253bcc9bcefa8207863e7d8cb8f66fbe9361805b02be WatchSource:0}: Error finding container 838bae1adaf0edd7e8cb253bcc9bcefa8207863e7d8cb8f66fbe9361805b02be: Status 404 returned error can't find the container with id 838bae1adaf0edd7e8cb253bcc9bcefa8207863e7d8cb8f66fbe9361805b02be
Jul 28 13:25:01.913423 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.913393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk" event={"ID":"691c28df-0c56-4f1b-a245-3376e8a69312","Type":"ContainerStarted","Data":"39e194838853d866b2082e5ddadc551b71450c14511bcff4b7fb5f59dd0c10ef"}
Jul 28 13:25:01.915219 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.915192    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8" event={"ID":"2afc61ea-fc3b-46b2-a06d-8045cf314168","Type":"ContainerStarted","Data":"8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d"}
Jul 28 13:25:01.915323 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.915235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8" event={"ID":"2afc61ea-fc3b-46b2-a06d-8045cf314168","Type":"ContainerStarted","Data":"838bae1adaf0edd7e8cb253bcc9bcefa8207863e7d8cb8f66fbe9361805b02be"}
Jul 28 13:25:01.915366 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.915316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:25:01.933051 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:01.933000    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8" podStartSLOduration=0.932983168 podStartE2EDuration="932.983168ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:25:01.930926875 +0000 UTC m=+2037.091694822" watchObservedRunningTime="2026-07-28 13:25:01.932983168 +0000 UTC m=+2037.093751101"
Jul 28 13:25:02.927994 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:02.927941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk" event={"ID":"691c28df-0c56-4f1b-a245-3376e8a69312","Type":"ContainerStarted","Data":"39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4"}
Jul 28 13:25:02.928424 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:02.928118    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:02.946264 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:02.946201    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk" podStartSLOduration=2.503648508 podStartE2EDuration="2.946182825s" totalImagesPullingTime="442.534317ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:25:02.945683243 +0000 UTC m=+2038.106451197" watchObservedRunningTime="2026-07-28 13:25:02.946182825 +0000 UTC m=+2038.106950761"
Jul 28 13:25:08.939901 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:08.939872    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:25:12.930398 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:25:12.930364    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:26:05.351896 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:05.351777    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:26:05.355860 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:05.355837    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:26:05.360440 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:05.360422    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:26:05.364102 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:05.364088    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:26:14.776848 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:14.776795    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"]
Jul 28 13:26:14.777297 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:14.777058    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk" podUID="691c28df-0c56-4f1b-a245-3376e8a69312" containerName="maas-api" containerID="cri-o://39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4" gracePeriod=30
Jul 28 13:26:14.817848 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:14.817792    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"]
Jul 28 13:26:14.818108 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:14.818059    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8" podUID="2afc61ea-fc3b-46b2-a06d-8045cf314168" containerName="payload-processing" containerID="cri-o://8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d" gracePeriod=30
Jul 28 13:26:15.073467 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.073438    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:26:15.098301 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.098277    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:26:15.170561 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.170533    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/691c28df-0c56-4f1b-a245-3376e8a69312-maas-api-tls\") pod \"691c28df-0c56-4f1b-a245-3376e8a69312\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") "
Jul 28 13:26:15.170756 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.170612    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2afc61ea-fc3b-46b2-a06d-8045cf314168-plugins-config-volume\") pod \"2afc61ea-fc3b-46b2-a06d-8045cf314168\" (UID: \"2afc61ea-fc3b-46b2-a06d-8045cf314168\") "
Jul 28 13:26:15.170756 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.170647    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/691c28df-0c56-4f1b-a245-3376e8a69312-openshift-service-ca\") pod \"691c28df-0c56-4f1b-a245-3376e8a69312\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") "
Jul 28 13:26:15.170756 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.170685    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86kqx\" (UniqueName: \"kubernetes.io/projected/2afc61ea-fc3b-46b2-a06d-8045cf314168-kube-api-access-86kqx\") pod \"2afc61ea-fc3b-46b2-a06d-8045cf314168\" (UID: \"2afc61ea-fc3b-46b2-a06d-8045cf314168\") "
Jul 28 13:26:15.170756 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.170715    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsdkg\" (UniqueName: \"kubernetes.io/projected/691c28df-0c56-4f1b-a245-3376e8a69312-kube-api-access-wsdkg\") pod \"691c28df-0c56-4f1b-a245-3376e8a69312\" (UID: \"691c28df-0c56-4f1b-a245-3376e8a69312\") "
Jul 28 13:26:15.171039 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.171015    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/691c28df-0c56-4f1b-a245-3376e8a69312-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "691c28df-0c56-4f1b-a245-3376e8a69312" (UID: "691c28df-0c56-4f1b-a245-3376e8a69312"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:26:15.171114 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.171058    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2afc61ea-fc3b-46b2-a06d-8045cf314168-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2afc61ea-fc3b-46b2-a06d-8045cf314168" (UID: "2afc61ea-fc3b-46b2-a06d-8045cf314168"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:26:15.173030 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.172997    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/691c28df-0c56-4f1b-a245-3376e8a69312-kube-api-access-wsdkg" (OuterVolumeSpecName: "kube-api-access-wsdkg") pod "691c28df-0c56-4f1b-a245-3376e8a69312" (UID: "691c28df-0c56-4f1b-a245-3376e8a69312"). InnerVolumeSpecName "kube-api-access-wsdkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:26:15.173139 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.173047    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/691c28df-0c56-4f1b-a245-3376e8a69312-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "691c28df-0c56-4f1b-a245-3376e8a69312" (UID: "691c28df-0c56-4f1b-a245-3376e8a69312"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:26:15.173139 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.173068    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2afc61ea-fc3b-46b2-a06d-8045cf314168-kube-api-access-86kqx" (OuterVolumeSpecName: "kube-api-access-86kqx") pod "2afc61ea-fc3b-46b2-a06d-8045cf314168" (UID: "2afc61ea-fc3b-46b2-a06d-8045cf314168"). InnerVolumeSpecName "kube-api-access-86kqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:26:15.271466 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.271439    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2afc61ea-fc3b-46b2-a06d-8045cf314168-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:26:15.271466 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.271461    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/691c28df-0c56-4f1b-a245-3376e8a69312-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:26:15.271466 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.271470    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86kqx\" (UniqueName: \"kubernetes.io/projected/2afc61ea-fc3b-46b2-a06d-8045cf314168-kube-api-access-86kqx\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:26:15.271734 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.271479    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsdkg\" (UniqueName: \"kubernetes.io/projected/691c28df-0c56-4f1b-a245-3376e8a69312-kube-api-access-wsdkg\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:26:15.271734 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.271488    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/691c28df-0c56-4f1b-a245-3376e8a69312-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:26:15.272361 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.272336    2578 generic.go:356] "Generic (PLEG): container finished" podID="691c28df-0c56-4f1b-a245-3376e8a69312" containerID="39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4" exitCode=0
Jul 28 13:26:15.272468 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.272406    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk" event={"ID":"691c28df-0c56-4f1b-a245-3376e8a69312","Type":"ContainerDied","Data":"39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4"}
Jul 28 13:26:15.272468 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.272448    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk" event={"ID":"691c28df-0c56-4f1b-a245-3376e8a69312","Type":"ContainerDied","Data":"39e194838853d866b2082e5ddadc551b71450c14511bcff4b7fb5f59dd0c10ef"}
Jul 28 13:26:15.272468 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.272452    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"
Jul 28 13:26:15.272634 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.272473    2578 scope.go:117] "RemoveContainer" containerID="39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4"
Jul 28 13:26:15.274105 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.274078    2578 generic.go:356] "Generic (PLEG): container finished" podID="2afc61ea-fc3b-46b2-a06d-8045cf314168" containerID="8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d" exitCode=0
Jul 28 13:26:15.274316 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.274214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8" event={"ID":"2afc61ea-fc3b-46b2-a06d-8045cf314168","Type":"ContainerDied","Data":"8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d"}
Jul 28 13:26:15.274316 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.274257    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8" event={"ID":"2afc61ea-fc3b-46b2-a06d-8045cf314168","Type":"ContainerDied","Data":"838bae1adaf0edd7e8cb253bcc9bcefa8207863e7d8cb8f66fbe9361805b02be"}
Jul 28 13:26:15.274316 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.274296    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"
Jul 28 13:26:15.283068 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.282947    2578 scope.go:117] "RemoveContainer" containerID="39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4"
Jul 28 13:26:15.283459 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:26:15.283436    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4\": container with ID starting with 39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4 not found: ID does not exist" containerID="39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4"
Jul 28 13:26:15.283576 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.283467    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4"} err="failed to get container status \"39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4\": rpc error: code = NotFound desc = could not find container \"39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4\": container with ID starting with 39cbe5bc88e1bdef7403de50eedd8847efc4ac68e1ade9d3b1e3682eddeaceb4 not found: ID does not exist"
Jul 28 13:26:15.283576 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.283486    2578 scope.go:117] "RemoveContainer" containerID="8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d"
Jul 28 13:26:15.292302 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.292281    2578 scope.go:117] "RemoveContainer" containerID="8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d"
Jul 28 13:26:15.292571 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:26:15.292552    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d\": container with ID starting with 8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d not found: ID does not exist" containerID="8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d"
Jul 28 13:26:15.292618 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.292579    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d"} err="failed to get container status \"8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d\": rpc error: code = NotFound desc = could not find container \"8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d\": container with ID starting with 8fbae96ba7ba307652c61568f65206797efe65fae7e9966379e9fb887446ad4d not found: ID does not exist"
Jul 28 13:26:15.299711 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.299690    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"]
Jul 28 13:26:15.303552 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.303497    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11cb60ac-7d9867cb77-z9tfk"]
Jul 28 13:26:15.313984 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.313948    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"]
Jul 28 13:26:15.315634 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:15.315615    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-11cb60ac-6bcf9f47f4-mwbc8"]
Jul 28 13:26:17.274653 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:17.274611    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2afc61ea-fc3b-46b2-a06d-8045cf314168" path="/var/lib/kubelet/pods/2afc61ea-fc3b-46b2-a06d-8045cf314168/volumes"
Jul 28 13:26:17.275246 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:26:17.275222    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="691c28df-0c56-4f1b-a245-3376e8a69312" path="/var/lib/kubelet/pods/691c28df-0c56-4f1b-a245-3376e8a69312/volumes"
Jul 28 13:28:09.545966 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.545933    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"]
Jul 28 13:28:09.546454 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.546360    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="691c28df-0c56-4f1b-a245-3376e8a69312" containerName="maas-api"
Jul 28 13:28:09.546454 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.546373    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="691c28df-0c56-4f1b-a245-3376e8a69312" containerName="maas-api"
Jul 28 13:28:09.546454 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.546394    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2afc61ea-fc3b-46b2-a06d-8045cf314168" containerName="payload-processing"
Jul 28 13:28:09.546454 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.546399    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2afc61ea-fc3b-46b2-a06d-8045cf314168" containerName="payload-processing"
Jul 28 13:28:09.546592 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.546467    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2afc61ea-fc3b-46b2-a06d-8045cf314168" containerName="payload-processing"
Jul 28 13:28:09.546592 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.546477    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="691c28df-0c56-4f1b-a245-3376e8a69312" containerName="maas-api"
Jul 28 13:28:09.549539 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.549517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:09.552525 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.552502    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-8b4f72-serving-cert\""
Jul 28 13:28:09.552682 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.552589    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j6zj5\""
Jul 28 13:28:09.563763 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.563733    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"]
Jul 28 13:28:09.695761 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.695716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec8f20b-dc31-4404-adad-c06816dfb64c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:09.695971 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.695853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec8f20b-dc31-4404-adad-c06816dfb64c-maas-api-tls\") pod \"maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:09.695971 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.695912    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf48x\" (UniqueName: \"kubernetes.io/projected/5ec8f20b-dc31-4404-adad-c06816dfb64c-kube-api-access-rf48x\") pod \"maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:09.797112 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.797026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec8f20b-dc31-4404-adad-c06816dfb64c-maas-api-tls\") pod \"maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:09.797112 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.797073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf48x\" (UniqueName: \"kubernetes.io/projected/5ec8f20b-dc31-4404-adad-c06816dfb64c-kube-api-access-rf48x\") pod \"maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:09.797112 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.797114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec8f20b-dc31-4404-adad-c06816dfb64c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:09.797346 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:28:09.797183    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-serving-cert: secret "maas-api-e2e-inf-a-8b4f72-serving-cert" not found
Jul 28 13:28:09.797346 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:28:09.797267    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec8f20b-dc31-4404-adad-c06816dfb64c-maas-api-tls podName:5ec8f20b-dc31-4404-adad-c06816dfb64c nodeName:}" failed. No retries permitted until 2026-07-28 13:28:10.297245575 +0000 UTC m=+2225.458013488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5ec8f20b-dc31-4404-adad-c06816dfb64c-maas-api-tls") pod "maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4" (UID: "5ec8f20b-dc31-4404-adad-c06816dfb64c") : secret "maas-api-e2e-inf-a-8b4f72-serving-cert" not found
Jul 28 13:28:09.797770 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.797752    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec8f20b-dc31-4404-adad-c06816dfb64c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:09.830682 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:09.830654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf48x\" (UniqueName: \"kubernetes.io/projected/5ec8f20b-dc31-4404-adad-c06816dfb64c-kube-api-access-rf48x\") pod \"maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:10.301138 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:10.301104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec8f20b-dc31-4404-adad-c06816dfb64c-maas-api-tls\") pod \"maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:10.303991 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:10.303962    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec8f20b-dc31-4404-adad-c06816dfb64c-maas-api-tls\") pod \"maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:10.460171 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:10.460130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:10.609294 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:10.609268    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"]
Jul 28 13:28:10.611674 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:28:10.611646    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec8f20b_dc31_4404_adad_c06816dfb64c.slice/crio-556fd13e8de215680d13e9cbe9f172075257d4553f00ecc5974327fc332e6ef1 WatchSource:0}: Error finding container 556fd13e8de215680d13e9cbe9f172075257d4553f00ecc5974327fc332e6ef1: Status 404 returned error can't find the container with id 556fd13e8de215680d13e9cbe9f172075257d4553f00ecc5974327fc332e6ef1
Jul 28 13:28:10.829373 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:10.829274    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4" event={"ID":"5ec8f20b-dc31-4404-adad-c06816dfb64c","Type":"ContainerStarted","Data":"556fd13e8de215680d13e9cbe9f172075257d4553f00ecc5974327fc332e6ef1"}
Jul 28 13:28:11.835854 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:11.835820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4" event={"ID":"5ec8f20b-dc31-4404-adad-c06816dfb64c","Type":"ContainerStarted","Data":"6bcf22fae03a5c720294c015a3648f337c80460f09d4c90bc84cb6326821ab15"}
Jul 28 13:28:11.836357 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:11.835959    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:11.856573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:11.856517    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4" podStartSLOduration=2.177917463 podStartE2EDuration="2.856498502s" totalImagesPullingTime="678.581039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:28:11.854503511 +0000 UTC m=+2227.015271444" watchObservedRunningTime="2026-07-28 13:28:11.856498502 +0000 UTC m=+2227.017266435"
Jul 28 13:28:17.847830 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:17.847776    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:28:40.659576 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.659539    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"]
Jul 28 13:28:40.663572 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.663549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:40.666055 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.666036    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d82b76-serving-cert\""
Jul 28 13:28:40.673927 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.673907    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"]
Jul 28 13:28:40.779633 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.779598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ae6d2-64ca-4259-aa0a-c4749ec9994f-maas-api-tls\") pod \"maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:40.779843 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.779671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527ae6d2-64ca-4259-aa0a-c4749ec9994f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:40.779843 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.779741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwsgd\" (UniqueName: \"kubernetes.io/projected/527ae6d2-64ca-4259-aa0a-c4749ec9994f-kube-api-access-lwsgd\") pod \"maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:40.880684 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.880647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527ae6d2-64ca-4259-aa0a-c4749ec9994f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:40.880904 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.880702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwsgd\" (UniqueName: \"kubernetes.io/projected/527ae6d2-64ca-4259-aa0a-c4749ec9994f-kube-api-access-lwsgd\") pod \"maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:40.880904 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.880749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ae6d2-64ca-4259-aa0a-c4749ec9994f-maas-api-tls\") pod \"maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:40.881001 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:28:40.880919    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-serving-cert: secret "maas-api-e2e-inf-b-d82b76-serving-cert" not found
Jul 28 13:28:40.881001 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:28:40.880983    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527ae6d2-64ca-4259-aa0a-c4749ec9994f-maas-api-tls podName:527ae6d2-64ca-4259-aa0a-c4749ec9994f nodeName:}" failed. No retries permitted until 2026-07-28 13:28:41.380966666 +0000 UTC m=+2256.541734577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/527ae6d2-64ca-4259-aa0a-c4749ec9994f-maas-api-tls") pod "maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96" (UID: "527ae6d2-64ca-4259-aa0a-c4749ec9994f") : secret "maas-api-e2e-inf-b-d82b76-serving-cert" not found
Jul 28 13:28:40.881317 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.881296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527ae6d2-64ca-4259-aa0a-c4749ec9994f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:40.890180 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:40.890153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwsgd\" (UniqueName: \"kubernetes.io/projected/527ae6d2-64ca-4259-aa0a-c4749ec9994f-kube-api-access-lwsgd\") pod \"maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:41.353301 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.353260    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"]
Jul 28 13:28:41.361659 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.361621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:28:41.364860 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.364797    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-d82b76-dockercfg-85bnb\""
Jul 28 13:28:41.365033 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.364981    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-d82b76\""
Jul 28 13:28:41.366714 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.366693    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"]
Jul 28 13:28:41.384621 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.384591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ae6d2-64ca-4259-aa0a-c4749ec9994f-maas-api-tls\") pod \"maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:41.387344 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.387322    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ae6d2-64ca-4259-aa0a-c4749ec9994f-maas-api-tls\") pod \"maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:41.486028 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.485992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdc5902a-79fc-46a8-b836-75c058f60e40-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4\" (UID: \"bdc5902a-79fc-46a8-b836-75c058f60e40\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:28:41.486225 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.486047    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrwmq\" (UniqueName: \"kubernetes.io/projected/bdc5902a-79fc-46a8-b836-75c058f60e40-kube-api-access-xrwmq\") pod \"payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4\" (UID: \"bdc5902a-79fc-46a8-b836-75c058f60e40\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:28:41.574800 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.574764    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:41.587201 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.587177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdc5902a-79fc-46a8-b836-75c058f60e40-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4\" (UID: \"bdc5902a-79fc-46a8-b836-75c058f60e40\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:28:41.587273 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.587226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrwmq\" (UniqueName: \"kubernetes.io/projected/bdc5902a-79fc-46a8-b836-75c058f60e40-kube-api-access-xrwmq\") pod \"payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4\" (UID: \"bdc5902a-79fc-46a8-b836-75c058f60e40\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:28:41.588317 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.588290    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdc5902a-79fc-46a8-b836-75c058f60e40-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4\" (UID: \"bdc5902a-79fc-46a8-b836-75c058f60e40\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:28:41.595110 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.595080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrwmq\" (UniqueName: \"kubernetes.io/projected/bdc5902a-79fc-46a8-b836-75c058f60e40-kube-api-access-xrwmq\") pod \"payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4\" (UID: \"bdc5902a-79fc-46a8-b836-75c058f60e40\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:28:41.675191 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.675159    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:28:41.718156 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.718132    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"]
Jul 28 13:28:41.721006 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:28:41.720967    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527ae6d2_64ca_4259_aa0a_c4749ec9994f.slice/crio-1a5cfe5e92cae3e137e045423a7302e03924da246e9a5224e3502203d76b153e WatchSource:0}: Error finding container 1a5cfe5e92cae3e137e045423a7302e03924da246e9a5224e3502203d76b153e: Status 404 returned error can't find the container with id 1a5cfe5e92cae3e137e045423a7302e03924da246e9a5224e3502203d76b153e
Jul 28 13:28:41.827128 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.827100    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"]
Jul 28 13:28:41.831476 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:28:41.831450    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc5902a_79fc_46a8_b836_75c058f60e40.slice/crio-bd64a7b9af1eb95903befa23f29540bddd76a58b4c00f2e5ef13923ee41e47a3 WatchSource:0}: Error finding container bd64a7b9af1eb95903befa23f29540bddd76a58b4c00f2e5ef13923ee41e47a3: Status 404 returned error can't find the container with id bd64a7b9af1eb95903befa23f29540bddd76a58b4c00f2e5ef13923ee41e47a3
Jul 28 13:28:41.974961 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.974928    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4" event={"ID":"bdc5902a-79fc-46a8-b836-75c058f60e40","Type":"ContainerStarted","Data":"b3fa7697d2d69fc8be65db3bdba11856cb9002e7a0981240ce4dc82cfaf4dff8"}
Jul 28 13:28:41.975151 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.974987    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4" event={"ID":"bdc5902a-79fc-46a8-b836-75c058f60e40","Type":"ContainerStarted","Data":"bd64a7b9af1eb95903befa23f29540bddd76a58b4c00f2e5ef13923ee41e47a3"}
Jul 28 13:28:41.975151 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.975035    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:28:41.976402 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.976378    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96" event={"ID":"527ae6d2-64ca-4259-aa0a-c4749ec9994f","Type":"ContainerStarted","Data":"1a5cfe5e92cae3e137e045423a7302e03924da246e9a5224e3502203d76b153e"}
Jul 28 13:28:41.991194 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:41.991153    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4" podStartSLOduration=0.991138718 podStartE2EDuration="991.138718ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:28:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:28:41.990005583 +0000 UTC m=+2257.150773517" watchObservedRunningTime="2026-07-28 13:28:41.991138718 +0000 UTC m=+2257.151906651"
Jul 28 13:28:42.984272 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:42.984237    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96" event={"ID":"527ae6d2-64ca-4259-aa0a-c4749ec9994f","Type":"ContainerStarted","Data":"cc8d8561b540c9e0b9b3f08f1f3b5cea9498ff37d37e85f0662f6fa8ea04c8ab"}
Jul 28 13:28:42.984706 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:42.984424    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:43.003337 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:43.003291    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96" podStartSLOduration=2.24057711 podStartE2EDuration="3.003274275s" totalImagesPullingTime="762.697165ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:28:43.001709924 +0000 UTC m=+2258.162477880" watchObservedRunningTime="2026-07-28 13:28:43.003274275 +0000 UTC m=+2258.164042208"
Jul 28 13:28:48.995001 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:48.994969    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:28:52.987308 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:28:52.987274    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:30:42.429645 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.429611    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"]
Jul 28 13:30:42.430793 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.429838    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4" podUID="5ec8f20b-dc31-4404-adad-c06816dfb64c" containerName="maas-api" containerID="cri-o://6bcf22fae03a5c720294c015a3648f337c80460f09d4c90bc84cb6326821ab15" gracePeriod=30
Jul 28 13:30:42.558260 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.558227    2578 generic.go:356] "Generic (PLEG): container finished" podID="5ec8f20b-dc31-4404-adad-c06816dfb64c" containerID="6bcf22fae03a5c720294c015a3648f337c80460f09d4c90bc84cb6326821ab15" exitCode=0
Jul 28 13:30:42.558409 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.558294    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4" event={"ID":"5ec8f20b-dc31-4404-adad-c06816dfb64c","Type":"ContainerDied","Data":"6bcf22fae03a5c720294c015a3648f337c80460f09d4c90bc84cb6326821ab15"}
Jul 28 13:30:42.700909 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.700882    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:30:42.813600 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.813565    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec8f20b-dc31-4404-adad-c06816dfb64c-openshift-service-ca\") pod \"5ec8f20b-dc31-4404-adad-c06816dfb64c\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") "
Jul 28 13:30:42.813769 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.813634    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec8f20b-dc31-4404-adad-c06816dfb64c-maas-api-tls\") pod \"5ec8f20b-dc31-4404-adad-c06816dfb64c\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") "
Jul 28 13:30:42.813769 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.813672    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf48x\" (UniqueName: \"kubernetes.io/projected/5ec8f20b-dc31-4404-adad-c06816dfb64c-kube-api-access-rf48x\") pod \"5ec8f20b-dc31-4404-adad-c06816dfb64c\" (UID: \"5ec8f20b-dc31-4404-adad-c06816dfb64c\") "
Jul 28 13:30:42.814061 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.814037    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec8f20b-dc31-4404-adad-c06816dfb64c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5ec8f20b-dc31-4404-adad-c06816dfb64c" (UID: "5ec8f20b-dc31-4404-adad-c06816dfb64c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:30:42.815957 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.815932    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec8f20b-dc31-4404-adad-c06816dfb64c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5ec8f20b-dc31-4404-adad-c06816dfb64c" (UID: "5ec8f20b-dc31-4404-adad-c06816dfb64c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:30:42.816097 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.816070    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ec8f20b-dc31-4404-adad-c06816dfb64c-kube-api-access-rf48x" (OuterVolumeSpecName: "kube-api-access-rf48x") pod "5ec8f20b-dc31-4404-adad-c06816dfb64c" (UID: "5ec8f20b-dc31-4404-adad-c06816dfb64c"). InnerVolumeSpecName "kube-api-access-rf48x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:30:42.915052 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.915011    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec8f20b-dc31-4404-adad-c06816dfb64c-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:30:42.915052 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.915042    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ec8f20b-dc31-4404-adad-c06816dfb64c-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:30:42.915052 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:42.915053    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf48x\" (UniqueName: \"kubernetes.io/projected/5ec8f20b-dc31-4404-adad-c06816dfb64c-kube-api-access-rf48x\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:30:43.564656 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:43.564573    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"
Jul 28 13:30:43.564656 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:43.564613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4" event={"ID":"5ec8f20b-dc31-4404-adad-c06816dfb64c","Type":"ContainerDied","Data":"556fd13e8de215680d13e9cbe9f172075257d4553f00ecc5974327fc332e6ef1"}
Jul 28 13:30:43.565139 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:43.564684    2578 scope.go:117] "RemoveContainer" containerID="6bcf22fae03a5c720294c015a3648f337c80460f09d4c90bc84cb6326821ab15"
Jul 28 13:30:43.581659 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:43.581631    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"]
Jul 28 13:30:43.584927 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:43.584904    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-8b4f72-6d79cb6789-9gjk4"]
Jul 28 13:30:45.275278 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:30:45.275198    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ec8f20b-dc31-4404-adad-c06816dfb64c" path="/var/lib/kubelet/pods/5ec8f20b-dc31-4404-adad-c06816dfb64c/volumes"
Jul 28 13:31:00.459051 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.459008    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"]
Jul 28 13:31:00.459483 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.459270    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96" podUID="527ae6d2-64ca-4259-aa0a-c4749ec9994f" containerName="maas-api" containerID="cri-o://cc8d8561b540c9e0b9b3f08f1f3b5cea9498ff37d37e85f0662f6fa8ea04c8ab" gracePeriod=30
Jul 28 13:31:00.522239 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.522203    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"]
Jul 28 13:31:00.522500 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.522454    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4" podUID="bdc5902a-79fc-46a8-b836-75c058f60e40" containerName="payload-pre-processing" containerID="cri-o://b3fa7697d2d69fc8be65db3bdba11856cb9002e7a0981240ce4dc82cfaf4dff8" gracePeriod=30
Jul 28 13:31:00.652600 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.652553    2578 generic.go:356] "Generic (PLEG): container finished" podID="bdc5902a-79fc-46a8-b836-75c058f60e40" containerID="b3fa7697d2d69fc8be65db3bdba11856cb9002e7a0981240ce4dc82cfaf4dff8" exitCode=0
Jul 28 13:31:00.652782 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.652650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4" event={"ID":"bdc5902a-79fc-46a8-b836-75c058f60e40","Type":"ContainerDied","Data":"b3fa7697d2d69fc8be65db3bdba11856cb9002e7a0981240ce4dc82cfaf4dff8"}
Jul 28 13:31:00.654279 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.654256    2578 generic.go:356] "Generic (PLEG): container finished" podID="527ae6d2-64ca-4259-aa0a-c4749ec9994f" containerID="cc8d8561b540c9e0b9b3f08f1f3b5cea9498ff37d37e85f0662f6fa8ea04c8ab" exitCode=0
Jul 28 13:31:00.654418 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.654403    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96" event={"ID":"527ae6d2-64ca-4259-aa0a-c4749ec9994f","Type":"ContainerDied","Data":"cc8d8561b540c9e0b9b3f08f1f3b5cea9498ff37d37e85f0662f6fa8ea04c8ab"}
Jul 28 13:31:00.778732 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.778708    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:31:00.810187 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.810156    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:31:00.877396 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.877363    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ae6d2-64ca-4259-aa0a-c4749ec9994f-maas-api-tls\") pod \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") "
Jul 28 13:31:00.877565 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.877453    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwsgd\" (UniqueName: \"kubernetes.io/projected/527ae6d2-64ca-4259-aa0a-c4749ec9994f-kube-api-access-lwsgd\") pod \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") "
Jul 28 13:31:00.877565 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.877509    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527ae6d2-64ca-4259-aa0a-c4749ec9994f-openshift-service-ca\") pod \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\" (UID: \"527ae6d2-64ca-4259-aa0a-c4749ec9994f\") "
Jul 28 13:31:00.877910 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.877878    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/527ae6d2-64ca-4259-aa0a-c4749ec9994f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "527ae6d2-64ca-4259-aa0a-c4749ec9994f" (UID: "527ae6d2-64ca-4259-aa0a-c4749ec9994f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:31:00.879580 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.879559    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527ae6d2-64ca-4259-aa0a-c4749ec9994f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "527ae6d2-64ca-4259-aa0a-c4749ec9994f" (UID: "527ae6d2-64ca-4259-aa0a-c4749ec9994f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:31:00.879667 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.879609    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527ae6d2-64ca-4259-aa0a-c4749ec9994f-kube-api-access-lwsgd" (OuterVolumeSpecName: "kube-api-access-lwsgd") pod "527ae6d2-64ca-4259-aa0a-c4749ec9994f" (UID: "527ae6d2-64ca-4259-aa0a-c4749ec9994f"). InnerVolumeSpecName "kube-api-access-lwsgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:31:00.978420 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.978381    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrwmq\" (UniqueName: \"kubernetes.io/projected/bdc5902a-79fc-46a8-b836-75c058f60e40-kube-api-access-xrwmq\") pod \"bdc5902a-79fc-46a8-b836-75c058f60e40\" (UID: \"bdc5902a-79fc-46a8-b836-75c058f60e40\") "
Jul 28 13:31:00.978623 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.978435    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdc5902a-79fc-46a8-b836-75c058f60e40-plugins-config-volume\") pod \"bdc5902a-79fc-46a8-b836-75c058f60e40\" (UID: \"bdc5902a-79fc-46a8-b836-75c058f60e40\") "
Jul 28 13:31:00.978623 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.978579    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwsgd\" (UniqueName: \"kubernetes.io/projected/527ae6d2-64ca-4259-aa0a-c4749ec9994f-kube-api-access-lwsgd\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:31:00.978623 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.978589    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527ae6d2-64ca-4259-aa0a-c4749ec9994f-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:31:00.978623 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.978598    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527ae6d2-64ca-4259-aa0a-c4749ec9994f-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:31:00.978932 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.978907    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdc5902a-79fc-46a8-b836-75c058f60e40-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bdc5902a-79fc-46a8-b836-75c058f60e40" (UID: "bdc5902a-79fc-46a8-b836-75c058f60e40"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:31:00.980611 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:00.980562    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc5902a-79fc-46a8-b836-75c058f60e40-kube-api-access-xrwmq" (OuterVolumeSpecName: "kube-api-access-xrwmq") pod "bdc5902a-79fc-46a8-b836-75c058f60e40" (UID: "bdc5902a-79fc-46a8-b836-75c058f60e40"). InnerVolumeSpecName "kube-api-access-xrwmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:31:01.079267 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.079213    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrwmq\" (UniqueName: \"kubernetes.io/projected/bdc5902a-79fc-46a8-b836-75c058f60e40-kube-api-access-xrwmq\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:31:01.079267 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.079259    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdc5902a-79fc-46a8-b836-75c058f60e40-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:31:01.660144 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.660061    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"
Jul 28 13:31:01.660579 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.660060    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4" event={"ID":"bdc5902a-79fc-46a8-b836-75c058f60e40","Type":"ContainerDied","Data":"bd64a7b9af1eb95903befa23f29540bddd76a58b4c00f2e5ef13923ee41e47a3"}
Jul 28 13:31:01.660579 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.660205    2578 scope.go:117] "RemoveContainer" containerID="b3fa7697d2d69fc8be65db3bdba11856cb9002e7a0981240ce4dc82cfaf4dff8"
Jul 28 13:31:01.661610 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.661598    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"
Jul 28 13:31:01.661686 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.661618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96" event={"ID":"527ae6d2-64ca-4259-aa0a-c4749ec9994f","Type":"ContainerDied","Data":"1a5cfe5e92cae3e137e045423a7302e03924da246e9a5224e3502203d76b153e"}
Jul 28 13:31:01.669312 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.669239    2578 scope.go:117] "RemoveContainer" containerID="cc8d8561b540c9e0b9b3f08f1f3b5cea9498ff37d37e85f0662f6fa8ea04c8ab"
Jul 28 13:31:01.680190 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.680166    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"]
Jul 28 13:31:01.683607 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.683578    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d82b76-6966fd9468-qvbr4"]
Jul 28 13:31:01.693407 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.693387    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"]
Jul 28 13:31:01.697007 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:01.696987    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d82b76-5d7cc5f8f8-frs96"]
Jul 28 13:31:03.272280 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:03.272240    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="527ae6d2-64ca-4259-aa0a-c4749ec9994f" path="/var/lib/kubelet/pods/527ae6d2-64ca-4259-aa0a-c4749ec9994f/volumes"
Jul 28 13:31:03.272670 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:03.272599    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdc5902a-79fc-46a8-b836-75c058f60e40" path="/var/lib/kubelet/pods/bdc5902a-79fc-46a8-b836-75c058f60e40/volumes"
Jul 28 13:31:05.381092 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:05.380978    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:31:05.396980 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:05.388038    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:31:05.396980 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:05.389550    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:31:05.396980 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:05.396298    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:31:11.531959 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.531919    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"]
Jul 28 13:31:11.532494 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.532474    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527ae6d2-64ca-4259-aa0a-c4749ec9994f" containerName="maas-api"
Jul 28 13:31:11.532595 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.532499    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="527ae6d2-64ca-4259-aa0a-c4749ec9994f" containerName="maas-api"
Jul 28 13:31:11.532595 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.532521    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec8f20b-dc31-4404-adad-c06816dfb64c" containerName="maas-api"
Jul 28 13:31:11.532595 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.532531    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec8f20b-dc31-4404-adad-c06816dfb64c" containerName="maas-api"
Jul 28 13:31:11.532595 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.532555    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc5902a-79fc-46a8-b836-75c058f60e40" containerName="payload-pre-processing"
Jul 28 13:31:11.532595 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.532565    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc5902a-79fc-46a8-b836-75c058f60e40" containerName="payload-pre-processing"
Jul 28 13:31:11.532763 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.532685    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc5902a-79fc-46a8-b836-75c058f60e40" containerName="payload-pre-processing"
Jul 28 13:31:11.532763 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.532701    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="527ae6d2-64ca-4259-aa0a-c4749ec9994f" containerName="maas-api"
Jul 28 13:31:11.532763 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.532713    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ec8f20b-dc31-4404-adad-c06816dfb64c" containerName="maas-api"
Jul 28 13:31:11.535852 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.535834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:11.538360 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.538342    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-955728-serving-cert\""
Jul 28 13:31:11.538470 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.538343    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j6zj5\""
Jul 28 13:31:11.544387 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.544363    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"]
Jul 28 13:31:11.564961 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.564934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf6196b-9612-4321-8dfd-c9120c904997-openshift-service-ca\") pod \"maas-api-e2e-api-a-955728-78d458f9df-q87qj\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:11.565114 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.564980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf6196b-9612-4321-8dfd-c9120c904997-maas-api-tls\") pod \"maas-api-e2e-api-a-955728-78d458f9df-q87qj\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:11.565114 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.565041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvbxg\" (UniqueName: \"kubernetes.io/projected/dcf6196b-9612-4321-8dfd-c9120c904997-kube-api-access-tvbxg\") pod \"maas-api-e2e-api-a-955728-78d458f9df-q87qj\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:11.665542 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.665507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf6196b-9612-4321-8dfd-c9120c904997-openshift-service-ca\") pod \"maas-api-e2e-api-a-955728-78d458f9df-q87qj\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:11.665721 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.665558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf6196b-9612-4321-8dfd-c9120c904997-maas-api-tls\") pod \"maas-api-e2e-api-a-955728-78d458f9df-q87qj\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:11.665721 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.665588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbxg\" (UniqueName: \"kubernetes.io/projected/dcf6196b-9612-4321-8dfd-c9120c904997-kube-api-access-tvbxg\") pod \"maas-api-e2e-api-a-955728-78d458f9df-q87qj\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:11.665798 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:31:11.665721    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-955728-serving-cert: secret "maas-api-e2e-api-a-955728-serving-cert" not found
Jul 28 13:31:11.665798 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:31:11.665791    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf6196b-9612-4321-8dfd-c9120c904997-maas-api-tls podName:dcf6196b-9612-4321-8dfd-c9120c904997 nodeName:}" failed. No retries permitted until 2026-07-28 13:31:12.165775167 +0000 UTC m=+2407.326543079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dcf6196b-9612-4321-8dfd-c9120c904997-maas-api-tls") pod "maas-api-e2e-api-a-955728-78d458f9df-q87qj" (UID: "dcf6196b-9612-4321-8dfd-c9120c904997") : secret "maas-api-e2e-api-a-955728-serving-cert" not found
Jul 28 13:31:11.666269 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.666251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf6196b-9612-4321-8dfd-c9120c904997-openshift-service-ca\") pod \"maas-api-e2e-api-a-955728-78d458f9df-q87qj\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:11.675253 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:11.675222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvbxg\" (UniqueName: \"kubernetes.io/projected/dcf6196b-9612-4321-8dfd-c9120c904997-kube-api-access-tvbxg\") pod \"maas-api-e2e-api-a-955728-78d458f9df-q87qj\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:12.169921 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.169874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf6196b-9612-4321-8dfd-c9120c904997-maas-api-tls\") pod \"maas-api-e2e-api-a-955728-78d458f9df-q87qj\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:12.172568 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.172533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf6196b-9612-4321-8dfd-c9120c904997-maas-api-tls\") pod \"maas-api-e2e-api-a-955728-78d458f9df-q87qj\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:12.178579 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.178554    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"]
Jul 28 13:31:12.182301 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.182280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:31:12.184986 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.184964    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-955728\""
Jul 28 13:31:12.185103 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.185085    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-955728-dockercfg-v52kn\""
Jul 28 13:31:12.191218 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.191186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"]
Jul 28 13:31:12.271159 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.271127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36c3a54a-f978-4972-b3f5-b912edf29f3b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8\" (UID: \"36c3a54a-f978-4972-b3f5-b912edf29f3b\") " pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:31:12.271340 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.271176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsmz8\" (UniqueName: \"kubernetes.io/projected/36c3a54a-f978-4972-b3f5-b912edf29f3b-kube-api-access-zsmz8\") pod \"payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8\" (UID: \"36c3a54a-f978-4972-b3f5-b912edf29f3b\") " pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:31:12.372191 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.372148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36c3a54a-f978-4972-b3f5-b912edf29f3b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8\" (UID: \"36c3a54a-f978-4972-b3f5-b912edf29f3b\") " pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:31:12.372191 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.372196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsmz8\" (UniqueName: \"kubernetes.io/projected/36c3a54a-f978-4972-b3f5-b912edf29f3b-kube-api-access-zsmz8\") pod \"payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8\" (UID: \"36c3a54a-f978-4972-b3f5-b912edf29f3b\") " pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:31:12.372964 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.372938    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36c3a54a-f978-4972-b3f5-b912edf29f3b-plugins-config-volume\") pod \"payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8\" (UID: \"36c3a54a-f978-4972-b3f5-b912edf29f3b\") " pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:31:12.383670 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.383645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsmz8\" (UniqueName: \"kubernetes.io/projected/36c3a54a-f978-4972-b3f5-b912edf29f3b-kube-api-access-zsmz8\") pod \"payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8\" (UID: \"36c3a54a-f978-4972-b3f5-b912edf29f3b\") " pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:31:12.448303 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.448221    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:12.493375 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.493335    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:31:12.604279 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.604120    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"]
Jul 28 13:31:12.606944 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:31:12.606898    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf6196b_9612_4321_8dfd_c9120c904997.slice/crio-28aaf7c8efd1d4a0e5c29dd9eefe79d1bfb2988dc230213c93755ad19ea7ce0a WatchSource:0}: Error finding container 28aaf7c8efd1d4a0e5c29dd9eefe79d1bfb2988dc230213c93755ad19ea7ce0a: Status 404 returned error can't find the container with id 28aaf7c8efd1d4a0e5c29dd9eefe79d1bfb2988dc230213c93755ad19ea7ce0a
Jul 28 13:31:12.608499 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.608477    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:31:12.649229 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.649202    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"]
Jul 28 13:31:12.651042 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:31:12.651013    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c3a54a_f978_4972_b3f5_b912edf29f3b.slice/crio-2e9f16eba4578975cd6cd5ae57a7dc8352ed6122e483edcaf00e799337113a8f WatchSource:0}: Error finding container 2e9f16eba4578975cd6cd5ae57a7dc8352ed6122e483edcaf00e799337113a8f: Status 404 returned error can't find the container with id 2e9f16eba4578975cd6cd5ae57a7dc8352ed6122e483edcaf00e799337113a8f
Jul 28 13:31:12.715735 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.715706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj" event={"ID":"dcf6196b-9612-4321-8dfd-c9120c904997","Type":"ContainerStarted","Data":"28aaf7c8efd1d4a0e5c29dd9eefe79d1bfb2988dc230213c93755ad19ea7ce0a"}
Jul 28 13:31:12.716977 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:12.716947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8" event={"ID":"36c3a54a-f978-4972-b3f5-b912edf29f3b","Type":"ContainerStarted","Data":"2e9f16eba4578975cd6cd5ae57a7dc8352ed6122e483edcaf00e799337113a8f"}
Jul 28 13:31:13.723442 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:13.723387    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj" event={"ID":"dcf6196b-9612-4321-8dfd-c9120c904997","Type":"ContainerStarted","Data":"dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc"}
Jul 28 13:31:13.723968 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:13.723546    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:13.724885 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:13.724854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8" event={"ID":"36c3a54a-f978-4972-b3f5-b912edf29f3b","Type":"ContainerStarted","Data":"5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187"}
Jul 28 13:31:13.724999 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:13.724989    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:31:13.741415 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:13.741325    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj" podStartSLOduration=1.867631399 podStartE2EDuration="2.74130997s" totalImagesPullingTime="873.678571ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:31:13.73935021 +0000 UTC m=+2408.900118147" watchObservedRunningTime="2026-07-28 13:31:13.74130997 +0000 UTC m=+2408.902077907"
Jul 28 13:31:13.757406 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:13.757360    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8" podStartSLOduration=1.757345968 podStartE2EDuration="1.757345968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:31:13.754940687 +0000 UTC m=+2408.915708644" watchObservedRunningTime="2026-07-28 13:31:13.757345968 +0000 UTC m=+2408.918113902"
Jul 28 13:31:19.735670 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:19.735635    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:31:24.731870 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:24.731830    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:31:40.493737 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.493696    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"]
Jul 28 13:31:40.497400 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.497372    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:40.500367 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.500339    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-44e001-serving-cert\""
Jul 28 13:31:40.510196 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.510166    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"]
Jul 28 13:31:40.623747 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.623711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmfnr\" (UniqueName: \"kubernetes.io/projected/27d153f2-4f15-493b-8916-2eb95855b68a-kube-api-access-nmfnr\") pod \"maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:40.623965 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.623759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27d153f2-4f15-493b-8916-2eb95855b68a-maas-api-tls\") pod \"maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:40.623965 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.623780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d153f2-4f15-493b-8916-2eb95855b68a-openshift-service-ca\") pod \"maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:40.724347 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.724319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmfnr\" (UniqueName: \"kubernetes.io/projected/27d153f2-4f15-493b-8916-2eb95855b68a-kube-api-access-nmfnr\") pod \"maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:40.724518 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.724367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27d153f2-4f15-493b-8916-2eb95855b68a-maas-api-tls\") pod \"maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:40.724518 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.724393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d153f2-4f15-493b-8916-2eb95855b68a-openshift-service-ca\") pod \"maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:40.724592 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:31:40.724536    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-serving-cert: secret "maas-api-e2e-api-b-44e001-serving-cert" not found
Jul 28 13:31:40.724632 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:31:40.724604    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d153f2-4f15-493b-8916-2eb95855b68a-maas-api-tls podName:27d153f2-4f15-493b-8916-2eb95855b68a nodeName:}" failed. No retries permitted until 2026-07-28 13:31:41.224585819 +0000 UTC m=+2436.385353741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/27d153f2-4f15-493b-8916-2eb95855b68a-maas-api-tls") pod "maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd" (UID: "27d153f2-4f15-493b-8916-2eb95855b68a") : secret "maas-api-e2e-api-b-44e001-serving-cert" not found
Jul 28 13:31:40.725101 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.725080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d153f2-4f15-493b-8916-2eb95855b68a-openshift-service-ca\") pod \"maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:40.735714 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:40.735611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmfnr\" (UniqueName: \"kubernetes.io/projected/27d153f2-4f15-493b-8916-2eb95855b68a-kube-api-access-nmfnr\") pod \"maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:41.230241 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:41.230208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27d153f2-4f15-493b-8916-2eb95855b68a-maas-api-tls\") pod \"maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:41.232952 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:41.232927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27d153f2-4f15-493b-8916-2eb95855b68a-maas-api-tls\") pod \"maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:41.409957 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:41.409924    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:41.558297 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:41.558180    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"]
Jul 28 13:31:41.560821 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:31:41.560768    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d153f2_4f15_493b_8916_2eb95855b68a.slice/crio-3c82a828d07818b57f0b47d9df8b20c55987573f25e5232dd47119142c3ff491 WatchSource:0}: Error finding container 3c82a828d07818b57f0b47d9df8b20c55987573f25e5232dd47119142c3ff491: Status 404 returned error can't find the container with id 3c82a828d07818b57f0b47d9df8b20c55987573f25e5232dd47119142c3ff491
Jul 28 13:31:41.868086 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:41.868049    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd" event={"ID":"27d153f2-4f15-493b-8916-2eb95855b68a","Type":"ContainerStarted","Data":"3c82a828d07818b57f0b47d9df8b20c55987573f25e5232dd47119142c3ff491"}
Jul 28 13:31:42.880073 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:42.880038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd" event={"ID":"27d153f2-4f15-493b-8916-2eb95855b68a","Type":"ContainerStarted","Data":"f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97"}
Jul 28 13:31:42.880557 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:42.880141    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:31:42.898958 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:42.898903    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd" podStartSLOduration=2.454379739 podStartE2EDuration="2.89888561s" totalImagesPullingTime="444.505871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:31:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:31:42.897045348 +0000 UTC m=+2438.057813285" watchObservedRunningTime="2026-07-28 13:31:42.89888561 +0000 UTC m=+2438.059653544"
Jul 28 13:31:48.890977 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:31:48.890945    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:32:24.156773 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.156735    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"]
Jul 28 13:32:24.157375 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.157003    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj" podUID="dcf6196b-9612-4321-8dfd-c9120c904997" containerName="maas-api" containerID="cri-o://dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc" gracePeriod=30
Jul 28 13:32:24.212091 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.212053    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"]
Jul 28 13:32:24.212351 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.212323    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8" podUID="36c3a54a-f978-4972-b3f5-b912edf29f3b" containerName="payload-processing" containerID="cri-o://5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187" gracePeriod=30
Jul 28 13:32:24.494410 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.494383    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:32:24.497354 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.497331    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:32:24.628681 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.628642    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf6196b-9612-4321-8dfd-c9120c904997-openshift-service-ca\") pod \"dcf6196b-9612-4321-8dfd-c9120c904997\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") "
Jul 28 13:32:24.628681 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.628692    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36c3a54a-f978-4972-b3f5-b912edf29f3b-plugins-config-volume\") pod \"36c3a54a-f978-4972-b3f5-b912edf29f3b\" (UID: \"36c3a54a-f978-4972-b3f5-b912edf29f3b\") "
Jul 28 13:32:24.628997 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.628714    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf6196b-9612-4321-8dfd-c9120c904997-maas-api-tls\") pod \"dcf6196b-9612-4321-8dfd-c9120c904997\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") "
Jul 28 13:32:24.628997 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.628735    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvbxg\" (UniqueName: \"kubernetes.io/projected/dcf6196b-9612-4321-8dfd-c9120c904997-kube-api-access-tvbxg\") pod \"dcf6196b-9612-4321-8dfd-c9120c904997\" (UID: \"dcf6196b-9612-4321-8dfd-c9120c904997\") "
Jul 28 13:32:24.628997 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.628844    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsmz8\" (UniqueName: \"kubernetes.io/projected/36c3a54a-f978-4972-b3f5-b912edf29f3b-kube-api-access-zsmz8\") pod \"36c3a54a-f978-4972-b3f5-b912edf29f3b\" (UID: \"36c3a54a-f978-4972-b3f5-b912edf29f3b\") "
Jul 28 13:32:24.629190 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.629153    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcf6196b-9612-4321-8dfd-c9120c904997-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dcf6196b-9612-4321-8dfd-c9120c904997" (UID: "dcf6196b-9612-4321-8dfd-c9120c904997"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:32:24.629276 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.629184    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c3a54a-f978-4972-b3f5-b912edf29f3b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "36c3a54a-f978-4972-b3f5-b912edf29f3b" (UID: "36c3a54a-f978-4972-b3f5-b912edf29f3b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:32:24.631217 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.631187    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c3a54a-f978-4972-b3f5-b912edf29f3b-kube-api-access-zsmz8" (OuterVolumeSpecName: "kube-api-access-zsmz8") pod "36c3a54a-f978-4972-b3f5-b912edf29f3b" (UID: "36c3a54a-f978-4972-b3f5-b912edf29f3b"). InnerVolumeSpecName "kube-api-access-zsmz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:32:24.631217 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.631202    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcf6196b-9612-4321-8dfd-c9120c904997-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dcf6196b-9612-4321-8dfd-c9120c904997" (UID: "dcf6196b-9612-4321-8dfd-c9120c904997"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:32:24.631369 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.631238    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf6196b-9612-4321-8dfd-c9120c904997-kube-api-access-tvbxg" (OuterVolumeSpecName: "kube-api-access-tvbxg") pod "dcf6196b-9612-4321-8dfd-c9120c904997" (UID: "dcf6196b-9612-4321-8dfd-c9120c904997"). InnerVolumeSpecName "kube-api-access-tvbxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:32:24.730307 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.730212    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcf6196b-9612-4321-8dfd-c9120c904997-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:32:24.730307 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.730242    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36c3a54a-f978-4972-b3f5-b912edf29f3b-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:32:24.730307 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.730255    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcf6196b-9612-4321-8dfd-c9120c904997-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:32:24.730307 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.730263    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvbxg\" (UniqueName: \"kubernetes.io/projected/dcf6196b-9612-4321-8dfd-c9120c904997-kube-api-access-tvbxg\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:32:24.730307 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:24.730271    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsmz8\" (UniqueName: \"kubernetes.io/projected/36c3a54a-f978-4972-b3f5-b912edf29f3b-kube-api-access-zsmz8\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:32:25.091042 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.091002    2578 generic.go:356] "Generic (PLEG): container finished" podID="36c3a54a-f978-4972-b3f5-b912edf29f3b" containerID="5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187" exitCode=0
Jul 28 13:32:25.091290 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.091052    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"
Jul 28 13:32:25.091290 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.091105    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8" event={"ID":"36c3a54a-f978-4972-b3f5-b912edf29f3b","Type":"ContainerDied","Data":"5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187"}
Jul 28 13:32:25.091290 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.091169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8" event={"ID":"36c3a54a-f978-4972-b3f5-b912edf29f3b","Type":"ContainerDied","Data":"2e9f16eba4578975cd6cd5ae57a7dc8352ed6122e483edcaf00e799337113a8f"}
Jul 28 13:32:25.091290 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.091197    2578 scope.go:117] "RemoveContainer" containerID="5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187"
Jul 28 13:32:25.092587 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.092567    2578 generic.go:356] "Generic (PLEG): container finished" podID="dcf6196b-9612-4321-8dfd-c9120c904997" containerID="dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc" exitCode=0
Jul 28 13:32:25.092675 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.092617    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"
Jul 28 13:32:25.092725 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.092607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj" event={"ID":"dcf6196b-9612-4321-8dfd-c9120c904997","Type":"ContainerDied","Data":"dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc"}
Jul 28 13:32:25.092787 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.092742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj" event={"ID":"dcf6196b-9612-4321-8dfd-c9120c904997","Type":"ContainerDied","Data":"28aaf7c8efd1d4a0e5c29dd9eefe79d1bfb2988dc230213c93755ad19ea7ce0a"}
Jul 28 13:32:25.101637 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.101615    2578 scope.go:117] "RemoveContainer" containerID="5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187"
Jul 28 13:32:25.102019 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:32:25.101991    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187\": container with ID starting with 5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187 not found: ID does not exist" containerID="5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187"
Jul 28 13:32:25.102117 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.102031    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187"} err="failed to get container status \"5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187\": rpc error: code = NotFound desc = could not find container \"5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187\": container with ID starting with 5a0ab93d6df36d138de789182253c12913b633451d0f45c0d4b9e29cfacc2187 not found: ID does not exist"
Jul 28 13:32:25.102117 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.102054    2578 scope.go:117] "RemoveContainer" containerID="dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc"
Jul 28 13:32:25.111001 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.110983    2578 scope.go:117] "RemoveContainer" containerID="dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc"
Jul 28 13:32:25.111311 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:32:25.111286    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc\": container with ID starting with dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc not found: ID does not exist" containerID="dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc"
Jul 28 13:32:25.111410 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.111316    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc"} err="failed to get container status \"dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc\": rpc error: code = NotFound desc = could not find container \"dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc\": container with ID starting with dd87ac5d73575af5798362ad05c4cf5e4e49ec09f82602f86179a1fa4ec9a8bc not found: ID does not exist"
Jul 28 13:32:25.125091 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.119695    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"]
Jul 28 13:32:25.128037 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.128010    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-955728-78d458f9df-q87qj"]
Jul 28 13:32:25.138723 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.138699    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"]
Jul 28 13:32:25.142255 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.142231    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-955728-5f7cc57f44-rtdc8"]
Jul 28 13:32:25.271592 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.271556    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c3a54a-f978-4972-b3f5-b912edf29f3b" path="/var/lib/kubelet/pods/36c3a54a-f978-4972-b3f5-b912edf29f3b/volumes"
Jul 28 13:32:25.271999 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:25.271982    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcf6196b-9612-4321-8dfd-c9120c904997" path="/var/lib/kubelet/pods/dcf6196b-9612-4321-8dfd-c9120c904997/volumes"
Jul 28 13:32:47.128267 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.128231    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"]
Jul 28 13:32:47.128679 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.128489    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd" podUID="27d153f2-4f15-493b-8916-2eb95855b68a" containerName="maas-api" containerID="cri-o://f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97" gracePeriod=30
Jul 28 13:32:47.390635 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.390571    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:32:47.441366 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.441339    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27d153f2-4f15-493b-8916-2eb95855b68a-maas-api-tls\") pod \"27d153f2-4f15-493b-8916-2eb95855b68a\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") "
Jul 28 13:32:47.441554 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.441383    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d153f2-4f15-493b-8916-2eb95855b68a-openshift-service-ca\") pod \"27d153f2-4f15-493b-8916-2eb95855b68a\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") "
Jul 28 13:32:47.441554 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.441404    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmfnr\" (UniqueName: \"kubernetes.io/projected/27d153f2-4f15-493b-8916-2eb95855b68a-kube-api-access-nmfnr\") pod \"27d153f2-4f15-493b-8916-2eb95855b68a\" (UID: \"27d153f2-4f15-493b-8916-2eb95855b68a\") "
Jul 28 13:32:47.441754 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.441732    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d153f2-4f15-493b-8916-2eb95855b68a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "27d153f2-4f15-493b-8916-2eb95855b68a" (UID: "27d153f2-4f15-493b-8916-2eb95855b68a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:32:47.443574 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.443549    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d153f2-4f15-493b-8916-2eb95855b68a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "27d153f2-4f15-493b-8916-2eb95855b68a" (UID: "27d153f2-4f15-493b-8916-2eb95855b68a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:32:47.443678 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.443602    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d153f2-4f15-493b-8916-2eb95855b68a-kube-api-access-nmfnr" (OuterVolumeSpecName: "kube-api-access-nmfnr") pod "27d153f2-4f15-493b-8916-2eb95855b68a" (UID: "27d153f2-4f15-493b-8916-2eb95855b68a"). InnerVolumeSpecName "kube-api-access-nmfnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:32:47.542296 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.542249    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27d153f2-4f15-493b-8916-2eb95855b68a-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:32:47.542296 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.542291    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27d153f2-4f15-493b-8916-2eb95855b68a-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:32:47.542296 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:47.542301    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmfnr\" (UniqueName: \"kubernetes.io/projected/27d153f2-4f15-493b-8916-2eb95855b68a-kube-api-access-nmfnr\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:32:48.210515 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:48.210478    2578 generic.go:356] "Generic (PLEG): container finished" podID="27d153f2-4f15-493b-8916-2eb95855b68a" containerID="f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97" exitCode=0
Jul 28 13:32:48.210969 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:48.210525    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"
Jul 28 13:32:48.210969 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:48.210562    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd" event={"ID":"27d153f2-4f15-493b-8916-2eb95855b68a","Type":"ContainerDied","Data":"f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97"}
Jul 28 13:32:48.210969 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:48.210614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd" event={"ID":"27d153f2-4f15-493b-8916-2eb95855b68a","Type":"ContainerDied","Data":"3c82a828d07818b57f0b47d9df8b20c55987573f25e5232dd47119142c3ff491"}
Jul 28 13:32:48.210969 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:48.210636    2578 scope.go:117] "RemoveContainer" containerID="f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97"
Jul 28 13:32:48.220063 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:48.220042    2578 scope.go:117] "RemoveContainer" containerID="f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97"
Jul 28 13:32:48.220330 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:32:48.220303    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97\": container with ID starting with f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97 not found: ID does not exist" containerID="f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97"
Jul 28 13:32:48.220383 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:48.220345    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97"} err="failed to get container status \"f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97\": rpc error: code = NotFound desc = could not find container \"f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97\": container with ID starting with f141b28aee7f64bd6f61ea171fd9c17418c35a28b2372824e7838fbcde990d97 not found: ID does not exist"
Jul 28 13:32:48.232055 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:48.232030    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"]
Jul 28 13:32:48.235668 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:48.235643    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-44e001-5f9f49f76d-f8tvd"]
Jul 28 13:32:49.272185 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:49.272152    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27d153f2-4f15-493b-8916-2eb95855b68a" path="/var/lib/kubelet/pods/27d153f2-4f15-493b-8916-2eb95855b68a/volumes"
Jul 28 13:32:58.121932 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.121846    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"]
Jul 28 13:32:58.122493 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.122373    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c3a54a-f978-4972-b3f5-b912edf29f3b" containerName="payload-processing"
Jul 28 13:32:58.122493 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.122392    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c3a54a-f978-4972-b3f5-b912edf29f3b" containerName="payload-processing"
Jul 28 13:32:58.122493 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.122423    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d153f2-4f15-493b-8916-2eb95855b68a" containerName="maas-api"
Jul 28 13:32:58.122493 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.122432    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d153f2-4f15-493b-8916-2eb95855b68a" containerName="maas-api"
Jul 28 13:32:58.122493 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.122451    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf6196b-9612-4321-8dfd-c9120c904997" containerName="maas-api"
Jul 28 13:32:58.122493 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.122459    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf6196b-9612-4321-8dfd-c9120c904997" containerName="maas-api"
Jul 28 13:32:58.122800 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.122577    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf6196b-9612-4321-8dfd-c9120c904997" containerName="maas-api"
Jul 28 13:32:58.122800 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.122591    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d153f2-4f15-493b-8916-2eb95855b68a" containerName="maas-api"
Jul 28 13:32:58.122800 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.122601    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c3a54a-f978-4972-b3f5-b912edf29f3b" containerName="payload-processing"
Jul 28 13:32:58.127080 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.127061    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:58.129885 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.129863    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-2c9e23-serving-cert\""
Jul 28 13:32:58.129992 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.129874    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j6zj5\""
Jul 28 13:32:58.137866 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.137840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"]
Jul 28 13:32:58.242218 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.242183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd8wt\" (UniqueName: \"kubernetes.io/projected/3f156553-f5fb-43e9-8fce-1403b1550d67-kube-api-access-wd8wt\") pod \"maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:58.242395 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.242293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f156553-f5fb-43e9-8fce-1403b1550d67-maas-api-tls\") pod \"maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:58.242395 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.242326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f156553-f5fb-43e9-8fce-1403b1550d67-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:58.343159 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.343123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f156553-f5fb-43e9-8fce-1403b1550d67-maas-api-tls\") pod \"maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:58.343159 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.343162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f156553-f5fb-43e9-8fce-1403b1550d67-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:58.343442 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.343219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8wt\" (UniqueName: \"kubernetes.io/projected/3f156553-f5fb-43e9-8fce-1403b1550d67-kube-api-access-wd8wt\") pod \"maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:58.343442 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:32:58.343266    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-serving-cert: secret "maas-api-e2e-shared-a-2c9e23-serving-cert" not found
Jul 28 13:32:58.343442 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:32:58.343367    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f156553-f5fb-43e9-8fce-1403b1550d67-maas-api-tls podName:3f156553-f5fb-43e9-8fce-1403b1550d67 nodeName:}" failed. No retries permitted until 2026-07-28 13:32:58.843342286 +0000 UTC m=+2514.004110215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f156553-f5fb-43e9-8fce-1403b1550d67-maas-api-tls") pod "maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8" (UID: "3f156553-f5fb-43e9-8fce-1403b1550d67") : secret "maas-api-e2e-shared-a-2c9e23-serving-cert" not found
Jul 28 13:32:58.343844 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.343827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f156553-f5fb-43e9-8fce-1403b1550d67-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:58.352519 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.352492    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd8wt\" (UniqueName: \"kubernetes.io/projected/3f156553-f5fb-43e9-8fce-1403b1550d67-kube-api-access-wd8wt\") pod \"maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:58.848859 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.848795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f156553-f5fb-43e9-8fce-1403b1550d67-maas-api-tls\") pod \"maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:58.851719 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:58.851693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f156553-f5fb-43e9-8fce-1403b1550d67-maas-api-tls\") pod \"maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:59.037926 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:59.037890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:32:59.184335 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:59.184297    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"]
Jul 28 13:32:59.187865 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:32:59.187833    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f156553_f5fb_43e9_8fce_1403b1550d67.slice/crio-858b9c5e7a8311684783a2b52a08168f479095ee4245c1bd31f237ae4b86f0b9 WatchSource:0}: Error finding container 858b9c5e7a8311684783a2b52a08168f479095ee4245c1bd31f237ae4b86f0b9: Status 404 returned error can't find the container with id 858b9c5e7a8311684783a2b52a08168f479095ee4245c1bd31f237ae4b86f0b9
Jul 28 13:32:59.277956 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:32:59.277918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8" event={"ID":"3f156553-f5fb-43e9-8fce-1403b1550d67","Type":"ContainerStarted","Data":"858b9c5e7a8311684783a2b52a08168f479095ee4245c1bd31f237ae4b86f0b9"}
Jul 28 13:33:00.272646 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:00.272605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8" event={"ID":"3f156553-f5fb-43e9-8fce-1403b1550d67","Type":"ContainerStarted","Data":"6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4"}
Jul 28 13:33:00.273168 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:00.272742    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:33:00.289119 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:00.289067    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8" podStartSLOduration=1.847858915 podStartE2EDuration="2.28905221s" totalImagesPullingTime="441.193295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:33:00.288102543 +0000 UTC m=+2515.448870499" watchObservedRunningTime="2026-07-28 13:33:00.28905221 +0000 UTC m=+2515.449820144"
Jul 28 13:33:06.282492 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:06.282453    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:33:28.032267 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.032229    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"]
Jul 28 13:33:28.035851 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.035792    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:28.038492 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.038471    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-8fd168-serving-cert\""
Jul 28 13:33:28.050474 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.050446    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"]
Jul 28 13:33:28.120813 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.120776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8fd168-557f749f54-l44td\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:28.120991 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.120854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcn7d\" (UniqueName: \"kubernetes.io/projected/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-kube-api-access-qcn7d\") pod \"maas-api-e2e-shared-b-8fd168-557f749f54-l44td\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:28.120991 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.120877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-maas-api-tls\") pod \"maas-api-e2e-shared-b-8fd168-557f749f54-l44td\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:28.221897 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.221858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8fd168-557f749f54-l44td\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:28.221897 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.221902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcn7d\" (UniqueName: \"kubernetes.io/projected/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-kube-api-access-qcn7d\") pod \"maas-api-e2e-shared-b-8fd168-557f749f54-l44td\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:28.222142 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.221926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-maas-api-tls\") pod \"maas-api-e2e-shared-b-8fd168-557f749f54-l44td\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:28.222142 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:33:28.222030    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-serving-cert: secret "maas-api-e2e-shared-b-8fd168-serving-cert" not found
Jul 28 13:33:28.222142 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:33:28.222110    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-maas-api-tls podName:1a588cb7-de3b-4c4a-bbef-8b4d3521afbb nodeName:}" failed. No retries permitted until 2026-07-28 13:33:28.722092924 +0000 UTC m=+2543.882860836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-maas-api-tls") pod "maas-api-e2e-shared-b-8fd168-557f749f54-l44td" (UID: "1a588cb7-de3b-4c4a-bbef-8b4d3521afbb") : secret "maas-api-e2e-shared-b-8fd168-serving-cert" not found
Jul 28 13:33:28.222591 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.222570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8fd168-557f749f54-l44td\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:28.236789 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.236765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcn7d\" (UniqueName: \"kubernetes.io/projected/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-kube-api-access-qcn7d\") pod \"maas-api-e2e-shared-b-8fd168-557f749f54-l44td\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:28.726654 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.726617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-maas-api-tls\") pod \"maas-api-e2e-shared-b-8fd168-557f749f54-l44td\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:28.729452 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.729426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-maas-api-tls\") pod \"maas-api-e2e-shared-b-8fd168-557f749f54-l44td\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:28.875674 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.875637    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"]
Jul 28 13:33:28.879170 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.879155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:33:28.881947 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.881927    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-8fd168\""
Jul 28 13:33:28.882025 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.882002    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-8fd168-dockercfg-m2dx7\""
Jul 28 13:33:28.889015 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.888994    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"]
Jul 28 13:33:28.929104 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.929068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f2b149-0540-4551-ab10-663abfe6da64-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz\" (UID: \"c8f2b149-0540-4551-ab10-663abfe6da64\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:33:28.929278 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.929139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj8dm\" (UniqueName: \"kubernetes.io/projected/c8f2b149-0540-4551-ab10-663abfe6da64-kube-api-access-pj8dm\") pod \"payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz\" (UID: \"c8f2b149-0540-4551-ab10-663abfe6da64\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:33:28.948693 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:28.948660    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:29.030295 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.030259    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj8dm\" (UniqueName: \"kubernetes.io/projected/c8f2b149-0540-4551-ab10-663abfe6da64-kube-api-access-pj8dm\") pod \"payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz\" (UID: \"c8f2b149-0540-4551-ab10-663abfe6da64\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:33:29.030473 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.030356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f2b149-0540-4551-ab10-663abfe6da64-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz\" (UID: \"c8f2b149-0540-4551-ab10-663abfe6da64\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:33:29.031195 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.031155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f2b149-0540-4551-ab10-663abfe6da64-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz\" (UID: \"c8f2b149-0540-4551-ab10-663abfe6da64\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:33:29.040394 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.040362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj8dm\" (UniqueName: \"kubernetes.io/projected/c8f2b149-0540-4551-ab10-663abfe6da64-kube-api-access-pj8dm\") pod \"payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz\" (UID: \"c8f2b149-0540-4551-ab10-663abfe6da64\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:33:29.104221 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.104188    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"]
Jul 28 13:33:29.106125 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:33:29.106100    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a588cb7_de3b_4c4a_bbef_8b4d3521afbb.slice/crio-d5290d06ea081f61788c472211fd461db3c9383f5ddfc20823703d18e7685bd5 WatchSource:0}: Error finding container d5290d06ea081f61788c472211fd461db3c9383f5ddfc20823703d18e7685bd5: Status 404 returned error can't find the container with id d5290d06ea081f61788c472211fd461db3c9383f5ddfc20823703d18e7685bd5
Jul 28 13:33:29.191940 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.191903    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:33:29.332949 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.332923    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"]
Jul 28 13:33:29.335016 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:33:29.334991    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f2b149_0540_4551_ab10_663abfe6da64.slice/crio-e6616ecad06d1d91b8cbd7030bf81f3039d83b63803fb3329526de3a5c640f43 WatchSource:0}: Error finding container e6616ecad06d1d91b8cbd7030bf81f3039d83b63803fb3329526de3a5c640f43: Status 404 returned error can't find the container with id e6616ecad06d1d91b8cbd7030bf81f3039d83b63803fb3329526de3a5c640f43
Jul 28 13:33:29.409689 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.409649    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz" event={"ID":"c8f2b149-0540-4551-ab10-663abfe6da64","Type":"ContainerStarted","Data":"10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21"}
Jul 28 13:33:29.409891 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.409702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz" event={"ID":"c8f2b149-0540-4551-ab10-663abfe6da64","Type":"ContainerStarted","Data":"e6616ecad06d1d91b8cbd7030bf81f3039d83b63803fb3329526de3a5c640f43"}
Jul 28 13:33:29.409891 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.409776    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:33:29.411061 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.411038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td" event={"ID":"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb","Type":"ContainerStarted","Data":"d5290d06ea081f61788c472211fd461db3c9383f5ddfc20823703d18e7685bd5"}
Jul 28 13:33:29.425683 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:29.425614    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz" podStartSLOduration=1.425595404 podStartE2EDuration="1.425595404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:33:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:33:29.425464426 +0000 UTC m=+2544.586232385" watchObservedRunningTime="2026-07-28 13:33:29.425595404 +0000 UTC m=+2544.586363342"
Jul 28 13:33:30.417852 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:30.417792    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td" event={"ID":"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb","Type":"ContainerStarted","Data":"d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb"}
Jul 28 13:33:30.436406 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:30.436346    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td" podStartSLOduration=1.5422592640000001 podStartE2EDuration="2.436327754s" totalImagesPullingTime="894.06849ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:33:30.434303718 +0000 UTC m=+2545.595071674" watchObservedRunningTime="2026-07-28 13:33:30.436327754 +0000 UTC m=+2545.597095687"
Jul 28 13:33:31.422321 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:31.422293    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:37.433036 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:37.433010    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:33:40.420034 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:33:40.420003    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:36:05.410833 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:36:05.410700    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:36:05.420271 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:36:05.420248    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:36:05.420824 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:36:05.420789    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:36:05.429326 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:36:05.429307    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:41:05.442408 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:41:05.442296    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:41:05.450966 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:41:05.450942    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:41:05.452380 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:41:05.452356    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:41:05.461151 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:41:05.461134    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:43:33.215173 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.215138    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"]
Jul 28 13:43:33.219101 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.219078    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:33.222371 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.222344    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-15d223-serving-cert\""
Jul 28 13:43:33.227536 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.227510    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"]
Jul 28 13:43:33.353753 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.353714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smkq7\" (UniqueName: \"kubernetes.io/projected/14e7129c-4a12-4939-b68f-b612fbe2cb74-kube-api-access-smkq7\") pod \"maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:33.353989 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.353784    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14e7129c-4a12-4939-b68f-b612fbe2cb74-maas-api-tls\") pod \"maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:33.353989 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.353939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14e7129c-4a12-4939-b68f-b612fbe2cb74-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:33.455430 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.455393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14e7129c-4a12-4939-b68f-b612fbe2cb74-maas-api-tls\") pod \"maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:33.455637 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.455499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14e7129c-4a12-4939-b68f-b612fbe2cb74-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:33.455637 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.455601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkq7\" (UniqueName: \"kubernetes.io/projected/14e7129c-4a12-4939-b68f-b612fbe2cb74-kube-api-access-smkq7\") pod \"maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:33.458833 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.457560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14e7129c-4a12-4939-b68f-b612fbe2cb74-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:33.464068 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.464039    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14e7129c-4a12-4939-b68f-b612fbe2cb74-maas-api-tls\") pod \"maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:33.466315 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.466259    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smkq7\" (UniqueName: \"kubernetes.io/projected/14e7129c-4a12-4939-b68f-b612fbe2cb74-kube-api-access-smkq7\") pod \"maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:33.530961 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.530931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:33.681160 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.681135    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"]
Jul 28 13:43:33.683352 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:43:33.683324    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e7129c_4a12_4939_b68f_b612fbe2cb74.slice/crio-3ea2256ce236d043ee51806c95d9890441136364b2c31e8848208b010f9f211a WatchSource:0}: Error finding container 3ea2256ce236d043ee51806c95d9890441136364b2c31e8848208b010f9f211a: Status 404 returned error can't find the container with id 3ea2256ce236d043ee51806c95d9890441136364b2c31e8848208b010f9f211a
Jul 28 13:43:33.684665 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:33.684650    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:43:34.339120 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:34.339085    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn" event={"ID":"14e7129c-4a12-4939-b68f-b612fbe2cb74","Type":"ContainerStarted","Data":"3ea2256ce236d043ee51806c95d9890441136364b2c31e8848208b010f9f211a"}
Jul 28 13:43:35.344875 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:35.344840    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn" event={"ID":"14e7129c-4a12-4939-b68f-b612fbe2cb74","Type":"ContainerStarted","Data":"60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58"}
Jul 28 13:43:35.345283 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:35.344904    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:35.365866 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:35.365781    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn" podStartSLOduration=1.6558181520000002 podStartE2EDuration="2.365763135s" totalImagesPullingTime="709.944983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:35.363906349 +0000 UTC m=+3150.524674304" watchObservedRunningTime="2026-07-28 13:43:35.365763135 +0000 UTC m=+3150.526531069"
Jul 28 13:43:41.355757 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:41.355720    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:43:44.166556 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:44.166519    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8v2cl"]
Jul 28 13:43:44.170350 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:44.170334    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl"
Jul 28 13:43:44.173424 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:44.173400    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 13:43:44.174411 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:44.174394    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6p5xr\""
Jul 28 13:43:44.174514 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:44.174435    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 13:43:44.180607 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:44.180585    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8v2cl"]
Jul 28 13:43:44.258793 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:44.258749    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9cpj\" (UniqueName: \"kubernetes.io/projected/79540247-fe46-4fce-bd5f-ddce80ef1580-kube-api-access-f9cpj\") pod \"kuadrant-operator-catalog-8v2cl\" (UID: \"79540247-fe46-4fce-bd5f-ddce80ef1580\") " pod="kuadrant-system/kuadrant-operator-catalog-8v2cl"
Jul 28 13:43:44.360265 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:44.360222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9cpj\" (UniqueName: \"kubernetes.io/projected/79540247-fe46-4fce-bd5f-ddce80ef1580-kube-api-access-f9cpj\") pod \"kuadrant-operator-catalog-8v2cl\" (UID: \"79540247-fe46-4fce-bd5f-ddce80ef1580\") " pod="kuadrant-system/kuadrant-operator-catalog-8v2cl"
Jul 28 13:43:44.370337 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:44.370300    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9cpj\" (UniqueName: \"kubernetes.io/projected/79540247-fe46-4fce-bd5f-ddce80ef1580-kube-api-access-f9cpj\") pod \"kuadrant-operator-catalog-8v2cl\" (UID: \"79540247-fe46-4fce-bd5f-ddce80ef1580\") " pod="kuadrant-system/kuadrant-operator-catalog-8v2cl"
Jul 28 13:43:44.480855 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:44.480753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl"
Jul 28 13:43:44.626792 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:44.626767    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8v2cl"]
Jul 28 13:43:44.628404 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:43:44.628374    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79540247_fe46_4fce_bd5f_ddce80ef1580.slice/crio-0cef4dc7949ec2f7c3724f612e4513e35585828a945e7bf6755c0516e6436906 WatchSource:0}: Error finding container 0cef4dc7949ec2f7c3724f612e4513e35585828a945e7bf6755c0516e6436906: Status 404 returned error can't find the container with id 0cef4dc7949ec2f7c3724f612e4513e35585828a945e7bf6755c0516e6436906
Jul 28 13:43:45.397678 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:45.397619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl" event={"ID":"79540247-fe46-4fce-bd5f-ddce80ef1580","Type":"ContainerStarted","Data":"0cef4dc7949ec2f7c3724f612e4513e35585828a945e7bf6755c0516e6436906"}
Jul 28 13:43:47.411154 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:47.411116    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl" event={"ID":"79540247-fe46-4fce-bd5f-ddce80ef1580","Type":"ContainerStarted","Data":"2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5"}
Jul 28 13:43:47.430570 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:47.430503    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl" podStartSLOduration=1.6754625399999998 podStartE2EDuration="3.430488382s" totalImagesPullingTime="1.755025842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:47.429035082 +0000 UTC m=+3162.589803060" watchObservedRunningTime="2026-07-28 13:43:47.430488382 +0000 UTC m=+3162.591256316"
Jul 28 13:43:54.481687 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:54.481644    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl"
Jul 28 13:43:54.482146 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:54.481711    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl"
Jul 28 13:43:54.504852 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:54.504826    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl"
Jul 28 13:43:55.477113 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:55.477080    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl"
Jul 28 13:43:55.518337 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:55.518305    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8v2cl"]
Jul 28 13:43:57.463023 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:57.462968    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl" podUID="79540247-fe46-4fce-bd5f-ddce80ef1580" containerName="registry-server" containerID="cri-o://2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5" gracePeriod=2
Jul 28 13:43:57.725441 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:57.725374    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl"
Jul 28 13:43:57.769408 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:57.769371    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9cpj\" (UniqueName: \"kubernetes.io/projected/79540247-fe46-4fce-bd5f-ddce80ef1580-kube-api-access-f9cpj\") pod \"79540247-fe46-4fce-bd5f-ddce80ef1580\" (UID: \"79540247-fe46-4fce-bd5f-ddce80ef1580\") "
Jul 28 13:43:57.771712 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:57.771685    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79540247-fe46-4fce-bd5f-ddce80ef1580-kube-api-access-f9cpj" (OuterVolumeSpecName: "kube-api-access-f9cpj") pod "79540247-fe46-4fce-bd5f-ddce80ef1580" (UID: "79540247-fe46-4fce-bd5f-ddce80ef1580"). InnerVolumeSpecName "kube-api-access-f9cpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:43:57.870195 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:57.870157    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9cpj\" (UniqueName: \"kubernetes.io/projected/79540247-fe46-4fce-bd5f-ddce80ef1580-kube-api-access-f9cpj\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:43:58.468876 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:58.468836    2578 generic.go:356] "Generic (PLEG): container finished" podID="79540247-fe46-4fce-bd5f-ddce80ef1580" containerID="2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5" exitCode=0
Jul 28 13:43:58.469376 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:58.468887    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl"
Jul 28 13:43:58.469376 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:58.468927    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl" event={"ID":"79540247-fe46-4fce-bd5f-ddce80ef1580","Type":"ContainerDied","Data":"2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5"}
Jul 28 13:43:58.469376 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:58.468975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8v2cl" event={"ID":"79540247-fe46-4fce-bd5f-ddce80ef1580","Type":"ContainerDied","Data":"0cef4dc7949ec2f7c3724f612e4513e35585828a945e7bf6755c0516e6436906"}
Jul 28 13:43:58.469376 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:58.468997    2578 scope.go:117] "RemoveContainer" containerID="2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5"
Jul 28 13:43:58.482290 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:58.482264    2578 scope.go:117] "RemoveContainer" containerID="2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5"
Jul 28 13:43:58.482626 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:43:58.482603    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5\": container with ID starting with 2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5 not found: ID does not exist" containerID="2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5"
Jul 28 13:43:58.482699 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:58.482633    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5"} err="failed to get container status \"2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5\": rpc error: code = NotFound desc = could not find container \"2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5\": container with ID starting with 2bb75a921512f4675170b4747d0dd6165d2c806b3a1284d8af625e2eab767eb5 not found: ID does not exist"
Jul 28 13:43:58.500161 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:58.500132    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8v2cl"]
Jul 28 13:43:58.505101 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:58.505075    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8v2cl"]
Jul 28 13:43:59.274869 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:43:59.274833    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79540247-fe46-4fce-bd5f-ddce80ef1580" path="/var/lib/kubelet/pods/79540247-fe46-4fce-bd5f-ddce80ef1580/volumes"
Jul 28 13:44:02.330055 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.330014    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"]
Jul 28 13:44:02.330507 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.330488    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79540247-fe46-4fce-bd5f-ddce80ef1580" containerName="registry-server"
Jul 28 13:44:02.330588 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.330509    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="79540247-fe46-4fce-bd5f-ddce80ef1580" containerName="registry-server"
Jul 28 13:44:02.330630 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.330603    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="79540247-fe46-4fce-bd5f-ddce80ef1580" containerName="registry-server"
Jul 28 13:44:02.335141 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.335114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:02.338757 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.338737    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-220710-serving-cert\""
Jul 28 13:44:02.356159 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.356130    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"]
Jul 28 13:44:02.413489 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.413452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmb52\" (UniqueName: \"kubernetes.io/projected/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-kube-api-access-jmb52\") pod \"maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:02.413489 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.413495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:02.413727 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.413517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:02.514602 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.514571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmb52\" (UniqueName: \"kubernetes.io/projected/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-kube-api-access-jmb52\") pod \"maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:02.514825 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.514611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:02.514825 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.514632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:02.514825 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:44:02.514753    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-serving-cert: secret "maas-api-e2e-ipp-b-220710-serving-cert" not found
Jul 28 13:44:02.515061 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:44:02.514833    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-maas-api-tls podName:ecad3f12-922e-4c15-8df3-15e4bed6d9f4 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:03.014796314 +0000 UTC m=+3178.175564226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-maas-api-tls") pod "maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm" (UID: "ecad3f12-922e-4c15-8df3-15e4bed6d9f4") : secret "maas-api-e2e-ipp-b-220710-serving-cert" not found
Jul 28 13:44:02.515382 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.515360    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:02.525889 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:02.525858    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmb52\" (UniqueName: \"kubernetes.io/projected/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-kube-api-access-jmb52\") pod \"maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:03.020254 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.020218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:03.022977 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.022951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:03.246204 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.246173    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:03.422144 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.422119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"]
Jul 28 13:44:03.424486 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:44:03.424450    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecad3f12_922e_4c15_8df3_15e4bed6d9f4.slice/crio-a49d406cd696a6041d809031ea965a40bf1a318dad2f087c630988b03d0caf83 WatchSource:0}: Error finding container a49d406cd696a6041d809031ea965a40bf1a318dad2f087c630988b03d0caf83: Status 404 returned error can't find the container with id a49d406cd696a6041d809031ea965a40bf1a318dad2f087c630988b03d0caf83
Jul 28 13:44:03.498957 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.498918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm" event={"ID":"ecad3f12-922e-4c15-8df3-15e4bed6d9f4","Type":"ContainerStarted","Data":"a49d406cd696a6041d809031ea965a40bf1a318dad2f087c630988b03d0caf83"}
Jul 28 13:44:03.535538 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.535494    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"]
Jul 28 13:44:03.540292 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.540270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:44:03.543866 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.543797    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-220710-dockercfg-vlwjm\""
Jul 28 13:44:03.544099 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.544084    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-220710\""
Jul 28 13:44:03.558195 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.558124    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"]
Jul 28 13:44:03.626754 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.626716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4\" (UID: \"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:44:03.626970 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.626831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk9pd\" (UniqueName: \"kubernetes.io/projected/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-kube-api-access-mk9pd\") pod \"payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4\" (UID: \"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:44:03.727646 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.727609    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9pd\" (UniqueName: \"kubernetes.io/projected/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-kube-api-access-mk9pd\") pod \"payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4\" (UID: \"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:44:03.727835 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.727712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4\" (UID: \"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:44:03.728422 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.728401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4\" (UID: \"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:44:03.741036 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.741003    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk9pd\" (UniqueName: \"kubernetes.io/projected/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-kube-api-access-mk9pd\") pod \"payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4\" (UID: \"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:44:03.853405 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:03.853376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:44:04.004868 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:04.004782    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"]
Jul 28 13:44:04.009271 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:44:04.009232    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805c401f_98c4_4e9c_b29f_26ebe7dcb1fd.slice/crio-7bb568c26e5ce4bef13fb0034477b0308417697a6e6b4b6d9c0625c7a8e913a4 WatchSource:0}: Error finding container 7bb568c26e5ce4bef13fb0034477b0308417697a6e6b4b6d9c0625c7a8e913a4: Status 404 returned error can't find the container with id 7bb568c26e5ce4bef13fb0034477b0308417697a6e6b4b6d9c0625c7a8e913a4
Jul 28 13:44:04.505875 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:04.505840    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4" event={"ID":"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd","Type":"ContainerStarted","Data":"77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5"}
Jul 28 13:44:04.506386 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:04.505899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4" event={"ID":"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd","Type":"ContainerStarted","Data":"7bb568c26e5ce4bef13fb0034477b0308417697a6e6b4b6d9c0625c7a8e913a4"}
Jul 28 13:44:04.506386 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:04.505947    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:44:04.507410 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:04.507383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm" event={"ID":"ecad3f12-922e-4c15-8df3-15e4bed6d9f4","Type":"ContainerStarted","Data":"8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a"}
Jul 28 13:44:04.507551 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:04.507426    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:04.527728 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:04.527674    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4" podStartSLOduration=1.5276577850000002 podStartE2EDuration="1.527657785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:04.524676207 +0000 UTC m=+3179.685444154" watchObservedRunningTime="2026-07-28 13:44:04.527657785 +0000 UTC m=+3179.688425718"
Jul 28 13:44:04.546183 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:04.546128    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm" podStartSLOduration=2.196679202 podStartE2EDuration="2.54611235s" totalImagesPullingTime="349.433148ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:04.5449729 +0000 UTC m=+3179.705740860" watchObservedRunningTime="2026-07-28 13:44:04.54611235 +0000 UTC m=+3179.706880284"
Jul 28 13:44:10.517842 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:10.517796    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:44:15.515443 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:15.515410    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:44:34.301207 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:44:34.301175    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-f4qlw_62fe0f32-e037-45b9-a596-4e7c7e4987b9/payload-processing/0.log"
Jul 28 13:45:47.246392 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:47.246359    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-f4qlw_62fe0f32-e037-45b9-a596-4e7c7e4987b9/payload-processing/0.log"
Jul 28 13:45:51.945368 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:51.945328    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"]
Jul 28 13:45:51.949088 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:51.949062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:51.953329 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:51.953298    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-ed36e3-serving-cert\""
Jul 28 13:45:51.959708 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:51.959683    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"]
Jul 28 13:45:52.034848 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.034781    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f749d22b-1294-4e8e-8e6d-5c9762df20fe-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:52.035032 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.034894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f749d22b-1294-4e8e-8e6d-5c9762df20fe-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:52.035077 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.035036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtd9r\" (UniqueName: \"kubernetes.io/projected/f749d22b-1294-4e8e-8e6d-5c9762df20fe-kube-api-access-xtd9r\") pod \"maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:52.135793 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.135743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtd9r\" (UniqueName: \"kubernetes.io/projected/f749d22b-1294-4e8e-8e6d-5c9762df20fe-kube-api-access-xtd9r\") pod \"maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:52.136013 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.135831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f749d22b-1294-4e8e-8e6d-5c9762df20fe-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:52.136013 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.135864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f749d22b-1294-4e8e-8e6d-5c9762df20fe-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:52.136013 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:45:52.135968    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-serving-cert: secret "maas-api-e2e-ipp-cleanup-ed36e3-serving-cert" not found
Jul 28 13:45:52.136138 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:45:52.136038    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f749d22b-1294-4e8e-8e6d-5c9762df20fe-maas-api-tls podName:f749d22b-1294-4e8e-8e6d-5c9762df20fe nodeName:}" failed. No retries permitted until 2026-07-28 13:45:52.636020749 +0000 UTC m=+3287.796788661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f749d22b-1294-4e8e-8e6d-5c9762df20fe-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx" (UID: "f749d22b-1294-4e8e-8e6d-5c9762df20fe") : secret "maas-api-e2e-ipp-cleanup-ed36e3-serving-cert" not found
Jul 28 13:45:52.136536 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.136516    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f749d22b-1294-4e8e-8e6d-5c9762df20fe-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:52.144836 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.144787    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtd9r\" (UniqueName: \"kubernetes.io/projected/f749d22b-1294-4e8e-8e6d-5c9762df20fe-kube-api-access-xtd9r\") pod \"maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:52.641285 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.641252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f749d22b-1294-4e8e-8e6d-5c9762df20fe-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:52.643963 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.643939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f749d22b-1294-4e8e-8e6d-5c9762df20fe-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:52.736720 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.736684    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"]
Jul 28 13:45:52.740606 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.740583    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:45:52.743393 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.743373    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-ed36e3\""
Jul 28 13:45:52.743504 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.743464    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-ed36e3-dockercfg-4qr4h\""
Jul 28 13:45:52.754761 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.754734    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"]
Jul 28 13:45:52.842504 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.842460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c42j6\" (UniqueName: \"kubernetes.io/projected/bede448f-fbb8-4349-a5ba-1ba35f68331b-kube-api-access-c42j6\") pod \"payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx\" (UID: \"bede448f-fbb8-4349-a5ba-1ba35f68331b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:45:52.842794 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.842765    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bede448f-fbb8-4349-a5ba-1ba35f68331b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx\" (UID: \"bede448f-fbb8-4349-a5ba-1ba35f68331b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:45:52.862792 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.862749    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:45:52.944706 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.943759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c42j6\" (UniqueName: \"kubernetes.io/projected/bede448f-fbb8-4349-a5ba-1ba35f68331b-kube-api-access-c42j6\") pod \"payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx\" (UID: \"bede448f-fbb8-4349-a5ba-1ba35f68331b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:45:52.944706 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.943889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bede448f-fbb8-4349-a5ba-1ba35f68331b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx\" (UID: \"bede448f-fbb8-4349-a5ba-1ba35f68331b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:45:52.945108 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.944903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bede448f-fbb8-4349-a5ba-1ba35f68331b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx\" (UID: \"bede448f-fbb8-4349-a5ba-1ba35f68331b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:45:52.955536 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:52.955502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c42j6\" (UniqueName: \"kubernetes.io/projected/bede448f-fbb8-4349-a5ba-1ba35f68331b-kube-api-access-c42j6\") pod \"payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx\" (UID: \"bede448f-fbb8-4349-a5ba-1ba35f68331b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:45:53.038966 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:53.038937    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"]
Jul 28 13:45:53.040938 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:45:53.040912    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf749d22b_1294_4e8e_8e6d_5c9762df20fe.slice/crio-d404933faec45e26721d25499fd38287af15dab232eeefa83ab2f20837fba992 WatchSource:0}: Error finding container d404933faec45e26721d25499fd38287af15dab232eeefa83ab2f20837fba992: Status 404 returned error can't find the container with id d404933faec45e26721d25499fd38287af15dab232eeefa83ab2f20837fba992
Jul 28 13:45:53.050950 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:53.050922    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:45:53.057005 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:53.056971    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx" event={"ID":"f749d22b-1294-4e8e-8e6d-5c9762df20fe","Type":"ContainerStarted","Data":"d404933faec45e26721d25499fd38287af15dab232eeefa83ab2f20837fba992"}
Jul 28 13:45:53.201019 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:53.200994    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"]
Jul 28 13:45:53.203382 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:45:53.203347    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbede448f_fbb8_4349_a5ba_1ba35f68331b.slice/crio-d00da1e9d1f8817eb28ff1f1ff768ded2ef4f5d92706067a6e10efc370e7ce8a WatchSource:0}: Error finding container d00da1e9d1f8817eb28ff1f1ff768ded2ef4f5d92706067a6e10efc370e7ce8a: Status 404 returned error can't find the container with id d00da1e9d1f8817eb28ff1f1ff768ded2ef4f5d92706067a6e10efc370e7ce8a
Jul 28 13:45:54.064259 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:54.064228    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx" event={"ID":"bede448f-fbb8-4349-a5ba-1ba35f68331b","Type":"ContainerStarted","Data":"be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351"}
Jul 28 13:45:54.064715 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:54.064279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx" event={"ID":"bede448f-fbb8-4349-a5ba-1ba35f68331b","Type":"ContainerStarted","Data":"d00da1e9d1f8817eb28ff1f1ff768ded2ef4f5d92706067a6e10efc370e7ce8a"}
Jul 28 13:45:54.064715 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:54.064343    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:45:54.137229 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:54.137167    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx" podStartSLOduration=2.137144756 podStartE2EDuration="2.137144756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:45:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:45:54.135926651 +0000 UTC m=+3289.296694607" watchObservedRunningTime="2026-07-28 13:45:54.137144756 +0000 UTC m=+3289.297912693"
Jul 28 13:45:55.071569 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:55.071523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx" event={"ID":"f749d22b-1294-4e8e-8e6d-5c9762df20fe","Type":"ContainerStarted","Data":"94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83"}
Jul 28 13:45:55.072065 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:45:55.071729    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:46:01.088933 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:01.083705    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:46:01.109485 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:01.109425    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx" podStartSLOduration=8.686376599 podStartE2EDuration="10.10940875s" totalImagesPullingTime="1.423032151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:45:55.09836431 +0000 UTC m=+3290.259132247" watchObservedRunningTime="2026-07-28 13:46:01.10940875 +0000 UTC m=+3296.270176683"
Jul 28 13:46:05.074012 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:05.073978    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:46:05.472347 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:05.472153    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:46:05.484841 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:05.481551    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:46:05.485183 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:05.485164    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:46:05.499263 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:05.499235    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m2jmq_68deab70-a94d-415f-9e9e-e6ef32666642/ovn-acl-logging/0.log"
Jul 28 13:46:22.513838 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.513785    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"]
Jul 28 13:46:22.514452 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.514047    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx" podUID="f749d22b-1294-4e8e-8e6d-5c9762df20fe" containerName="maas-api" containerID="cri-o://94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83" gracePeriod=30
Jul 28 13:46:22.582681 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.582642    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"]
Jul 28 13:46:22.582963 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.582935    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx" podUID="bede448f-fbb8-4349-a5ba-1ba35f68331b" containerName="payload-processing" containerID="cri-o://be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351" gracePeriod=30
Jul 28 13:46:22.848510 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.848483    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:46:22.873037 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.873008    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:46:22.933978 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.933946    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c42j6\" (UniqueName: \"kubernetes.io/projected/bede448f-fbb8-4349-a5ba-1ba35f68331b-kube-api-access-c42j6\") pod \"bede448f-fbb8-4349-a5ba-1ba35f68331b\" (UID: \"bede448f-fbb8-4349-a5ba-1ba35f68331b\") "
Jul 28 13:46:22.933978 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.933986    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bede448f-fbb8-4349-a5ba-1ba35f68331b-plugins-config-volume\") pod \"bede448f-fbb8-4349-a5ba-1ba35f68331b\" (UID: \"bede448f-fbb8-4349-a5ba-1ba35f68331b\") "
Jul 28 13:46:22.934227 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.934047    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f749d22b-1294-4e8e-8e6d-5c9762df20fe-maas-api-tls\") pod \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") "
Jul 28 13:46:22.934227 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.934067    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f749d22b-1294-4e8e-8e6d-5c9762df20fe-openshift-service-ca\") pod \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") "
Jul 28 13:46:22.934227 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.934086    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtd9r\" (UniqueName: \"kubernetes.io/projected/f749d22b-1294-4e8e-8e6d-5c9762df20fe-kube-api-access-xtd9r\") pod \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\" (UID: \"f749d22b-1294-4e8e-8e6d-5c9762df20fe\") "
Jul 28 13:46:22.934459 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.934418    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f749d22b-1294-4e8e-8e6d-5c9762df20fe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f749d22b-1294-4e8e-8e6d-5c9762df20fe" (UID: "f749d22b-1294-4e8e-8e6d-5c9762df20fe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:46:22.934459 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.934436    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bede448f-fbb8-4349-a5ba-1ba35f68331b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bede448f-fbb8-4349-a5ba-1ba35f68331b" (UID: "bede448f-fbb8-4349-a5ba-1ba35f68331b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:46:22.936401 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.936374    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f749d22b-1294-4e8e-8e6d-5c9762df20fe-kube-api-access-xtd9r" (OuterVolumeSpecName: "kube-api-access-xtd9r") pod "f749d22b-1294-4e8e-8e6d-5c9762df20fe" (UID: "f749d22b-1294-4e8e-8e6d-5c9762df20fe"). InnerVolumeSpecName "kube-api-access-xtd9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:46:22.936495 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.936404    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f749d22b-1294-4e8e-8e6d-5c9762df20fe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f749d22b-1294-4e8e-8e6d-5c9762df20fe" (UID: "f749d22b-1294-4e8e-8e6d-5c9762df20fe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:46:22.936495 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:22.936380    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bede448f-fbb8-4349-a5ba-1ba35f68331b-kube-api-access-c42j6" (OuterVolumeSpecName: "kube-api-access-c42j6") pod "bede448f-fbb8-4349-a5ba-1ba35f68331b" (UID: "bede448f-fbb8-4349-a5ba-1ba35f68331b"). InnerVolumeSpecName "kube-api-access-c42j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:46:23.035290 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.035246    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c42j6\" (UniqueName: \"kubernetes.io/projected/bede448f-fbb8-4349-a5ba-1ba35f68331b-kube-api-access-c42j6\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:46:23.035290 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.035281    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bede448f-fbb8-4349-a5ba-1ba35f68331b-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:46:23.035290 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.035292    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f749d22b-1294-4e8e-8e6d-5c9762df20fe-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:46:23.035290 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.035300    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f749d22b-1294-4e8e-8e6d-5c9762df20fe-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:46:23.035569 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.035309    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtd9r\" (UniqueName: \"kubernetes.io/projected/f749d22b-1294-4e8e-8e6d-5c9762df20fe-kube-api-access-xtd9r\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:46:23.216187 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.216085    2578 generic.go:356] "Generic (PLEG): container finished" podID="f749d22b-1294-4e8e-8e6d-5c9762df20fe" containerID="94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83" exitCode=0
Jul 28 13:46:23.216187 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.216139    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"
Jul 28 13:46:23.216187 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.216175    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx" event={"ID":"f749d22b-1294-4e8e-8e6d-5c9762df20fe","Type":"ContainerDied","Data":"94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83"}
Jul 28 13:46:23.216450 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.216230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx" event={"ID":"f749d22b-1294-4e8e-8e6d-5c9762df20fe","Type":"ContainerDied","Data":"d404933faec45e26721d25499fd38287af15dab232eeefa83ab2f20837fba992"}
Jul 28 13:46:23.216450 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.216256    2578 scope.go:117] "RemoveContainer" containerID="94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83"
Jul 28 13:46:23.217483 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.217461    2578 generic.go:356] "Generic (PLEG): container finished" podID="bede448f-fbb8-4349-a5ba-1ba35f68331b" containerID="be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351" exitCode=0
Jul 28 13:46:23.217598 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.217503    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"
Jul 28 13:46:23.217598 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.217556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx" event={"ID":"bede448f-fbb8-4349-a5ba-1ba35f68331b","Type":"ContainerDied","Data":"be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351"}
Jul 28 13:46:23.217672 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.217602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx" event={"ID":"bede448f-fbb8-4349-a5ba-1ba35f68331b","Type":"ContainerDied","Data":"d00da1e9d1f8817eb28ff1f1ff768ded2ef4f5d92706067a6e10efc370e7ce8a"}
Jul 28 13:46:23.227548 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.227372    2578 scope.go:117] "RemoveContainer" containerID="94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83"
Jul 28 13:46:23.227756 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:46:23.227729    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83\": container with ID starting with 94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83 not found: ID does not exist" containerID="94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83"
Jul 28 13:46:23.227858 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.227772    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83"} err="failed to get container status \"94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83\": rpc error: code = NotFound desc = could not find container \"94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83\": container with ID starting with 94bc797859371381c1b384213f69f4767fb6b55b0322dd33998f5ad2b4377c83 not found: ID does not exist"
Jul 28 13:46:23.227858 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.227795    2578 scope.go:117] "RemoveContainer" containerID="be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351"
Jul 28 13:46:23.236187 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.236172    2578 scope.go:117] "RemoveContainer" containerID="be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351"
Jul 28 13:46:23.236484 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:46:23.236465    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351\": container with ID starting with be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351 not found: ID does not exist" containerID="be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351"
Jul 28 13:46:23.236553 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.236493    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351"} err="failed to get container status \"be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351\": rpc error: code = NotFound desc = could not find container \"be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351\": container with ID starting with be7af288220d218f31e2a4a941d0e569c6a3017584b3e754f00ec088a5131351 not found: ID does not exist"
Jul 28 13:46:23.243208 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.243181    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"]
Jul 28 13:46:23.253627 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.253604    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-ed36e3-75b45574d5-22bjx"]
Jul 28 13:46:23.272788 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.272747    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f749d22b-1294-4e8e-8e6d-5c9762df20fe" path="/var/lib/kubelet/pods/f749d22b-1294-4e8e-8e6d-5c9762df20fe/volumes"
Jul 28 13:46:23.273196 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.273176    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"]
Jul 28 13:46:23.275905 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:23.275883    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ed36e3-6bbd9576b8-7cwcx"]
Jul 28 13:46:25.272432 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:25.272395    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bede448f-fbb8-4349-a5ba-1ba35f68331b" path="/var/lib/kubelet/pods/bede448f-fbb8-4349-a5ba-1ba35f68331b/volumes"
Jul 28 13:46:55.928921 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:55.928882    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"]
Jul 28 13:46:55.929462 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:55.929159    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn" podUID="14e7129c-4a12-4939-b68f-b612fbe2cb74" containerName="maas-api" containerID="cri-o://60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58" gracePeriod=30
Jul 28 13:46:56.204885 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.204857    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:46:56.346519 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.346480    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14e7129c-4a12-4939-b68f-b612fbe2cb74-maas-api-tls\") pod \"14e7129c-4a12-4939-b68f-b612fbe2cb74\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") "
Jul 28 13:46:56.346714 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.346541    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smkq7\" (UniqueName: \"kubernetes.io/projected/14e7129c-4a12-4939-b68f-b612fbe2cb74-kube-api-access-smkq7\") pod \"14e7129c-4a12-4939-b68f-b612fbe2cb74\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") "
Jul 28 13:46:56.346714 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.346635    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14e7129c-4a12-4939-b68f-b612fbe2cb74-openshift-service-ca\") pod \"14e7129c-4a12-4939-b68f-b612fbe2cb74\" (UID: \"14e7129c-4a12-4939-b68f-b612fbe2cb74\") "
Jul 28 13:46:56.347032 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.347000    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14e7129c-4a12-4939-b68f-b612fbe2cb74-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "14e7129c-4a12-4939-b68f-b612fbe2cb74" (UID: "14e7129c-4a12-4939-b68f-b612fbe2cb74"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:46:56.349040 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.349015    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14e7129c-4a12-4939-b68f-b612fbe2cb74-kube-api-access-smkq7" (OuterVolumeSpecName: "kube-api-access-smkq7") pod "14e7129c-4a12-4939-b68f-b612fbe2cb74" (UID: "14e7129c-4a12-4939-b68f-b612fbe2cb74"). InnerVolumeSpecName "kube-api-access-smkq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:46:56.349170 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.349058    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14e7129c-4a12-4939-b68f-b612fbe2cb74-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "14e7129c-4a12-4939-b68f-b612fbe2cb74" (UID: "14e7129c-4a12-4939-b68f-b612fbe2cb74"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:46:56.394246 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.394203    2578 generic.go:356] "Generic (PLEG): container finished" podID="14e7129c-4a12-4939-b68f-b612fbe2cb74" containerID="60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58" exitCode=0
Jul 28 13:46:56.394246 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.394247    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"
Jul 28 13:46:56.394485 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.394291    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn" event={"ID":"14e7129c-4a12-4939-b68f-b612fbe2cb74","Type":"ContainerDied","Data":"60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58"}
Jul 28 13:46:56.394485 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.394345    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn" event={"ID":"14e7129c-4a12-4939-b68f-b612fbe2cb74","Type":"ContainerDied","Data":"3ea2256ce236d043ee51806c95d9890441136364b2c31e8848208b010f9f211a"}
Jul 28 13:46:56.394485 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.394368    2578 scope.go:117] "RemoveContainer" containerID="60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58"
Jul 28 13:46:56.404241 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.404222    2578 scope.go:117] "RemoveContainer" containerID="60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58"
Jul 28 13:46:56.404522 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:46:56.404502    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58\": container with ID starting with 60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58 not found: ID does not exist" containerID="60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58"
Jul 28 13:46:56.404595 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.404531    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58"} err="failed to get container status \"60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58\": rpc error: code = NotFound desc = could not find container \"60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58\": container with ID starting with 60bb96500c698d7be1df4d4cb2a367c0eeac905c91c312608657b119e67bfe58 not found: ID does not exist"
Jul 28 13:46:56.421835 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.421786    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"]
Jul 28 13:46:56.440567 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.440488    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-15d223-54d76ff795-7mjqn"]
Jul 28 13:46:56.448126 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.448091    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14e7129c-4a12-4939-b68f-b612fbe2cb74-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:46:56.448126 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.448117    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14e7129c-4a12-4939-b68f-b612fbe2cb74-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:46:56.448126 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:56.448129    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smkq7\" (UniqueName: \"kubernetes.io/projected/14e7129c-4a12-4939-b68f-b612fbe2cb74-kube-api-access-smkq7\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:46:57.271364 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:46:57.271328    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14e7129c-4a12-4939-b68f-b612fbe2cb74" path="/var/lib/kubelet/pods/14e7129c-4a12-4939-b68f-b612fbe2cb74/volumes"
Jul 28 13:47:33.740090 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:33.740054    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"]
Jul 28 13:47:33.740646 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:33.740305    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm" podUID="ecad3f12-922e-4c15-8df3-15e4bed6d9f4" containerName="maas-api" containerID="cri-o://8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a" gracePeriod=30
Jul 28 13:47:33.832579 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:33.832538    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"]
Jul 28 13:47:33.832781 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:33.832757    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4" podUID="805c401f-98c4-4e9c-b29f-26ebe7dcb1fd" containerName="payload-pre-processing" containerID="cri-o://77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5" gracePeriod=30
Jul 28 13:47:34.101647 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.101621    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:47:34.122481 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.122457    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:47:34.196661 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.196619    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-plugins-config-volume\") pod \"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd\" (UID: \"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd\") "
Jul 28 13:47:34.196900 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.196676    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmb52\" (UniqueName: \"kubernetes.io/projected/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-kube-api-access-jmb52\") pod \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") "
Jul 28 13:47:34.196900 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.196723    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-maas-api-tls\") pod \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") "
Jul 28 13:47:34.196900 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.196850    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk9pd\" (UniqueName: \"kubernetes.io/projected/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-kube-api-access-mk9pd\") pod \"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd\" (UID: \"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd\") "
Jul 28 13:47:34.196900 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.196891    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-openshift-service-ca\") pod \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\" (UID: \"ecad3f12-922e-4c15-8df3-15e4bed6d9f4\") "
Jul 28 13:47:34.197134 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.197085    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "805c401f-98c4-4e9c-b29f-26ebe7dcb1fd" (UID: "805c401f-98c4-4e9c-b29f-26ebe7dcb1fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:47:34.197341 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.197314    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:47:34.197341 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.197311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ecad3f12-922e-4c15-8df3-15e4bed6d9f4" (UID: "ecad3f12-922e-4c15-8df3-15e4bed6d9f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:47:34.198970 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.198949    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ecad3f12-922e-4c15-8df3-15e4bed6d9f4" (UID: "ecad3f12-922e-4c15-8df3-15e4bed6d9f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:47:34.199518 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.199497    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-kube-api-access-mk9pd" (OuterVolumeSpecName: "kube-api-access-mk9pd") pod "805c401f-98c4-4e9c-b29f-26ebe7dcb1fd" (UID: "805c401f-98c4-4e9c-b29f-26ebe7dcb1fd"). InnerVolumeSpecName "kube-api-access-mk9pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:47:34.199596 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.199524    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-kube-api-access-jmb52" (OuterVolumeSpecName: "kube-api-access-jmb52") pod "ecad3f12-922e-4c15-8df3-15e4bed6d9f4" (UID: "ecad3f12-922e-4c15-8df3-15e4bed6d9f4"). InnerVolumeSpecName "kube-api-access-jmb52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:47:34.298451 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.298415    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmb52\" (UniqueName: \"kubernetes.io/projected/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-kube-api-access-jmb52\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:47:34.298451 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.298451    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:47:34.298668 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.298463    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk9pd\" (UniqueName: \"kubernetes.io/projected/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd-kube-api-access-mk9pd\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:47:34.298668 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.298471    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecad3f12-922e-4c15-8df3-15e4bed6d9f4-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:47:34.578155 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.578054    2578 generic.go:356] "Generic (PLEG): container finished" podID="805c401f-98c4-4e9c-b29f-26ebe7dcb1fd" containerID="77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5" exitCode=0
Jul 28 13:47:34.578155 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.578115    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"
Jul 28 13:47:34.578155 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.578137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4" event={"ID":"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd","Type":"ContainerDied","Data":"77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5"}
Jul 28 13:47:34.578463 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.578195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4" event={"ID":"805c401f-98c4-4e9c-b29f-26ebe7dcb1fd","Type":"ContainerDied","Data":"7bb568c26e5ce4bef13fb0034477b0308417697a6e6b4b6d9c0625c7a8e913a4"}
Jul 28 13:47:34.578463 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.578232    2578 scope.go:117] "RemoveContainer" containerID="77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5"
Jul 28 13:47:34.579458 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.579411    2578 generic.go:356] "Generic (PLEG): container finished" podID="ecad3f12-922e-4c15-8df3-15e4bed6d9f4" containerID="8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a" exitCode=0
Jul 28 13:47:34.579548 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.579467    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"
Jul 28 13:47:34.579548 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.579502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm" event={"ID":"ecad3f12-922e-4c15-8df3-15e4bed6d9f4","Type":"ContainerDied","Data":"8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a"}
Jul 28 13:47:34.579666 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.579558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm" event={"ID":"ecad3f12-922e-4c15-8df3-15e4bed6d9f4","Type":"ContainerDied","Data":"a49d406cd696a6041d809031ea965a40bf1a318dad2f087c630988b03d0caf83"}
Jul 28 13:47:34.588056 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.588040    2578 scope.go:117] "RemoveContainer" containerID="77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5"
Jul 28 13:47:34.588333 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:47:34.588314    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5\": container with ID starting with 77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5 not found: ID does not exist" containerID="77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5"
Jul 28 13:47:34.588415 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.588342    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5"} err="failed to get container status \"77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5\": rpc error: code = NotFound desc = could not find container \"77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5\": container with ID starting with 77c2220c33b6d2548f138fb9fd8fadcad4ccdab602871d9d9e76806ccd7d77c5 not found: ID does not exist"
Jul 28 13:47:34.588415 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.588359    2578 scope.go:117] "RemoveContainer" containerID="8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a"
Jul 28 13:47:34.597041 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.597020    2578 scope.go:117] "RemoveContainer" containerID="8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a"
Jul 28 13:47:34.597285 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:47:34.597264    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a\": container with ID starting with 8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a not found: ID does not exist" containerID="8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a"
Jul 28 13:47:34.597371 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.597294    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a"} err="failed to get container status \"8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a\": rpc error: code = NotFound desc = could not find container \"8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a\": container with ID starting with 8e9163f5c800c63e83adb5ef9dffd8b6f5f681e8df2e7d5e80eaac5b2dd3536a not found: ID does not exist"
Jul 28 13:47:34.604821 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.604785    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"]
Jul 28 13:47:34.610141 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.610118    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-220710-6588c5cf7b-nj4z4"]
Jul 28 13:47:34.622484 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.622457    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"]
Jul 28 13:47:34.628396 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:34.628374    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-220710-8676768ddc-mjrsm"]
Jul 28 13:47:35.272382 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:35.272349    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="805c401f-98c4-4e9c-b29f-26ebe7dcb1fd" path="/var/lib/kubelet/pods/805c401f-98c4-4e9c-b29f-26ebe7dcb1fd/volumes"
Jul 28 13:47:35.272763 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:35.272736    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecad3f12-922e-4c15-8df3-15e4bed6d9f4" path="/var/lib/kubelet/pods/ecad3f12-922e-4c15-8df3-15e4bed6d9f4/volumes"
Jul 28 13:47:52.329176 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.329141    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"]
Jul 28 13:47:52.329744 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.329385    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8" podUID="3f156553-f5fb-43e9-8fce-1403b1550d67" containerName="maas-api" containerID="cri-o://6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4" gracePeriod=30
Jul 28 13:47:52.585954 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.585872    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:47:52.665699 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.665662    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd8wt\" (UniqueName: \"kubernetes.io/projected/3f156553-f5fb-43e9-8fce-1403b1550d67-kube-api-access-wd8wt\") pod \"3f156553-f5fb-43e9-8fce-1403b1550d67\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") "
Jul 28 13:47:52.665910 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.665724    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f156553-f5fb-43e9-8fce-1403b1550d67-maas-api-tls\") pod \"3f156553-f5fb-43e9-8fce-1403b1550d67\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") "
Jul 28 13:47:52.665910 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.665767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f156553-f5fb-43e9-8fce-1403b1550d67-openshift-service-ca\") pod \"3f156553-f5fb-43e9-8fce-1403b1550d67\" (UID: \"3f156553-f5fb-43e9-8fce-1403b1550d67\") "
Jul 28 13:47:52.666207 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.666185    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f156553-f5fb-43e9-8fce-1403b1550d67-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f156553-f5fb-43e9-8fce-1403b1550d67" (UID: "3f156553-f5fb-43e9-8fce-1403b1550d67"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:47:52.668155 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.668126    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f156553-f5fb-43e9-8fce-1403b1550d67-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f156553-f5fb-43e9-8fce-1403b1550d67" (UID: "3f156553-f5fb-43e9-8fce-1403b1550d67"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:47:52.668275 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.668188    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f156553-f5fb-43e9-8fce-1403b1550d67-kube-api-access-wd8wt" (OuterVolumeSpecName: "kube-api-access-wd8wt") pod "3f156553-f5fb-43e9-8fce-1403b1550d67" (UID: "3f156553-f5fb-43e9-8fce-1403b1550d67"). InnerVolumeSpecName "kube-api-access-wd8wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:47:52.671505 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.671478    2578 generic.go:356] "Generic (PLEG): container finished" podID="3f156553-f5fb-43e9-8fce-1403b1550d67" containerID="6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4" exitCode=0
Jul 28 13:47:52.671623 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.671524    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"
Jul 28 13:47:52.671623 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.671536    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8" event={"ID":"3f156553-f5fb-43e9-8fce-1403b1550d67","Type":"ContainerDied","Data":"6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4"}
Jul 28 13:47:52.671623 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.671583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8" event={"ID":"3f156553-f5fb-43e9-8fce-1403b1550d67","Type":"ContainerDied","Data":"858b9c5e7a8311684783a2b52a08168f479095ee4245c1bd31f237ae4b86f0b9"}
Jul 28 13:47:52.671623 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.671604    2578 scope.go:117] "RemoveContainer" containerID="6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4"
Jul 28 13:47:52.687721 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.687702    2578 scope.go:117] "RemoveContainer" containerID="6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4"
Jul 28 13:47:52.688031 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:47:52.688013    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4\": container with ID starting with 6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4 not found: ID does not exist" containerID="6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4"
Jul 28 13:47:52.688083 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.688042    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4"} err="failed to get container status \"6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4\": rpc error: code = NotFound desc = could not find container \"6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4\": container with ID starting with 6f8d9d3fe4ce520b62e79565f82c77e35e291b697907b6550619655d6e2843b4 not found: ID does not exist"
Jul 28 13:47:52.702314 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.702279    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"]
Jul 28 13:47:52.706896 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.706873    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2c9e23-6cbd69995b-m8fl8"]
Jul 28 13:47:52.766916 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.766871    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd8wt\" (UniqueName: \"kubernetes.io/projected/3f156553-f5fb-43e9-8fce-1403b1550d67-kube-api-access-wd8wt\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:47:52.766916 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.766901    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f156553-f5fb-43e9-8fce-1403b1550d67-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:47:52.766916 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:52.766912    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f156553-f5fb-43e9-8fce-1403b1550d67-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:47:53.272370 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:47:53.272332    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f156553-f5fb-43e9-8fce-1403b1550d67" path="/var/lib/kubelet/pods/3f156553-f5fb-43e9-8fce-1403b1550d67/volumes"
Jul 28 13:48:10.668471 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:10.668433    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"]
Jul 28 13:48:10.668915 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:10.668661    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td" podUID="1a588cb7-de3b-4c4a-bbef-8b4d3521afbb" containerName="maas-api" containerID="cri-o://d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb" gracePeriod=30
Jul 28 13:48:10.771929 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:10.771892    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"]
Jul 28 13:48:10.772205 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:10.772160    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz" podUID="c8f2b149-0540-4551-ab10-663abfe6da64" containerName="payload-pre-processing" containerID="cri-o://10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21" gracePeriod=30
Jul 28 13:48:10.948778 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:10.948748    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:48:11.001308 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.001275    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-maas-api-tls\") pod \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") "
Jul 28 13:48:11.001308 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.001322    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-openshift-service-ca\") pod \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") "
Jul 28 13:48:11.001524 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.001369    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcn7d\" (UniqueName: \"kubernetes.io/projected/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-kube-api-access-qcn7d\") pod \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\" (UID: \"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb\") "
Jul 28 13:48:11.001798 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.001770    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1a588cb7-de3b-4c4a-bbef-8b4d3521afbb" (UID: "1a588cb7-de3b-4c4a-bbef-8b4d3521afbb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:48:11.003608 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.003574    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-kube-api-access-qcn7d" (OuterVolumeSpecName: "kube-api-access-qcn7d") pod "1a588cb7-de3b-4c4a-bbef-8b4d3521afbb" (UID: "1a588cb7-de3b-4c4a-bbef-8b4d3521afbb"). InnerVolumeSpecName "kube-api-access-qcn7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:48:11.003758 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.003621    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1a588cb7-de3b-4c4a-bbef-8b4d3521afbb" (UID: "1a588cb7-de3b-4c4a-bbef-8b4d3521afbb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:48:11.042026 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.041997    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:48:11.102064 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.102030    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f2b149-0540-4551-ab10-663abfe6da64-plugins-config-volume\") pod \"c8f2b149-0540-4551-ab10-663abfe6da64\" (UID: \"c8f2b149-0540-4551-ab10-663abfe6da64\") "
Jul 28 13:48:11.102257 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.102105    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj8dm\" (UniqueName: \"kubernetes.io/projected/c8f2b149-0540-4551-ab10-663abfe6da64-kube-api-access-pj8dm\") pod \"c8f2b149-0540-4551-ab10-663abfe6da64\" (UID: \"c8f2b149-0540-4551-ab10-663abfe6da64\") "
Jul 28 13:48:11.102410 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.102392    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-maas-api-tls\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:48:11.102481 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.102417    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-openshift-service-ca\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:48:11.102481 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.102435    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcn7d\" (UniqueName: \"kubernetes.io/projected/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb-kube-api-access-qcn7d\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:48:11.102481 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.102471    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8f2b149-0540-4551-ab10-663abfe6da64-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c8f2b149-0540-4551-ab10-663abfe6da64" (UID: "c8f2b149-0540-4551-ab10-663abfe6da64"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:48:11.104395 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.104370    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f2b149-0540-4551-ab10-663abfe6da64-kube-api-access-pj8dm" (OuterVolumeSpecName: "kube-api-access-pj8dm") pod "c8f2b149-0540-4551-ab10-663abfe6da64" (UID: "c8f2b149-0540-4551-ab10-663abfe6da64"). InnerVolumeSpecName "kube-api-access-pj8dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:48:11.203429 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.203341    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f2b149-0540-4551-ab10-663abfe6da64-plugins-config-volume\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:48:11.203429 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.203371    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj8dm\" (UniqueName: \"kubernetes.io/projected/c8f2b149-0540-4551-ab10-663abfe6da64-kube-api-access-pj8dm\") on node \"ip-10-0-136-204.ec2.internal\" DevicePath \"\""
Jul 28 13:48:11.769046 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.769008    2578 generic.go:356] "Generic (PLEG): container finished" podID="c8f2b149-0540-4551-ab10-663abfe6da64" containerID="10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21" exitCode=0
Jul 28 13:48:11.769046 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.769052    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"
Jul 28 13:48:11.769532 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.769101    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz" event={"ID":"c8f2b149-0540-4551-ab10-663abfe6da64","Type":"ContainerDied","Data":"10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21"}
Jul 28 13:48:11.769532 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.769167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz" event={"ID":"c8f2b149-0540-4551-ab10-663abfe6da64","Type":"ContainerDied","Data":"e6616ecad06d1d91b8cbd7030bf81f3039d83b63803fb3329526de3a5c640f43"}
Jul 28 13:48:11.769532 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.769199    2578 scope.go:117] "RemoveContainer" containerID="10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21"
Jul 28 13:48:11.770568 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.770535    2578 generic.go:356] "Generic (PLEG): container finished" podID="1a588cb7-de3b-4c4a-bbef-8b4d3521afbb" containerID="d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb" exitCode=0
Jul 28 13:48:11.770634 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.770577    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"
Jul 28 13:48:11.770677 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.770630    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td" event={"ID":"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb","Type":"ContainerDied","Data":"d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb"}
Jul 28 13:48:11.770712 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.770679    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td" event={"ID":"1a588cb7-de3b-4c4a-bbef-8b4d3521afbb","Type":"ContainerDied","Data":"d5290d06ea081f61788c472211fd461db3c9383f5ddfc20823703d18e7685bd5"}
Jul 28 13:48:11.778308 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.778292    2578 scope.go:117] "RemoveContainer" containerID="10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21"
Jul 28 13:48:11.778548 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:48:11.778530    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21\": container with ID starting with 10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21 not found: ID does not exist" containerID="10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21"
Jul 28 13:48:11.778629 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.778554    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21"} err="failed to get container status \"10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21\": rpc error: code = NotFound desc = could not find container \"10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21\": container with ID starting with 10579aa3cfdc4d4bc631b86d6a08d682a2cc5a786af729ea769b129028a87d21 not found: ID does not exist"
Jul 28 13:48:11.778629 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.778570    2578 scope.go:117] "RemoveContainer" containerID="d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb"
Jul 28 13:48:11.787243 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.787220    2578 scope.go:117] "RemoveContainer" containerID="d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb"
Jul 28 13:48:11.787383 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.787366    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"]
Jul 28 13:48:11.787517 ip-10-0-136-204 kubenswrapper[2578]: E0728 13:48:11.787498    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb\": container with ID starting with d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb not found: ID does not exist" containerID="d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb"
Jul 28 13:48:11.787565 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.787526    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb"} err="failed to get container status \"d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb\": rpc error: code = NotFound desc = could not find container \"d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb\": container with ID starting with d3e76a484a064da0aca900308eed9b1c978e5822a4bc82eb6eeedce5bd99bacb not found: ID does not exist"
Jul 28 13:48:11.791099 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.791075    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8fd168-557f749f54-l44td"]
Jul 28 13:48:11.803131 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.803097    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"]
Jul 28 13:48:11.805482 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:11.805460    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-8fd168-77f9668988-nfqzz"]
Jul 28 13:48:13.272202 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:13.272168    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a588cb7-de3b-4c4a-bbef-8b4d3521afbb" path="/var/lib/kubelet/pods/1a588cb7-de3b-4c4a-bbef-8b4d3521afbb/volumes"
Jul 28 13:48:13.272685 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:13.272664    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f2b149-0540-4551-ab10-663abfe6da64" path="/var/lib/kubelet/pods/c8f2b149-0540-4551-ab10-663abfe6da64/volumes"
Jul 28 13:48:26.526967 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:26.526927    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bb96bdcb-hlgqg_ba80b53c-17ca-41a6-9505-bf7d11a71961/manager/0.log"
Jul 28 13:48:27.027018 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:27.026979    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bb544cf8-cccl6_6de136f9-5cd7-40ad-8820-fd896420a2a6/copy-manifests/0.log"
Jul 28 13:48:27.037236 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:27.037205    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bb544cf8-cccl6_6de136f9-5cd7-40ad-8820-fd896420a2a6/manager/0.log"
Jul 28 13:48:27.537688 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:27.537660    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-654d46db6b-hj2ks_a9f5eba1-f3a5-4888-be95-37121dd02dcf/maas-api/0.log"
Jul 28 13:48:28.006394 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:28.006316    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-fh99n_58007ecf-900f-4475-ba1a-33c0fb17cb34/postgres/0.log"
Jul 28 13:48:30.763787 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:30.763754    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mb7fn_3cb43755-0c43-4964-9700-a3d0fd53febb/discovery/0.log"
Jul 28 13:48:31.505618 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:31.505583    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-f4qlw_62fe0f32-e037-45b9-a596-4e7c7e4987b9/payload-processing/0.log"
Jul 28 13:48:31.674562 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:31.674523    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-98cffcd85-lcdgz_bf21c8e3-9a60-4dfa-a9c5-79744cecceb1/router/0.log"
Jul 28 13:48:32.133922 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:32.133894    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wdwjg_e4d368ad-8854-408f-b71d-a002524139cc/main/0.log"
Jul 28 13:48:32.385865 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:32.385769    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fhhr4_8fda14f4-69b2-43f0-8c90-3df68e355bc7/main/0.log"
Jul 28 13:48:32.653832 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:32.653722    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-pntgp_1043c521-a944-438d-a3b1-709f4c8262b1/main/0.log"
Jul 28 13:48:43.475406 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:43.475371    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qsknb_da3d8ccd-539e-4d22-9e58-2851a576a3cd/global-pull-secret-syncer/0.log"
Jul 28 13:48:43.630273 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:43.630238    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kvr75_95627455-5e31-4559-9b52-fb1864f3c6c5/konnectivity-agent/0.log"
Jul 28 13:48:43.763298 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:43.763220    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-204.ec2.internal_94d3a7ac9a84028a23c9e8da860b6db4/haproxy/0.log"
Jul 28 13:48:51.409356 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:51.409304    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-4vb57_75391787-ee75-4954-af25-755dd1f434b4/cluster-monitoring-operator/0.log"
Jul 28 13:48:51.717016 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:51.716944    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4bj5p_54e95159-3335-4796-9e96-30ec5873dd31/node-exporter/0.log"
Jul 28 13:48:51.747357 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:51.747333    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4bj5p_54e95159-3335-4796-9e96-30ec5873dd31/kube-rbac-proxy/0.log"
Jul 28 13:48:51.775635 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:51.775613    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4bj5p_54e95159-3335-4796-9e96-30ec5873dd31/init-textfile/0.log"
Jul 28 13:48:52.368484 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:52.368450    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b7d87986-sqkfm_01fcd59c-1576-4a5d-8925-c209270bcae3/telemeter-client/0.log"
Jul 28 13:48:52.395223 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:52.395196    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b7d87986-sqkfm_01fcd59c-1576-4a5d-8925-c209270bcae3/reload/0.log"
Jul 28 13:48:52.423924 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:52.423899    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b7d87986-sqkfm_01fcd59c-1576-4a5d-8925-c209270bcae3/kube-rbac-proxy/0.log"
Jul 28 13:48:53.392002 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.391968    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"]
Jul 28 13:48:53.392328 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392316    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805c401f-98c4-4e9c-b29f-26ebe7dcb1fd" containerName="payload-pre-processing"
Jul 28 13:48:53.392378 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392330    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="805c401f-98c4-4e9c-b29f-26ebe7dcb1fd" containerName="payload-pre-processing"
Jul 28 13:48:53.392378 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392344    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f749d22b-1294-4e8e-8e6d-5c9762df20fe" containerName="maas-api"
Jul 28 13:48:53.392378 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392350    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f749d22b-1294-4e8e-8e6d-5c9762df20fe" containerName="maas-api"
Jul 28 13:48:53.392378 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392365    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a588cb7-de3b-4c4a-bbef-8b4d3521afbb" containerName="maas-api"
Jul 28 13:48:53.392378 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392371    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a588cb7-de3b-4c4a-bbef-8b4d3521afbb" containerName="maas-api"
Jul 28 13:48:53.392378 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392378    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14e7129c-4a12-4939-b68f-b612fbe2cb74" containerName="maas-api"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392383    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="14e7129c-4a12-4939-b68f-b612fbe2cb74" containerName="maas-api"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392390    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bede448f-fbb8-4349-a5ba-1ba35f68331b" containerName="payload-processing"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392395    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bede448f-fbb8-4349-a5ba-1ba35f68331b" containerName="payload-processing"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392403    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f156553-f5fb-43e9-8fce-1403b1550d67" containerName="maas-api"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392408    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f156553-f5fb-43e9-8fce-1403b1550d67" containerName="maas-api"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392415    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f2b149-0540-4551-ab10-663abfe6da64" containerName="payload-pre-processing"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392419    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f2b149-0540-4551-ab10-663abfe6da64" containerName="payload-pre-processing"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392426    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecad3f12-922e-4c15-8df3-15e4bed6d9f4" containerName="maas-api"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392431    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecad3f12-922e-4c15-8df3-15e4bed6d9f4" containerName="maas-api"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392489    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="14e7129c-4a12-4939-b68f-b612fbe2cb74" containerName="maas-api"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392499    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="805c401f-98c4-4e9c-b29f-26ebe7dcb1fd" containerName="payload-pre-processing"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392505    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecad3f12-922e-4c15-8df3-15e4bed6d9f4" containerName="maas-api"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392510    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f749d22b-1294-4e8e-8e6d-5c9762df20fe" containerName="maas-api"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392517    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f156553-f5fb-43e9-8fce-1403b1550d67" containerName="maas-api"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392522    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a588cb7-de3b-4c4a-bbef-8b4d3521afbb" containerName="maas-api"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392526    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f2b149-0540-4551-ab10-663abfe6da64" containerName="payload-pre-processing"
Jul 28 13:48:53.392573 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.392532    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bede448f-fbb8-4349-a5ba-1ba35f68331b" containerName="payload-processing"
Jul 28 13:48:53.395621 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.395605    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.400438 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.400417    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gt2h\"/\"openshift-service-ca.crt\""
Jul 28 13:48:53.400575 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.400447    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4gt2h\"/\"default-dockercfg-tljvg\""
Jul 28 13:48:53.400575 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.400449    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gt2h\"/\"kube-root-ca.crt\""
Jul 28 13:48:53.408331 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.408308    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"]
Jul 28 13:48:53.495220 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.495179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-sys\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.495220 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.495223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-lib-modules\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.495703 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.495243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-proc\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.495703 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.495357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-podres\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.495703 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.495422    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqz6f\" (UniqueName: \"kubernetes.io/projected/1f4caf90-61f1-4594-b3fc-47b133598208-kube-api-access-hqz6f\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.596666 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.596631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-proc\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.596877 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.596682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-podres\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.596877 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.596721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqz6f\" (UniqueName: \"kubernetes.io/projected/1f4caf90-61f1-4594-b3fc-47b133598208-kube-api-access-hqz6f\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.596877 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.596756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-proc\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.596877 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.596786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-sys\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.596877 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.596839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-lib-modules\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.597064 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.596923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-sys\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.597064 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.596946    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-lib-modules\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.597064 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.596923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f4caf90-61f1-4594-b3fc-47b133598208-podres\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.605733 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.605713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqz6f\" (UniqueName: \"kubernetes.io/projected/1f4caf90-61f1-4594-b3fc-47b133598208-kube-api-access-hqz6f\") pod \"perf-node-gather-daemonset-kmsrr\" (UID: \"1f4caf90-61f1-4594-b3fc-47b133598208\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.706156 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.706064    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.759085 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.759055    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-c7dk6_dd65c8d4-7057-46c9-945c-ce9db4bf0150/networking-console-plugin/0.log"
Jul 28 13:48:53.848510 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.848485    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"]
Jul 28 13:48:53.851270 ip-10-0-136-204 kubenswrapper[2578]: W0728 13:48:53.851243    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1f4caf90_61f1_4594_b3fc_47b133598208.slice/crio-02ccd8d2a95889cfe28d03df1dad563b05b8d25a80bc7e12f91f652f107652be WatchSource:0}: Error finding container 02ccd8d2a95889cfe28d03df1dad563b05b8d25a80bc7e12f91f652f107652be: Status 404 returned error can't find the container with id 02ccd8d2a95889cfe28d03df1dad563b05b8d25a80bc7e12f91f652f107652be
Jul 28 13:48:53.975121 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.975086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr" event={"ID":"1f4caf90-61f1-4594-b3fc-47b133598208","Type":"ContainerStarted","Data":"c0f9e47ddd0998ad86b4901062976b30c4128acb3bb0ffb3599889d89b28b2a7"}
Jul 28 13:48:53.975278 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.975150    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr" event={"ID":"1f4caf90-61f1-4594-b3fc-47b133598208","Type":"ContainerStarted","Data":"02ccd8d2a95889cfe28d03df1dad563b05b8d25a80bc7e12f91f652f107652be"}
Jul 28 13:48:53.975278 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.975270    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:48:53.993882 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:53.993827    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr" podStartSLOduration=0.993792895 podStartE2EDuration="993.792895ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:48:53.992599039 +0000 UTC m=+3469.153367010" watchObservedRunningTime="2026-07-28 13:48:53.993792895 +0000 UTC m=+3469.154560828"
Jul 28 13:48:54.407682 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:54.407647    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/1.log"
Jul 28 13:48:54.412781 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:54.412761    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-k7ghm_db0c90d4-38e0-4275-bc1c-98ac44f91d58/console-operator/2.log"
Jul 28 13:48:54.926794 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:54.926767    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bc999f9c7-fn7k9_4e91ea08-1227-459a-8ee8-0bf1887f6920/console/0.log"
Jul 28 13:48:54.966622 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:54.966593    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-gm2c6_c24ea4ed-96b4-4c63-8b65-ed0fdb3bfed8/download-server/0.log"
Jul 28 13:48:55.577892 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:55.577866    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-msfd9_6b95039e-7b8c-4847-8b03-77de7444f84e/volume-data-source-validator/0.log"
Jul 28 13:48:56.862328 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:56.862297    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7cf9w_011fbc6a-9e73-4aaf-8c83-bd717507d2b5/dns/0.log"
Jul 28 13:48:56.901375 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:56.901350    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7cf9w_011fbc6a-9e73-4aaf-8c83-bd717507d2b5/kube-rbac-proxy/0.log"
Jul 28 13:48:56.939894 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:56.939871    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jskh7_607c523b-7e24-41a6-b546-e945742f9491/dns-node-resolver/0.log"
Jul 28 13:48:57.697218 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:57.697186    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f84gz_f022c708-2f19-42f5-9bc2-c353795dda51/node-ca/0.log"
Jul 28 13:48:58.873597 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:58.873568    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mb7fn_3cb43755-0c43-4964-9700-a3d0fd53febb/discovery/0.log"
Jul 28 13:48:59.094268 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:59.094238    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-f4qlw_62fe0f32-e037-45b9-a596-4e7c7e4987b9/payload-processing/0.log"
Jul 28 13:48:59.121867 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:59.121843    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-98cffcd85-lcdgz_bf21c8e3-9a60-4dfa-a9c5-79744cecceb1/router/0.log"
Jul 28 13:48:59.962006 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:59.961976    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mgf4h_eed8a04e-5aea-410a-a3c6-083c1ebd26bb/serve-healthcheck-canary/0.log"
Jul 28 13:48:59.991177 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:48:59.991151    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-kmsrr"
Jul 28 13:49:00.509994 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:00.509960    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-7b8zl_8e4ad1a7-d332-4a33-8256-bf5082aba4c3/insights-operator/0.log"
Jul 28 13:49:00.510822 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:00.510789    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-7b8zl_8e4ad1a7-d332-4a33-8256-bf5082aba4c3/insights-operator/1.log"
Jul 28 13:49:00.535697 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:00.535671    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hsmkh_d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36/kube-rbac-proxy/0.log"
Jul 28 13:49:00.564658 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:00.564638    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hsmkh_d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36/exporter/0.log"
Jul 28 13:49:00.590641 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:00.590602    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hsmkh_d77a83fd-3c1a-4cd3-ae4c-9244f14f3e36/extractor/0.log"
Jul 28 13:49:03.685239 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:03.685140    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-bb96bdcb-hlgqg_ba80b53c-17ca-41a6-9505-bf7d11a71961/manager/0.log"
Jul 28 13:49:03.786525 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:03.786479    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mb7fn_3cb43755-0c43-4964-9700-a3d0fd53febb/discovery/0.log"
Jul 28 13:49:03.929655 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:03.929618    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bb544cf8-cccl6_6de136f9-5cd7-40ad-8820-fd896420a2a6/manager/0.log"
Jul 28 13:49:03.961673 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:03.961578    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bb544cf8-cccl6_6de136f9-5cd7-40ad-8820-fd896420a2a6/copy-manifests/0.log"
Jul 28 13:49:03.963593 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:03.963572    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-f4qlw_62fe0f32-e037-45b9-a596-4e7c7e4987b9/payload-processing/0.log"
Jul 28 13:49:03.979994 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:03.979970    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-98cffcd85-lcdgz_bf21c8e3-9a60-4dfa-a9c5-79744cecceb1/router/0.log"
Jul 28 13:49:05.480036 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:05.480007    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5fcd6f4d74-pmjhw_9d52370c-ef05-43d0-ad8e-699d8c283fad/manager/0.log"
Jul 28 13:49:05.668316 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:05.668275    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mb7fn_3cb43755-0c43-4964-9700-a3d0fd53febb/discovery/0.log"
Jul 28 13:49:05.848629 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:05.848594    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-f4qlw_62fe0f32-e037-45b9-a596-4e7c7e4987b9/payload-processing/0.log"
Jul 28 13:49:05.869937 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:05.869911    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-98cffcd85-lcdgz_bf21c8e3-9a60-4dfa-a9c5-79744cecceb1/router/0.log"
Jul 28 13:49:11.254462 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:11.254383    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk_30bc73c0-3fcf-4377-8324-d8aa53a6fd95/kube-storage-version-migrator-operator/1.log"
Jul 28 13:49:11.255129 ip-10-0-136-204 kubenswrapper[2578]: I0728 13:49:11.255109    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-lzrgk_30bc73c0-3fcf-4377-8324-d8aa53a6fd95/kube-storage-version-migrator-operator/0.log"