Jul 22 13:46:15.634400 ip-10-0-131-79 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 13:46:16.062474 ip-10-0-131-79 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 13:46:16.062474 ip-10-0-131-79 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 13:46:16.062474 ip-10-0-131-79 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 13:46:16.062474 ip-10-0-131-79 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 13:46:16.062474 ip-10-0-131-79 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 13:46:16.063167 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.062528    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 13:46:16.066000 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.065984    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:16.066000 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.065999    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066002    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066006    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066010    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066012    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066015    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066018    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066021    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066023    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066026    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066028    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066030    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066033    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066035    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066037    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066040    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066042    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066049    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066052    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066055    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:16.066061 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066057    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066059    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066062    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066064    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066067    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066070    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066073    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066076    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066078    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066081    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066083    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066085    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066088    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066090    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066092    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066095    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066097    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066099    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066102    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066104    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:16.066519 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066108    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066111    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066114    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066116    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066119    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066122    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066124    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066128    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066146    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066150    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066153    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066157    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066159    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066162    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066165    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066168    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066170    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066173    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066176    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:16.066976 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066178    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066180    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066183    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066186    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066189    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066191    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066193    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066196    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066198    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066201    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066203    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066205    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066208    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066210    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066212    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066215    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066217    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066220    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066222    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066224    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:16.067477 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066226    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066229    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066231    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066233    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066236    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066239    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066241    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066244    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066247    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066249    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066252    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066254    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066257    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066259    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066262    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066264    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066266    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066268    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066271    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066924    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:16.067935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066930    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066933    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066935    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066938    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066940    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066943    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066945    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066948    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066950    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066952    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066955    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066957    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066961    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066965    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066968    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066971    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066973    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066976    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066979    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:16.068419 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066983    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066985    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066988    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066991    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066993    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066996    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.066998    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067000    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067003    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067005    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067007    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067010    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067012    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067014    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067016    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067019    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067021    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067024    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067026    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067028    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:16.069059 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067031    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067033    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067035    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067037    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067040    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067042    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067045    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067047    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067049    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067052    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067054    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067057    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067061    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067063    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067066    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067069    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067072    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067074    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067077    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067079    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:16.069818 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067082    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067084    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067086    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067089    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067091    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067094    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067096    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067101    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067104    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067107    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067110    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067112    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067115    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067119    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067122    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067125    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067128    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067146    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067149    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:16.070358 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067152    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067155    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067158    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067160    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067163    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067167    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067170    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067173    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067175    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067178    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067181    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067183    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067185    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067188    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067190    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067192    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067195    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067197    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067200    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067202    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:16.070806 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067559    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067563    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067566    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067570    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067574    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067577    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067579    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067582    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067585    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067588    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067591    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067593    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067597    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067600    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067602    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067604    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067606    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067610    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067612    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067615    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:16.071300 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067617    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067620    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067622    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067624    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067627    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067629    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067632    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067634    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067637    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067639    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067641    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067643    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067645    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067648    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067650    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067653    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067655    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067657    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067660    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:16.071760 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067662    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067665    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067667    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067670    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067673    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067675    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067677    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067680    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067682    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067685    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067687    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067697    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067699    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067702    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067704    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067706    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067708    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067711    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067713    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067715    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:16.072243 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067718    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067720    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067722    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067724    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067727    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067729    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067731    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067734    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067736    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067738    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067741    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067743    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067745    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067748    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067751    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067753    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067757    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067760    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067763    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:16.072749 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067766    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067768    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067771    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067774    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067776    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067779    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067781    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067784    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067786    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067789    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067791    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067794    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067796    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067799    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067801    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067803    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067806    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067808    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067810    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067813    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.067815    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:16.073191 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067881    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067887    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067892    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067896    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067900    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067904    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067908    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067912    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067915    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067918    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067922    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067926    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067928    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067931    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067934    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067937    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067940    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067944    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067947    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067950    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067953    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067956    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067959    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067962    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 13:46:16.073670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067965    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067968    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067971    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067974    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067976    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067979    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067981    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067984    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067988    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067991    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067993    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.067997    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068002    2578 flags.go:64] FLAG: --enable-server="true"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068005    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068009    2578 flags.go:64] FLAG: --event-burst="100"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068012    2578 flags.go:64] FLAG: --event-qps="50"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068014    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068017    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068020    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068024    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068027    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068029    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068032    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068035    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068038    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 13:46:16.074261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068041    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068044    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068047    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068050    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068052    2578 flags.go:64] FLAG: --feature-gates=""
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068055    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068058    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068061    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068063    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068066    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068069    2578 flags.go:64] FLAG: --help="false"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068072    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068074    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068077    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068080    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068083    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068086    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068089    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068092    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068095    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068098    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068100    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068103    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068106    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 22 13:46:16.074840 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068108    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068113    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068116    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068118    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068121    2578 flags.go:64] FLAG: --lock-file=""
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068123    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068126    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068145    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068150    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068153    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068156    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068159    2578 flags.go:64] FLAG: --logging-format="text"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068162    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068165    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068167    2578 flags.go:64] FLAG: --manifest-url=""
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068170    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068174    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068177    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068180    2578 flags.go:64] FLAG: --max-pods="110"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068183    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068186    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068189    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068191    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068194    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068197    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 13:46:16.075464 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068200    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068206    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068210    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068213    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068216    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068218    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068224    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068226    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068229    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068233    2578 flags.go:64] FLAG: --port="10250"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068236    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068239    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e65f691c127a1e09"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068242    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068245    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068247    2578 flags.go:64] FLAG: --register-node="true"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068250    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068253    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068256    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068262    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068264    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068268    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068271    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068273    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068276    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068279    2578 flags.go:64] FLAG: --runonce="false"
Jul 22 13:46:16.076073 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068281    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068284    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068287    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068289    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068292    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068294    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068297    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068300    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068302    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068306    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068309    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068311    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068314    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068317    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068320    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068324    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068330    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068333    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068336    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068339    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068342    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068344    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068347    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068350    2578 flags.go:64] FLAG: --v="2"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068353    2578 flags.go:64] FLAG: --version="false"
Jul 22 13:46:16.076680 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068357    2578 flags.go:64] FLAG: --vmodule=""
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068361    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.068364    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069215    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069228    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069232    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069236    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069240    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069244    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069253    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069257    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069261    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069265    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069269    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069274    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069278    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069286    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069290    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069294    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069298    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:16.077326 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069303    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069311    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069316    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069321    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069326    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069330    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069334    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069338    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069342    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069346    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069350    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069354    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069358    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069362    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069372    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069376    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069380    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069384    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069388    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069392    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:16.077783 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069396    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069399    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069403    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069407    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069411    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069417    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069423    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069432    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069439    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069443    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069447    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069452    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069456    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069460    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069464    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069470    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069474    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069478    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069482    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:16.078266 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069490    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069495    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069529    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069553    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069692    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069698    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069702    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069706    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069711    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069715    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069754    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069759    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069763    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069766    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069769    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069772    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069774    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069777    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069779    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:16.078700 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069781    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069784    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069787    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069789    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069791    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069794    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069796    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069799    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069801    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069804    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069807    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069809    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069811    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069814    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069816    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069819    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069822    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069826    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069828    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069831    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:16.079146 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069834    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069837    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069840    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.069842    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.069848    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.076347    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.076363    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.076384    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.076389    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076459    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076465    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076468    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076471    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076474    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:16.079622 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076476    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076479    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076481    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076483    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076486    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076489    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076492    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076494    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076497    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076500    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076503    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076506    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076508    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076510    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076513    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076515    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076518    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076520    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076522    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:16.079964 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076525    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076527    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076529    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076532    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076534    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076538    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076540    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076543    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076545    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076548    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076550    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076553    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076555    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076557    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076560    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076562    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076565    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076567    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076570    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076572    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076574    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:16.080429 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076577    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076579    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076582    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076584    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076586    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076588    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076591    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076593    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076595    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076598    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076600    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076603    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076605    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076607    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076610    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076613    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076616    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076618    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076620    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:16.080919 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076623    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076625    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076628    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076630    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076633    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076635    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076637    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076640    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076642    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076645    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076647    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076650    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076652    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076655    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076658    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076660    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076664    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076667    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076670    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:16.081435 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076673    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076676    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076678    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076681    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076684    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076686    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076689    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076692    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076694    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076697    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076700    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076702    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076705    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076707    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076710    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:16.081951 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076712    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.076717    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076835    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076839    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076842    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076844    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076847    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076849    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076852    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076855    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076857    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076860    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076863    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076865    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076867    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 13:46:16.082320 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076870    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076872    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076875    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076878    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076880    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076882    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076884    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076887    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076889    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076891    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076894    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076896    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076899    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076902    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076904    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076907    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076909    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076911    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076914    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076916    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 13:46:16.082676 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076918    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076921    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076923    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076925    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076928    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076930    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076932    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076935    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076937    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076939    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076943    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076945    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076948    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076952    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076955    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076958    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076960    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076963    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076965    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 13:46:16.083162 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076967    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076970    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076973    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076976    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076979    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076982    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076985    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076987    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076989    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076992    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076995    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076997    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.076999    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077002    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077004    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077006    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077008    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077011    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077013    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077015    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 13:46:16.083610 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077018    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077020    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077022    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077025    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077028    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077030    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077032    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077035    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077037    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077039    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077041    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077044    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077046    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077048    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077050    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077053    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077055    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077058    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077060    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077063    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077065    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 13:46:16.084058 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077068    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 13:46:16.084569 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077070    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 13:46:16.084569 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077072    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 13:46:16.084569 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077076    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 13:46:16.084569 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077079    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 13:46:16.084569 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:16.077082    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 13:46:16.084569 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.077086    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 13:46:16.084569 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.077196    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 13:46:16.084569 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.081385    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 13:46:16.084569 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.082757    2578 server.go:1019] "Starting client certificate rotation"
Jul 22 13:46:16.084569 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.082857    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 13:46:16.084569 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.082893    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 13:46:16.085432 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.085419    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 13:46:16.087160 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.087144    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 13:46:16.099807 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.099790    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 22 13:46:16.102239 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.102223    2578 log.go:25] "Validated CRI v1 image API"
Jul 22 13:46:16.103063 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.103045    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 13:46:16.106995 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.106976    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a4d62d15-53e9-4b18-83a6-2360655d91e5:/dev/nvme0n1p3 c7339f71-1a4b-449d-a261-8d56bddc8ec1:/dev/nvme0n1p4]
Jul 22 13:46:16.107062 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.106994    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 13:46:16.109961 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.109943    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 13:46:16.112087 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.111988    2578 manager.go:216] Machine: {Timestamp:2026-07-22 13:46:16.111542768 +0000 UTC m=+0.353637722 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3210689 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27f38f196ba1bbb5a90440c51eb706 SystemUUID:ec27f38f-196b-a1bb-b5a9-0440c51eb706 BootID:0ab87228-5b37-42de-85f1-0afb8c1dcd04 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dc:0d:4f:73:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dc:0d:4f:73:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:d5:3f:f4:28:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 13:46:16.112087 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.112081    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 13:46:16.112210 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.112165    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 13:46:16.115203 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.115181    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 13:46:16.115333 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.115206    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-79.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 13:46:16.116732 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.116721    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 13:46:16.116762 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.116735    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 13:46:16.116762 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.116743    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 13:46:16.116762 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.116753    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 13:46:16.117999 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.117990    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 13:46:16.121402 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.121391    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 13:46:16.121501 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.121492    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 13:46:16.121531 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.121521    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 13:46:16.121531 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.121530    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 13:46:16.121582 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.121547    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 13:46:16.121582 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.121557    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 22 13:46:16.121582 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.121565    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 13:46:16.121881 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.121870    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 13:46:16.121981 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.121887    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 13:46:16.124117 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.124102    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 13:46:16.125490 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.125478    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 13:46:16.125528 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.125508    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 13:46:16.126160 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126127    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 13:46:16.126192 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126173    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 13:46:16.126192 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126185    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 13:46:16.126247 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126197    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 13:46:16.126247 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126213    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 13:46:16.126247 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126224    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 13:46:16.126247 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126240    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 13:46:16.126341 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126251    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 13:46:16.126341 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126264    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 13:46:16.126341 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126274    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 13:46:16.126341 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126289    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 13:46:16.126341 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.126304    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 13:46:16.127103 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.127093    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 13:46:16.127152 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.127103    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 13:46:16.130365 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.130350    2578 server.go:1268] "Started kubelet"
Jul 22 13:46:16.130447 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.130424    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 13:46:16.130888 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.130551    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 13:46:16.130888 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.130598    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 13:46:16.131340 ip-10-0-131-79 systemd[1]: Started Kubernetes Kubelet.
Jul 22 13:46:16.131727 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.131710    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 13:46:16.133556 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.133540    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 13:46:16.133914 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.133891    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-79.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 13:46:16.134080 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.134051    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 13:46:16.134180 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.134165    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 13:46:16.135004 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.134981    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pb658"
Jul 22 13:46:16.137295 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.137276    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 13:46:16.137607 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.136495    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-79.ec2.internal.18c4a0a36df32cae  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-79.ec2.internal,UID:ip-10-0-131-79.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-79.ec2.internal,},FirstTimestamp:2026-07-22 13:46:16.130325678 +0000 UTC m=+0.372420633,LastTimestamp:2026-07-22 13:46:16.130325678 +0000 UTC m=+0.372420633,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-79.ec2.internal,}"
Jul 22 13:46:16.140491 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.140476    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 13:46:16.140551 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.140497    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 13:46:16.140600 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.140572    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:16.141187 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141166    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 13:46:16.141187 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141188    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 13:46:16.141325 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141192    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 13:46:16.141325 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141292    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 13:46:16.141325 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141297    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 13:46:16.141584 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141568    2578 factory.go:153] Registering CRI-O factory
Jul 22 13:46:16.141584 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141588    2578 factory.go:223] Registration of the crio container factory successfully
Jul 22 13:46:16.141692 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141639    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 13:46:16.141692 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141647    2578 factory.go:55] Registering systemd factory
Jul 22 13:46:16.141692 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141654    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 22 13:46:16.141692 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141676    2578 factory.go:103] Registering Raw factory
Jul 22 13:46:16.141692 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.141684    2578 manager.go:1196] Started watching for new ooms in manager
Jul 22 13:46:16.142244 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.142228    2578 manager.go:349] Starting recovery of all containers
Jul 22 13:46:16.143877 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.143854    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pb658"
Jul 22 13:46:16.146309 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.146281    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 13:46:16.146420 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.146384    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 13:46:16.151602 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.151488    2578 manager.go:354] Recovery completed
Jul 22 13:46:16.153248 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.153228    2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 22 13:46:16.156065 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.156053    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:16.158003 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.157987    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:16.158067 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.158015    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:16.158067 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.158025    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:16.158555 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.158531    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 13:46:16.158555 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.158555    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 13:46:16.158677 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.158573    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 13:46:16.158677 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.158545    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:16.159360 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.159345    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:16.159409 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.159370    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:16.159409 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.159383    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:16.159895 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.159879    2578 policy_none.go:49] "None policy: Start"
Jul 22 13:46:16.159895 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.159897    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 13:46:16.159990 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.159907    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 13:46:16.160389 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.160328    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-79.ec2.internal.18c4a0a36f997c9f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-79.ec2.internal,UID:ip-10-0-131-79.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-79.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-79.ec2.internal,},FirstTimestamp:2026-07-22 13:46:16.158002335 +0000 UTC m=+0.400097291,LastTimestamp:2026-07-22 13:46:16.158002335 +0000 UTC m=+0.400097291,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-79.ec2.internal,}"
Jul 22 13:46:16.161049 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.161035    2578 policy_none.go:47] "Start"
Jul 22 13:46:16.207714 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.207693    2578 manager.go:337] "Starting Device Plugin manager"
Jul 22 13:46:16.207824 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.207738    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 13:46:16.207824 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.207748    2578 server.go:87] "Starting device plugin registration server"
Jul 22 13:46:16.208013 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.208000    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 13:46:16.208054 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.208016    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 13:46:16.208128 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.208110    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 13:46:16.208231 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.208216    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 13:46:16.208281 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.208233    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 13:46:16.208847 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.208825    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 13:46:16.208936 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.208869    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:16.246049 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.246010    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 13:46:16.247333 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.247322    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 13:46:16.247394 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.247356    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 13:46:16.247394 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.247376    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 13:46:16.247471 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.247405    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 13:46:16.250148 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.250113    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:16.308456 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.308434    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:16.309280 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.309264    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:16.309350 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.309297    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:16.309350 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.309308    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:16.309350 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.309331    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.318448 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.318397    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.318448 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.318422    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-79.ec2.internal\": node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:16.336083 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.336063    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:16.348394 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.348365    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal"]
Jul 22 13:46:16.348479 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.348438    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:16.349195 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.349174    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:16.349283 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.349202    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:16.349283 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.349211    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:16.350616 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.350604    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:16.350741 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.350725    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.350777 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.350756    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:16.351261 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.351239    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:16.351353 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.351267    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:16.351353 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.351282    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:16.351353 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.351310    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:16.351353 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.351330    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:16.351353 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.351340    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:16.352372 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.352360    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.352433 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.352383    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 13:46:16.352999 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.352980    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 13:46:16.353072 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.353005    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 13:46:16.353072 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.353020    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeHasSufficientPID"
Jul 22 13:46:16.384692 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.384676    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-79.ec2.internal\" not found" node="ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.385905 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.385892    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-79.ec2.internal\" not found" node="ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.436397 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.436382    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:16.442660 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.442643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dba07077d86471426887abd01210c23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"0dba07077d86471426887abd01210c23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.442714 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.442668    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8d0181de62365719ca8addca6e9fe43-config\") pod \"kube-apiserver-proxy-ip-10-0-131-79.ec2.internal\" (UID: \"e8d0181de62365719ca8addca6e9fe43\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.442714 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.442686    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0dba07077d86471426887abd01210c23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"0dba07077d86471426887abd01210c23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.537112 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.537088    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:16.543487 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.543469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0dba07077d86471426887abd01210c23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"0dba07077d86471426887abd01210c23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.543584 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.543499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dba07077d86471426887abd01210c23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"0dba07077d86471426887abd01210c23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.543584 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.543520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8d0181de62365719ca8addca6e9fe43-config\") pod \"kube-apiserver-proxy-ip-10-0-131-79.ec2.internal\" (UID: \"e8d0181de62365719ca8addca6e9fe43\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.543584 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.543579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0dba07077d86471426887abd01210c23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"0dba07077d86471426887abd01210c23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.543701 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.543636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dba07077d86471426887abd01210c23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal\" (UID: \"0dba07077d86471426887abd01210c23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.543701 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.543670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8d0181de62365719ca8addca6e9fe43-config\") pod \"kube-apiserver-proxy-ip-10-0-131-79.ec2.internal\" (UID: \"e8d0181de62365719ca8addca6e9fe43\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.637969 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.637885    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:16.688438 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.688410    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.688545 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:16.688410    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:16.738172 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.738148    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:16.838668 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.838643    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:16.939262 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:16.939188    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:17.039711 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:17.039684    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:17.082166 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.082125    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 13:46:17.082549 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.082275    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 13:46:17.109695 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.109665    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:17.140100 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:17.140068    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:17.154644 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.154610    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 13:41:16 +0000 UTC" deadline="2028-01-12 02:34:08.512443913 +0000 UTC"
Jul 22 13:46:17.154644 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.154641    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12924h47m51.357807409s"
Jul 22 13:46:17.241024 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:17.240955    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-79.ec2.internal\" not found"
Jul 22 13:46:17.276431 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:17.276387    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d0181de62365719ca8addca6e9fe43.slice/crio-152c43bcccbf91257aa15a75645568fadca980318c1853aa924a6c3ef3686b56 WatchSource:0}: Error finding container 152c43bcccbf91257aa15a75645568fadca980318c1853aa924a6c3ef3686b56: Status 404 returned error can't find the container with id 152c43bcccbf91257aa15a75645568fadca980318c1853aa924a6c3ef3686b56
Jul 22 13:46:17.276696 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:17.276680    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dba07077d86471426887abd01210c23.slice/crio-4aa2697acaacd9caf9c6ff1f2f30372b35eafe57e4da4d0c250f3f3996f5f6db WatchSource:0}: Error finding container 4aa2697acaacd9caf9c6ff1f2f30372b35eafe57e4da4d0c250f3f3996f5f6db: Status 404 returned error can't find the container with id 4aa2697acaacd9caf9c6ff1f2f30372b35eafe57e4da4d0c250f3f3996f5f6db
Jul 22 13:46:17.280477 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.280461    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 13:46:17.294798 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.294771    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:17.300318 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.300298    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:17.341188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.341158    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:17.351933 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.351914    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 13:46:17.352884 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.352871    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal"
Jul 22 13:46:17.361425 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:17.361397    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 13:46:18.103758 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.103727    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 13:46:18.122602 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.122579    2578 apiserver.go:52] "Watching apiserver"
Jul 22 13:46:18.133017 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.132995    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 13:46:18.134211 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.134122    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-nppcl","openshift-multus/network-metrics-daemon-q47d2","openshift-network-diagnostics/network-check-target-hl66n","openshift-network-operator/iptables-alerter-kpg65","openshift-ovn-kubernetes/ovnkube-node-76njp","kube-system/global-pull-secret-syncer-lhzsv","kube-system/konnectivity-agent-k67cl","kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96","openshift-cluster-node-tuning-operator/tuned-vl6w5","openshift-dns/node-resolver-bl7wx","openshift-image-registry/node-ca-xvdhd","openshift-multus/multus-additional-cni-plugins-5bdxf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal"]
Jul 22 13:46:18.136303 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.136277    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:18.136478 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.136449    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:18.137869 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.137848    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.139454 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.139430    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:18.140271 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.140249    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 13:46:18.141397 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.140450    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x9gbb\""
Jul 22 13:46:18.141397 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.140676    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 13:46:18.141397 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.140809    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 13:46:18.141397 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.140869    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 13:46:18.141397 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.141076    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 13:46:18.141397 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.141079    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kpg65"
Jul 22 13:46:18.141397 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.141383    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 13:46:18.142096 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.142072    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nl2gl\""
Jul 22 13:46:18.142369 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.142109    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 13:46:18.142369 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.142121    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 13:46:18.143398 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.142937    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.143398 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.143136    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhzxq\""
Jul 22 13:46:18.144169 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.143575    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 13:46:18.144169 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.143613    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 13:46:18.144169 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.143853    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 13:46:18.144775 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.144539    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:18.144775 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.144604    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:18.147297 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.145739    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 13:46:18.147297 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.145810    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 13:46:18.147297 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.146251    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 13:46:18.147297 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.146482    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 13:46:18.147297 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.146863    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b69jc\""
Jul 22 13:46:18.147297 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.147047    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 13:46:18.147297 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.147151    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 13:46:18.147297 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.147202    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.147809 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.147755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.149226 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.149208    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.149560 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.149542    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 13:46:18.149717 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.149696    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5l8tl\""
Jul 22 13:46:18.150086 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.150064    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 13:46:18.150513 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.150494    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 13:46:18.150771 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.150490    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 13:46:18.150987 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.150958    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-26965\""
Jul 22 13:46:18.151527 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.151357    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g5tbn\""
Jul 22 13:46:18.152206 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152137    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bl7wx"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpnp5\" (UniqueName: \"kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5\") pod \"network-check-target-hl66n\" (UID: \"ae59d001-6ba1-4e77-8808-d6e78d9d7c21\") " pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-cnibin\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-os-release\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-cni-bin\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152588    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-run-openvswitch\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/582ca5fa-2185-4721-8cbf-e6adfdaffa61-ovn-node-metrics-cert\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77mjh\" (UniqueName: \"kubernetes.io/projected/e1cb3c35-a8ed-4f28-9d32-0e92cb642221-kube-api-access-77mjh\") pod \"iptables-alerter-kpg65\" (UID: \"e1cb3c35-a8ed-4f28-9d32-0e92cb642221\") " pod="openshift-network-operator/iptables-alerter-kpg65"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-run-netns\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-run-systemd\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-var-lib-openvswitch\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152765    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-log-socket\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/582ca5fa-2185-4721-8cbf-e6adfdaffa61-ovnkube-config\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-cni-netd\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.153656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/582ca5fa-2185-4721-8cbf-e6adfdaffa61-ovnkube-script-lib\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1cb3c35-a8ed-4f28-9d32-0e92cb642221-host-slash\") pod \"iptables-alerter-kpg65\" (UID: \"e1cb3c35-a8ed-4f28-9d32-0e92cb642221\") " pod="openshift-network-operator/iptables-alerter-kpg65"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-run-ovn\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57f9f457-158b-4e7e-907c-a431f3892e96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5btx2\" (UniqueName: \"kubernetes.io/projected/57f9f457-158b-4e7e-907c-a431f3892e96-kube-api-access-5btx2\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152991    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57f9f457-158b-4e7e-907c-a431f3892e96-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-run-ovn-kubernetes\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ae56745-0d4a-4fa5-9dde-82570c20980b-agent-certs\") pod \"konnectivity-agent-k67cl\" (UID: \"0ae56745-0d4a-4fa5-9dde-82570c20980b\") " pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ae56745-0d4a-4fa5-9dde-82570c20980b-konnectivity-ca\") pod \"konnectivity-agent-k67cl\" (UID: \"0ae56745-0d4a-4fa5-9dde-82570c20980b\") " pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-systemd-units\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-node-log\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153143    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-system-cni-dir\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1cb3c35-a8ed-4f28-9d32-0e92cb642221-iptables-alerter-script\") pod \"iptables-alerter-kpg65\" (UID: \"e1cb3c35-a8ed-4f28-9d32-0e92cb642221\") " pod="openshift-network-operator/iptables-alerter-kpg65"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-kubelet\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-slash\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.154471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-etc-openvswitch\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.155307 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/582ca5fa-2185-4721-8cbf-e6adfdaffa61-env-overrides\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.155307 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj2xf\" (UniqueName: \"kubernetes.io/projected/582ca5fa-2185-4721-8cbf-e6adfdaffa61-kube-api-access-vj2xf\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.155307 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.153375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57f9f457-158b-4e7e-907c-a431f3892e96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.155307 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.152817    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 13:46:18.157070 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.156030    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:18.157070 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.156129    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:18.157070 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.156517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvdhd"
Jul 22 13:46:18.158821 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.157652    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fn5pz\""
Jul 22 13:46:18.158821 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.157877    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 13:46:18.158821 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.158134    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 13:46:18.158821 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.158368    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 13:46:18.158821 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.158688    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 13:46:18.158821 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.158701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7l4ft\""
Jul 22 13:46:18.159781 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.159373    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 13:46:18.159781 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.159581    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 13:46:18.243152 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.243120    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 13:46:18.252481 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.252437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" event={"ID":"e8d0181de62365719ca8addca6e9fe43","Type":"ContainerStarted","Data":"152c43bcccbf91257aa15a75645568fadca980318c1853aa924a6c3ef3686b56"}
Jul 22 13:46:18.253564 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253523    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57f9f457-158b-4e7e-907c-a431f3892e96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.253564 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" event={"ID":"0dba07077d86471426887abd01210c23","Type":"ContainerStarted","Data":"4aa2697acaacd9caf9c6ff1f2f30372b35eafe57e4da4d0c250f3f3996f5f6db"}
Jul 22 13:46:18.253564 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57f9f457-158b-4e7e-907c-a431f3892e96-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.253784 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-run-ovn-kubernetes\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.253784 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-os-release\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.253784 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ae56745-0d4a-4fa5-9dde-82570c20980b-agent-certs\") pod \"konnectivity-agent-k67cl\" (UID: \"0ae56745-0d4a-4fa5-9dde-82570c20980b\") " pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:18.253784 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-run-ovn-kubernetes\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.253784 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ae56745-0d4a-4fa5-9dde-82570c20980b-konnectivity-ca\") pod \"konnectivity-agent-k67cl\" (UID: \"0ae56745-0d4a-4fa5-9dde-82570c20980b\") " pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:18.253784 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-node-log\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.253784 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-modprobe-d\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-kubelet-config\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-socket-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc-hosts-file\") pod \"node-resolver-bl7wx\" (UID: \"b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc\") " pod="openshift-dns/node-resolver-bl7wx"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzf27\" (UniqueName: \"kubernetes.io/projected/d252f413-c17e-4a0c-a75a-c4879f6402d4-kube-api-access-pzf27\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-sysctl-d\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253927    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1840c625-3bd6-47b6-8499-81e605f84dd1-cni-binary-copy\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.253988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-var-lib-cni-bin\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-etc-selinux\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-slash\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/582ca5fa-2185-4721-8cbf-e6adfdaffa61-env-overrides\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-dbus\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:18.254099 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-device-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57f9f457-158b-4e7e-907c-a431f3892e96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-cnibin\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-os-release\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254220    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57f9f457-158b-4e7e-907c-a431f3892e96-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjh9g\" (UniqueName: \"kubernetes.io/projected/b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc-kube-api-access-qjh9g\") pod \"node-resolver-bl7wx\" (UID: \"b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc\") " pod="openshift-dns/node-resolver-bl7wx"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j45m\" (UniqueName: \"kubernetes.io/projected/aebdd817-9129-47a1-acd6-a2433e994000-kube-api-access-9j45m\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/582ca5fa-2185-4721-8cbf-e6adfdaffa61-ovn-node-metrics-cert\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-slash\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254354    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-host\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-system-cni-dir\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-run-netns\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-run-netns\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-run-systemd\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.254694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-var-lib-openvswitch\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-log-socket\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc-tmp-dir\") pod \"node-resolver-bl7wx\" (UID: \"b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc\") " pod="openshift-dns/node-resolver-bl7wx"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-sysconfig\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-cni-netd\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254671    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/582ca5fa-2185-4721-8cbf-e6adfdaffa61-ovnkube-script-lib\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aebdd817-9129-47a1-acd6-a2433e994000-tmp\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-socket-dir-parent\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ae56745-0d4a-4fa5-9dde-82570c20980b-konnectivity-ca\") pod \"konnectivity-agent-k67cl\" (UID: \"0ae56745-0d4a-4fa5-9dde-82570c20980b\") " pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-run-multus-certs\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4hm8\" (UniqueName: \"kubernetes.io/projected/1840c625-3bd6-47b6-8499-81e605f84dd1-kube-api-access-j4hm8\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254799    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-node-log\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1cb3c35-a8ed-4f28-9d32-0e92cb642221-host-slash\") pod \"iptables-alerter-kpg65\" (UID: \"e1cb3c35-a8ed-4f28-9d32-0e92cb642221\") " pod="openshift-network-operator/iptables-alerter-kpg65"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/582ca5fa-2185-4721-8cbf-e6adfdaffa61-env-overrides\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254829    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-run-ovn\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5btx2\" (UniqueName: \"kubernetes.io/projected/57f9f457-158b-4e7e-907c-a431f3892e96-kube-api-access-5btx2\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dca31c51-02c6-473f-8e76-1aace19d0a56-serviceca\") pod \"node-ca-xvdhd\" (UID: \"dca31c51-02c6-473f-8e76-1aace19d0a56\") " pod="openshift-image-registry/node-ca-xvdhd"
Jul 22 13:46:18.255711 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254911    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-sysctl-conf\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-systemd\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-systemd-units\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-lib-modules\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aebdd817-9129-47a1-acd6-a2433e994000-etc-tuned\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-hostroot\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pskk\" (UniqueName: \"kubernetes.io/projected/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-kube-api-access-5pskk\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-system-cni-dir\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1cb3c35-a8ed-4f28-9d32-0e92cb642221-iptables-alerter-script\") pod \"iptables-alerter-kpg65\" (UID: \"e1cb3c35-a8ed-4f28-9d32-0e92cb642221\") " pod="openshift-network-operator/iptables-alerter-kpg65"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-kubelet\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-cnibin\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255249    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-var-lib-cni-multus\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255257    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57f9f457-158b-4e7e-907c-a431f3892e96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-conf-dir\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255309    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-etc-kubernetes\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-cnibin\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-etc-openvswitch\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.256520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj2xf\" (UniqueName: \"kubernetes.io/projected/582ca5fa-2185-4721-8cbf-e6adfdaffa61-kube-api-access-vj2xf\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-os-release\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255414    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-kubernetes\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.254222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57f9f457-158b-4e7e-907c-a431f3892e96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-run-ovn\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-kubelet\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-etc-openvswitch\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255624    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-systemd-units\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255658    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-cni-netd\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255692    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-system-cni-dir\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-run-systemd\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255823    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-var-lib-openvswitch\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-log-socket\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-registration-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-sys-fs\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dca31c51-02c6-473f-8e76-1aace19d0a56-host\") pod \"node-ca-xvdhd\" (UID: \"dca31c51-02c6-473f-8e76-1aace19d0a56\") " pod="openshift-image-registry/node-ca-xvdhd"
Jul 22 13:46:18.257430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-run\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.255998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-var-lib-kubelet\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnp5\" (UniqueName: \"kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5\") pod \"network-check-target-hl66n\" (UID: \"ae59d001-6ba1-4e77-8808-d6e78d9d7c21\") " pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-cni-bin\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-run-openvswitch\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84tpm\" (UniqueName: \"kubernetes.io/projected/dca31c51-02c6-473f-8e76-1aace19d0a56-kube-api-access-84tpm\") pod \"node-ca-xvdhd\" (UID: \"dca31c51-02c6-473f-8e76-1aace19d0a56\") " pod="openshift-image-registry/node-ca-xvdhd"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77mjh\" (UniqueName: \"kubernetes.io/projected/e1cb3c35-a8ed-4f28-9d32-0e92cb642221-kube-api-access-77mjh\") pod \"iptables-alerter-kpg65\" (UID: \"e1cb3c35-a8ed-4f28-9d32-0e92cb642221\") " pod="openshift-network-operator/iptables-alerter-kpg65"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/582ca5fa-2185-4721-8cbf-e6adfdaffa61-ovnkube-config\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256295    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/582ca5fa-2185-4721-8cbf-e6adfdaffa61-ovnkube-script-lib\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256309    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-cni-dir\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-sys\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-run-k8s-cni-cncf-io\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-var-lib-kubelet\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-daemon-config\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256643    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1cb3c35-a8ed-4f28-9d32-0e92cb642221-iptables-alerter-script\") pod \"iptables-alerter-kpg65\" (UID: \"e1cb3c35-a8ed-4f28-9d32-0e92cb642221\") " pod="openshift-network-operator/iptables-alerter-kpg65"
Jul 22 13:46:18.258253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-cni-bin\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.258911 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256744    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1cb3c35-a8ed-4f28-9d32-0e92cb642221-host-slash\") pod \"iptables-alerter-kpg65\" (UID: \"e1cb3c35-a8ed-4f28-9d32-0e92cb642221\") " pod="openshift-network-operator/iptables-alerter-kpg65"
Jul 22 13:46:18.258911 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256788    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-run-openvswitch\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.258911 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256916    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57f9f457-158b-4e7e-907c-a431f3892e96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.258911 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.256945    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/582ca5fa-2185-4721-8cbf-e6adfdaffa61-host-run-netns\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.258911 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.257114    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/582ca5fa-2185-4721-8cbf-e6adfdaffa61-ovnkube-config\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.258911 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.258170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ae56745-0d4a-4fa5-9dde-82570c20980b-agent-certs\") pod \"konnectivity-agent-k67cl\" (UID: \"0ae56745-0d4a-4fa5-9dde-82570c20980b\") " pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:18.258911 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.258761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/582ca5fa-2185-4721-8cbf-e6adfdaffa61-ovn-node-metrics-cert\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.263485 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.263222    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:18.263485 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.263248    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:18.263485 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.263262    2578 projected.go:196] Error preparing data for projected volume kube-api-access-fpnp5 for pod openshift-network-diagnostics/network-check-target-hl66n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:18.263485 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.263317    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5 podName:ae59d001-6ba1-4e77-8808-d6e78d9d7c21 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:18.763302648 +0000 UTC m=+3.005397609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fpnp5" (UniqueName: "kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5") pod "network-check-target-hl66n" (UID: "ae59d001-6ba1-4e77-8808-d6e78d9d7c21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:18.264601 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.264578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj2xf\" (UniqueName: \"kubernetes.io/projected/582ca5fa-2185-4721-8cbf-e6adfdaffa61-kube-api-access-vj2xf\") pod \"ovnkube-node-76njp\" (UID: \"582ca5fa-2185-4721-8cbf-e6adfdaffa61\") " pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.264826 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.264807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5btx2\" (UniqueName: \"kubernetes.io/projected/57f9f457-158b-4e7e-907c-a431f3892e96-kube-api-access-5btx2\") pod \"multus-additional-cni-plugins-5bdxf\" (UID: \"57f9f457-158b-4e7e-907c-a431f3892e96\") " pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.265853 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.265831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77mjh\" (UniqueName: \"kubernetes.io/projected/e1cb3c35-a8ed-4f28-9d32-0e92cb642221-kube-api-access-77mjh\") pod \"iptables-alerter-kpg65\" (UID: \"e1cb3c35-a8ed-4f28-9d32-0e92cb642221\") " pod="openshift-network-operator/iptables-alerter-kpg65"
Jul 22 13:46:18.272270 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.272242    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6mt5t"
Jul 22 13:46:18.281643 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.281625    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6mt5t"
Jul 22 13:46:18.356916 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.356840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-modprobe-d\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.356916 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.356873    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-kubelet-config\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:18.356916 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.356897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-socket-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.356918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc-hosts-file\") pod \"node-resolver-bl7wx\" (UID: \"b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc\") " pod="openshift-dns/node-resolver-bl7wx"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.356976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzf27\" (UniqueName: \"kubernetes.io/projected/d252f413-c17e-4a0c-a75a-c4879f6402d4-kube-api-access-pzf27\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.356992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc-hosts-file\") pod \"node-resolver-bl7wx\" (UID: \"b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc\") " pod="openshift-dns/node-resolver-bl7wx"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.356992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-kubelet-config\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-sysctl-d\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1840c625-3bd6-47b6-8499-81e605f84dd1-cni-binary-copy\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-var-lib-cni-bin\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-etc-selinux\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-dbus\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-modprobe-d\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-device-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.357188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357185    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-socket-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-sysctl-d\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjh9g\" (UniqueName: \"kubernetes.io/projected/b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc-kube-api-access-qjh9g\") pod \"node-resolver-bl7wx\" (UID: \"b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc\") " pod="openshift-dns/node-resolver-bl7wx"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j45m\" (UniqueName: \"kubernetes.io/projected/aebdd817-9129-47a1-acd6-a2433e994000-kube-api-access-9j45m\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-etc-selinux\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-host\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-system-cni-dir\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357321    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-device-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-run-netns\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc-tmp-dir\") pod \"node-resolver-bl7wx\" (UID: \"b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc\") " pod="openshift-dns/node-resolver-bl7wx"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357383    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-host\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-sysconfig\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aebdd817-9129-47a1-acd6-a2433e994000-tmp\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.357437    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357441    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-sysconfig\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-socket-dir-parent\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.357804 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.357487    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret podName:b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:18.857473259 +0000 UTC m=+3.099568203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret") pod "global-pull-secret-syncer-lhzsv" (UID: "b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-system-cni-dir\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-socket-dir-parent\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-run-netns\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1840c625-3bd6-47b6-8499-81e605f84dd1-cni-binary-copy\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc-tmp-dir\") pod \"node-resolver-bl7wx\" (UID: \"b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc\") " pod="openshift-dns/node-resolver-bl7wx"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357838    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-dbus\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-var-lib-cni-bin\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.357973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-run-multus-certs\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4hm8\" (UniqueName: \"kubernetes.io/projected/1840c625-3bd6-47b6-8499-81e605f84dd1-kube-api-access-j4hm8\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dca31c51-02c6-473f-8e76-1aace19d0a56-serviceca\") pod \"node-ca-xvdhd\" (UID: \"dca31c51-02c6-473f-8e76-1aace19d0a56\") " pod="openshift-image-registry/node-ca-xvdhd"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358090    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-run-multus-certs\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-sysctl-conf\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-systemd\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-lib-modules\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aebdd817-9129-47a1-acd6-a2433e994000-etc-tuned\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-hostroot\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pskk\" (UniqueName: \"kubernetes.io/projected/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-kube-api-access-5pskk\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.358667 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-cnibin\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-var-lib-cni-multus\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-conf-dir\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-lib-modules\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-sysctl-conf\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-etc-kubernetes\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-kubernetes\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358428    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-cnibin\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-registration-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358465    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-etc-kubernetes\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-systemd\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-sys-fs\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dca31c51-02c6-473f-8e76-1aace19d0a56-host\") pod \"node-ca-xvdhd\" (UID: \"dca31c51-02c6-473f-8e76-1aace19d0a56\") " pod="openshift-image-registry/node-ca-xvdhd"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358554    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-conf-dir\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358554    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-etc-kubernetes\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358508    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-var-lib-cni-multus\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358598    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-registration-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.359489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dca31c51-02c6-473f-8e76-1aace19d0a56-host\") pod \"node-ca-xvdhd\" (UID: \"dca31c51-02c6-473f-8e76-1aace19d0a56\") " pod="openshift-image-registry/node-ca-xvdhd"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-sys-fs\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-run\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358633    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-hostroot\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-run\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.358676    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-var-lib-kubelet\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358716    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dca31c51-02c6-473f-8e76-1aace19d0a56-serviceca\") pod \"node-ca-xvdhd\" (UID: \"dca31c51-02c6-473f-8e76-1aace19d0a56\") " pod="openshift-image-registry/node-ca-xvdhd"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358746    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-var-lib-kubelet\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.358797    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs podName:d252f413-c17e-4a0c-a75a-c4879f6402d4 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:18.85871903 +0000 UTC m=+3.100813983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs") pod "network-metrics-daemon-q47d2" (UID: "d252f413-c17e-4a0c-a75a-c4879f6402d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84tpm\" (UniqueName: \"kubernetes.io/projected/dca31c51-02c6-473f-8e76-1aace19d0a56-kube-api-access-84tpm\") pod \"node-ca-xvdhd\" (UID: \"dca31c51-02c6-473f-8e76-1aace19d0a56\") " pod="openshift-image-registry/node-ca-xvdhd"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-cni-dir\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.358995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.359014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-sys\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.359041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-run-k8s-cni-cncf-io\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.359058    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-cni-dir\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.359087    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-run-k8s-cni-cncf-io\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.360310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.359097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aebdd817-9129-47a1-acd6-a2433e994000-sys\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.361197 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.359121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-var-lib-kubelet\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.361197 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.359150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-daemon-config\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.361197 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.359189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-host-var-lib-kubelet\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.361197 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.359181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-os-release\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.361197 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.359304    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1840c625-3bd6-47b6-8499-81e605f84dd1-os-release\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.361197 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.359629    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1840c625-3bd6-47b6-8499-81e605f84dd1-multus-daemon-config\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.361197 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.360292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aebdd817-9129-47a1-acd6-a2433e994000-tmp\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.361197 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.360771    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aebdd817-9129-47a1-acd6-a2433e994000-etc-tuned\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.367192 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.367143    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjh9g\" (UniqueName: \"kubernetes.io/projected/b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc-kube-api-access-qjh9g\") pod \"node-resolver-bl7wx\" (UID: \"b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc\") " pod="openshift-dns/node-resolver-bl7wx"
Jul 22 13:46:18.367192 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.367181    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzf27\" (UniqueName: \"kubernetes.io/projected/d252f413-c17e-4a0c-a75a-c4879f6402d4-kube-api-access-pzf27\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:18.367433 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.367322    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j45m\" (UniqueName: \"kubernetes.io/projected/aebdd817-9129-47a1-acd6-a2433e994000-kube-api-access-9j45m\") pod \"tuned-vl6w5\" (UID: \"aebdd817-9129-47a1-acd6-a2433e994000\") " pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.368039 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.368016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pskk\" (UniqueName: \"kubernetes.io/projected/d08202e9-deaa-4f76-8a08-c9a5b97e3da0-kube-api-access-5pskk\") pod \"aws-ebs-csi-driver-node-62c96\" (UID: \"d08202e9-deaa-4f76-8a08-c9a5b97e3da0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.368792 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.368765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84tpm\" (UniqueName: \"kubernetes.io/projected/dca31c51-02c6-473f-8e76-1aace19d0a56-kube-api-access-84tpm\") pod \"node-ca-xvdhd\" (UID: \"dca31c51-02c6-473f-8e76-1aace19d0a56\") " pod="openshift-image-registry/node-ca-xvdhd"
Jul 22 13:46:18.368907 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.368828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4hm8\" (UniqueName: \"kubernetes.io/projected/1840c625-3bd6-47b6-8499-81e605f84dd1-kube-api-access-j4hm8\") pod \"multus-nppcl\" (UID: \"1840c625-3bd6-47b6-8499-81e605f84dd1\") " pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.451282 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.451239    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5bdxf"
Jul 22 13:46:18.466327 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.466298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:18.478996 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.478970    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kpg65"
Jul 22 13:46:18.485341 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.485310    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:18.493670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.493650    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nppcl"
Jul 22 13:46:18.500904 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.500882    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96"
Jul 22 13:46:18.508856 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.508835    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vl6w5"
Jul 22 13:46:18.517013 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.516992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bl7wx"
Jul 22 13:46:18.521882 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.521865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvdhd"
Jul 22 13:46:18.863791 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.863754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:18.863991 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.863809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnp5\" (UniqueName: \"kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5\") pod \"network-check-target-hl66n\" (UID: \"ae59d001-6ba1-4e77-8808-d6e78d9d7c21\") " pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:18.863991 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:18.863861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:18.863991 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.863972    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:18.863991 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.863974    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:18.864226 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.864018    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:18.864226 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.864040    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret podName:b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:19.864022545 +0000 UTC m=+4.106117496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret") pod "global-pull-secret-syncer-lhzsv" (UID: "b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:18.864226 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.864043    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:18.864226 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.864060    2578 projected.go:196] Error preparing data for projected volume kube-api-access-fpnp5 for pod openshift-network-diagnostics/network-check-target-hl66n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:18.864226 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.864062    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs podName:d252f413-c17e-4a0c-a75a-c4879f6402d4 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:19.864050688 +0000 UTC m=+4.106145639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs") pod "network-metrics-daemon-q47d2" (UID: "d252f413-c17e-4a0c-a75a-c4879f6402d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:18.864226 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:18.864112    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5 podName:ae59d001-6ba1-4e77-8808-d6e78d9d7c21 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:19.864094836 +0000 UTC m=+4.106189781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpnp5" (UniqueName: "kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5") pod "network-check-target-hl66n" (UID: "ae59d001-6ba1-4e77-8808-d6e78d9d7c21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:19.197317 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:19.197292    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cb3c35_a8ed_4f28_9d32_0e92cb642221.slice/crio-d693ce5538a27e04db4e02d2e0133a516cbcf167e19fdf621aafbc1071e7e9e3 WatchSource:0}: Error finding container d693ce5538a27e04db4e02d2e0133a516cbcf167e19fdf621aafbc1071e7e9e3: Status 404 returned error can't find the container with id d693ce5538a27e04db4e02d2e0133a516cbcf167e19fdf621aafbc1071e7e9e3
Jul 22 13:46:19.198189 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:19.198162    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12fed3b_5144_4cf4_8cd3_97c7d8ff79bc.slice/crio-6164e679ce67538164dc152d359d8bd6a69ee69bae13870ceb4efd314467f739 WatchSource:0}: Error finding container 6164e679ce67538164dc152d359d8bd6a69ee69bae13870ceb4efd314467f739: Status 404 returned error can't find the container with id 6164e679ce67538164dc152d359d8bd6a69ee69bae13870ceb4efd314467f739
Jul 22 13:46:19.199554 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:19.199528    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca31c51_02c6_473f_8e76_1aace19d0a56.slice/crio-7051d1868fac1680935c763fb93348e85fbaa8b0cda4902f9b2d79d368ab21e8 WatchSource:0}: Error finding container 7051d1868fac1680935c763fb93348e85fbaa8b0cda4902f9b2d79d368ab21e8: Status 404 returned error can't find the container with id 7051d1868fac1680935c763fb93348e85fbaa8b0cda4902f9b2d79d368ab21e8
Jul 22 13:46:19.203024 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:19.202283    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f9f457_158b_4e7e_907c_a431f3892e96.slice/crio-c7634e648aaf1ed2981ed7ad4502342ed0e3a5daff79f13d47a7ce3048fb03e5 WatchSource:0}: Error finding container c7634e648aaf1ed2981ed7ad4502342ed0e3a5daff79f13d47a7ce3048fb03e5: Status 404 returned error can't find the container with id c7634e648aaf1ed2981ed7ad4502342ed0e3a5daff79f13d47a7ce3048fb03e5
Jul 22 13:46:19.203024 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:19.202484    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582ca5fa_2185_4721_8cbf_e6adfdaffa61.slice/crio-c4ba98c42b88a943335f9f34c1497ee4f93166e996614ec2f7348edcedb6eaad WatchSource:0}: Error finding container c4ba98c42b88a943335f9f34c1497ee4f93166e996614ec2f7348edcedb6eaad: Status 404 returned error can't find the container with id c4ba98c42b88a943335f9f34c1497ee4f93166e996614ec2f7348edcedb6eaad
Jul 22 13:46:19.205373 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:19.205007    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08202e9_deaa_4f76_8a08_c9a5b97e3da0.slice/crio-09ad5eb401031cc119a42376b531d876773499b018b2887e31397a5cf3fa536e WatchSource:0}: Error finding container 09ad5eb401031cc119a42376b531d876773499b018b2887e31397a5cf3fa536e: Status 404 returned error can't find the container with id 09ad5eb401031cc119a42376b531d876773499b018b2887e31397a5cf3fa536e
Jul 22 13:46:19.206585 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:19.206532    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1840c625_3bd6_47b6_8499_81e605f84dd1.slice/crio-9fcbd2e9899a349b48ef64db4e0c4c59cdacdf43c098132b6d01723fc9bcd306 WatchSource:0}: Error finding container 9fcbd2e9899a349b48ef64db4e0c4c59cdacdf43c098132b6d01723fc9bcd306: Status 404 returned error can't find the container with id 9fcbd2e9899a349b48ef64db4e0c4c59cdacdf43c098132b6d01723fc9bcd306
Jul 22 13:46:19.257002 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.256964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96" event={"ID":"d08202e9-deaa-4f76-8a08-c9a5b97e3da0","Type":"ContainerStarted","Data":"09ad5eb401031cc119a42376b531d876773499b018b2887e31397a5cf3fa536e"}
Jul 22 13:46:19.258368 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.258124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bdxf" event={"ID":"57f9f457-158b-4e7e-907c-a431f3892e96","Type":"ContainerStarted","Data":"c7634e648aaf1ed2981ed7ad4502342ed0e3a5daff79f13d47a7ce3048fb03e5"}
Jul 22 13:46:19.260291 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.260262    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvdhd" event={"ID":"dca31c51-02c6-473f-8e76-1aace19d0a56","Type":"ContainerStarted","Data":"7051d1868fac1680935c763fb93348e85fbaa8b0cda4902f9b2d79d368ab21e8"}
Jul 22 13:46:19.261449 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.261424    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bl7wx" event={"ID":"b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc","Type":"ContainerStarted","Data":"6164e679ce67538164dc152d359d8bd6a69ee69bae13870ceb4efd314467f739"}
Jul 22 13:46:19.262615 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.262576    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vl6w5" event={"ID":"aebdd817-9129-47a1-acd6-a2433e994000","Type":"ContainerStarted","Data":"2e7349daa3cbd62df09dee5f5d23eea3c315b0f4d4db9ed51c6bd9990859c7ed"}
Jul 22 13:46:19.263776 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.263753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k67cl" event={"ID":"0ae56745-0d4a-4fa5-9dde-82570c20980b","Type":"ContainerStarted","Data":"671b5e15cedd1ce4538f0333adc619e4d043380ea7f25c0e9195b8e4e8381119"}
Jul 22 13:46:19.264963 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.264939    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76njp" event={"ID":"582ca5fa-2185-4721-8cbf-e6adfdaffa61","Type":"ContainerStarted","Data":"c4ba98c42b88a943335f9f34c1497ee4f93166e996614ec2f7348edcedb6eaad"}
Jul 22 13:46:19.266168 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.266144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kpg65" event={"ID":"e1cb3c35-a8ed-4f28-9d32-0e92cb642221","Type":"ContainerStarted","Data":"d693ce5538a27e04db4e02d2e0133a516cbcf167e19fdf621aafbc1071e7e9e3"}
Jul 22 13:46:19.267537 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.267515    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nppcl" event={"ID":"1840c625-3bd6-47b6-8499-81e605f84dd1","Type":"ContainerStarted","Data":"9fcbd2e9899a349b48ef64db4e0c4c59cdacdf43c098132b6d01723fc9bcd306"}
Jul 22 13:46:19.285117 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.285091    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 13:41:18 +0000 UTC" deadline="2027-12-20 16:02:58.610590355 +0000 UTC"
Jul 22 13:46:19.285117 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.285117    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12386h16m39.325476801s"
Jul 22 13:46:19.872737 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.872641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:19.872737 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.872704    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnp5\" (UniqueName: \"kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5\") pod \"network-check-target-hl66n\" (UID: \"ae59d001-6ba1-4e77-8808-d6e78d9d7c21\") " pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:19.872975 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:19.872763    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:19.872975 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:19.872946    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:19.873084 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:19.873019    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret podName:b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:21.872997213 +0000 UTC m=+6.115092180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret") pod "global-pull-secret-syncer-lhzsv" (UID: "b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:19.873590 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:19.873568    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:19.873698 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:19.873691    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs podName:d252f413-c17e-4a0c-a75a-c4879f6402d4 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:21.873670523 +0000 UTC m=+6.115765483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs") pod "network-metrics-daemon-q47d2" (UID: "d252f413-c17e-4a0c-a75a-c4879f6402d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:19.873851 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:19.873782    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:19.873851 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:19.873822    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:19.873851 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:19.873837    2578 projected.go:196] Error preparing data for projected volume kube-api-access-fpnp5 for pod openshift-network-diagnostics/network-check-target-hl66n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:19.874017 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:19.873875    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5 podName:ae59d001-6ba1-4e77-8808-d6e78d9d7c21 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:21.8738629 +0000 UTC m=+6.115957848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpnp5" (UniqueName: "kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5") pod "network-check-target-hl66n" (UID: "ae59d001-6ba1-4e77-8808-d6e78d9d7c21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:20.251230 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:20.250309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:20.251230 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:20.250467    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:20.251230 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:20.250877    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:20.251230 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:20.250967    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:20.251230 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:20.251034    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:20.251230 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:20.251107    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:20.278622 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:20.278586    2578 generic.go:356] "Generic (PLEG): container finished" podID="0dba07077d86471426887abd01210c23" containerID="ee36e4fe09f57564a5bc77ffec36915f1089d6458f89303f3b43dc915ce5fbee" exitCode=0
Jul 22 13:46:20.278812 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:20.278686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" event={"ID":"0dba07077d86471426887abd01210c23","Type":"ContainerDied","Data":"ee36e4fe09f57564a5bc77ffec36915f1089d6458f89303f3b43dc915ce5fbee"}
Jul 22 13:46:20.285465 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:20.285435    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 13:41:18 +0000 UTC" deadline="2028-01-28 13:22:52.348838118 +0000 UTC"
Jul 22 13:46:20.285465 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:20.285465    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13319h36m32.063377006s"
Jul 22 13:46:20.293009 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:20.292973    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" event={"ID":"e8d0181de62365719ca8addca6e9fe43","Type":"ContainerStarted","Data":"bb060d9a894b218fe9aaa80d87d784929ac0f41598560f0a5a8f847c2e946023"}
Jul 22 13:46:21.312370 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:21.312332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" event={"ID":"0dba07077d86471426887abd01210c23","Type":"ContainerStarted","Data":"c06c70296c115245a73f755e245145295a2421724489ff60e5bba01be215c7d7"}
Jul 22 13:46:21.332323 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:21.331708    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-79.ec2.internal" podStartSLOduration=3.331684296 podStartE2EDuration="3.331684296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:20.311289858 +0000 UTC m=+4.553384825" watchObservedRunningTime="2026-07-22 13:46:21.331684296 +0000 UTC m=+5.573779265"
Jul 22 13:46:21.892321 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:21.892270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:21.892502 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:21.892356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:21.892502 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:21.892390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnp5\" (UniqueName: \"kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5\") pod \"network-check-target-hl66n\" (UID: \"ae59d001-6ba1-4e77-8808-d6e78d9d7c21\") " pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:21.892626 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:21.892551    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:21.892626 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:21.892573    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:21.892626 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:21.892586    2578 projected.go:196] Error preparing data for projected volume kube-api-access-fpnp5 for pod openshift-network-diagnostics/network-check-target-hl66n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:21.892782 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:21.892645    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5 podName:ae59d001-6ba1-4e77-8808-d6e78d9d7c21 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:25.892626232 +0000 UTC m=+10.134721182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpnp5" (UniqueName: "kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5") pod "network-check-target-hl66n" (UID: "ae59d001-6ba1-4e77-8808-d6e78d9d7c21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:21.893062 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:21.893040    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:21.893156 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:21.893098    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret podName:b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:25.89308306 +0000 UTC m=+10.135178011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret") pod "global-pull-secret-syncer-lhzsv" (UID: "b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:21.893244 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:21.893156    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:21.893244 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:21.893188    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs podName:d252f413-c17e-4a0c-a75a-c4879f6402d4 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:25.893176609 +0000 UTC m=+10.135271555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs") pod "network-metrics-daemon-q47d2" (UID: "d252f413-c17e-4a0c-a75a-c4879f6402d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:22.249418 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:22.249336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:22.249418 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:22.249389    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:22.249638 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:22.249336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:22.249638 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:22.249495    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:22.249638 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:22.249577    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:22.249788 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:22.249676    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:24.248349 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:24.248314    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:24.248779 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:24.248457    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:24.251268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:24.251235    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:24.251382 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:24.251355    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:24.251443 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:24.251395    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:24.251525 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:24.251504    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:25.926351 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:25.926316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:25.926847 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:25.926383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:25.926847 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:25.926409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnp5\" (UniqueName: \"kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5\") pod \"network-check-target-hl66n\" (UID: \"ae59d001-6ba1-4e77-8808-d6e78d9d7c21\") " pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:25.926847 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:25.926494    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:25.926847 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:25.926533    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:25.926847 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:25.926551    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:25.926847 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:25.926565    2578 projected.go:196] Error preparing data for projected volume kube-api-access-fpnp5 for pod openshift-network-diagnostics/network-check-target-hl66n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:25.926847 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:25.926570    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret podName:b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:33.926548187 +0000 UTC m=+18.168643135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret") pod "global-pull-secret-syncer-lhzsv" (UID: "b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:25.926847 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:25.926616    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5 podName:ae59d001-6ba1-4e77-8808-d6e78d9d7c21 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:33.926598859 +0000 UTC m=+18.168693820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpnp5" (UniqueName: "kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5") pod "network-check-target-hl66n" (UID: "ae59d001-6ba1-4e77-8808-d6e78d9d7c21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:25.926847 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:25.926685    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:25.926847 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:25.926721    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs podName:d252f413-c17e-4a0c-a75a-c4879f6402d4 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:33.926709912 +0000 UTC m=+18.168804870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs") pod "network-metrics-daemon-q47d2" (UID: "d252f413-c17e-4a0c-a75a-c4879f6402d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:26.248990 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:26.248913    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:26.249116 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:26.249038    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:26.249433 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:26.249416    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:26.249530 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:26.249509    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:26.249616 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:26.249589    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:26.249702 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:26.249684    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:28.248312 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:28.248233    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:28.248809 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:28.248361    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:28.248809 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:28.248737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:28.248921 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:28.248839    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:28.248979 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:28.248914    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:28.249027 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:28.249008    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:30.248225 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:30.248192    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:30.248572 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:30.248192    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:30.248572 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:30.248319    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:30.248572 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:30.248204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:30.248572 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:30.248409    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:30.248572 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:30.248453    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:32.247833 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:32.247803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:32.248291 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:32.247803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:32.248291 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:32.247946    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:32.248291 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:32.248036    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:32.248291 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:32.247803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:32.248291 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:32.248155    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:33.990012 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:33.989972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:33.990496 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:33.990026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnp5\" (UniqueName: \"kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5\") pod \"network-check-target-hl66n\" (UID: \"ae59d001-6ba1-4e77-8808-d6e78d9d7c21\") " pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:33.990496 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:33.990076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:33.990496 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:33.990108    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:33.990496 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:33.990182    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:33.990496 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:33.990186    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs podName:d252f413-c17e-4a0c-a75a-c4879f6402d4 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:49.990166892 +0000 UTC m=+34.232261839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs") pod "network-metrics-daemon-q47d2" (UID: "d252f413-c17e-4a0c-a75a-c4879f6402d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:33.990496 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:33.990213    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret podName:b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:49.990204054 +0000 UTC m=+34.232298996 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret") pod "global-pull-secret-syncer-lhzsv" (UID: "b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:33.990496 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:33.990220    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:33.990496 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:33.990243    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:33.990496 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:33.990256    2578 projected.go:196] Error preparing data for projected volume kube-api-access-fpnp5 for pod openshift-network-diagnostics/network-check-target-hl66n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:33.990496 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:33.990308    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5 podName:ae59d001-6ba1-4e77-8808-d6e78d9d7c21 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:49.990293674 +0000 UTC m=+34.232388617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpnp5" (UniqueName: "kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5") pod "network-check-target-hl66n" (UID: "ae59d001-6ba1-4e77-8808-d6e78d9d7c21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:34.248559 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:34.248485    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:34.248709 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:34.248496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:34.248709 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:34.248621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:34.248709 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:34.248617    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:34.248851 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:34.248721    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:34.248851 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:34.248796    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:36.248347 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:36.248318    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:36.248791 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:36.248432    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:36.248791 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:36.248482    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:36.248791 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:36.248530    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:36.248791 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:36.248554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:36.248791 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:36.248597    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:38.247653 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:38.247621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:38.248055 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:38.247630    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:38.248055 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:38.247717    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:38.248055 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:38.247810    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:38.248055 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:38.247876    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:38.248055 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:38.247978    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:39.350419 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.350045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nppcl" event={"ID":"1840c625-3bd6-47b6-8499-81e605f84dd1","Type":"ContainerStarted","Data":"41c7c8c42ad4f7b8a094c5cb8bfff3b4cb6e0e6f7b128ccddfce21c79ad431ce"}
Jul 22 13:46:39.351519 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.351500    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96" event={"ID":"d08202e9-deaa-4f76-8a08-c9a5b97e3da0","Type":"ContainerStarted","Data":"4ba998d1c1c3ea3497d3ddd8e6a86701ea5488733eaf49749a5b78f8709c60d2"}
Jul 22 13:46:39.352869 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.352848    2578 generic.go:356] "Generic (PLEG): container finished" podID="57f9f457-158b-4e7e-907c-a431f3892e96" containerID="b5cb06bac48f5ca075dfd529739f42d3aac647b66cc71fd2199b0cac40bcba86" exitCode=0
Jul 22 13:46:39.352960 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.352909    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bdxf" event={"ID":"57f9f457-158b-4e7e-907c-a431f3892e96","Type":"ContainerDied","Data":"b5cb06bac48f5ca075dfd529739f42d3aac647b66cc71fd2199b0cac40bcba86"}
Jul 22 13:46:39.356471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.356450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvdhd" event={"ID":"dca31c51-02c6-473f-8e76-1aace19d0a56","Type":"ContainerStarted","Data":"b6b42196f6349a70e1664ab9d30c46d0e6f5940c04bbf1bcb2458a34ecac413e"}
Jul 22 13:46:39.357809 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.357785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bl7wx" event={"ID":"b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc","Type":"ContainerStarted","Data":"ee9d4fd0ecdf6e6039051361228960db57d505892176ecfec056abab55168131"}
Jul 22 13:46:39.359170 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.359148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vl6w5" event={"ID":"aebdd817-9129-47a1-acd6-a2433e994000","Type":"ContainerStarted","Data":"f61dc0d6d37f2fc8815a22ca612c176d3b84eeb498552655f383b0f8b6731b67"}
Jul 22 13:46:39.360387 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.360368    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k67cl" event={"ID":"0ae56745-0d4a-4fa5-9dde-82570c20980b","Type":"ContainerStarted","Data":"a6fcec75a32e1c71cb041f2cbbe8f2e1e62399ac6d0db90b123ab898dca42f33"}
Jul 22 13:46:39.363016 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.363001    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 13:46:39.363318 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.363300    2578 generic.go:356] "Generic (PLEG): container finished" podID="582ca5fa-2185-4721-8cbf-e6adfdaffa61" containerID="128a3ae68c77d55dfb1f09d87930ac667fbfd165ed031ee98bb43b6df3af0bef" exitCode=1
Jul 22 13:46:39.363357 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.363329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76njp" event={"ID":"582ca5fa-2185-4721-8cbf-e6adfdaffa61","Type":"ContainerStarted","Data":"3acb5b1eb37073e8fc477096a85ce8bcfec1cd6d0d7dfa61823ce52465469e87"}
Jul 22 13:46:39.363395 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.363385    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76njp" event={"ID":"582ca5fa-2185-4721-8cbf-e6adfdaffa61","Type":"ContainerStarted","Data":"619d485fd10a24d64e9231bb3a5861db85743026c016c11d5041e236f5a00fd6"}
Jul 22 13:46:39.363438 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.363427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76njp" event={"ID":"582ca5fa-2185-4721-8cbf-e6adfdaffa61","Type":"ContainerStarted","Data":"678ed99dea1f5b19c1de2f74818610277d76f0681d76efb254fe876c04fab569"}
Jul 22 13:46:39.363474 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.363459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76njp" event={"ID":"582ca5fa-2185-4721-8cbf-e6adfdaffa61","Type":"ContainerStarted","Data":"9b0297946717c5a8d1bc7f394fbcc2745ea964067a2651196d79b06d3054064a"}
Jul 22 13:46:39.363504 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.363486    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76njp" event={"ID":"582ca5fa-2185-4721-8cbf-e6adfdaffa61","Type":"ContainerDied","Data":"128a3ae68c77d55dfb1f09d87930ac667fbfd165ed031ee98bb43b6df3af0bef"}
Jul 22 13:46:39.363534 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.363513    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76njp" event={"ID":"582ca5fa-2185-4721-8cbf-e6adfdaffa61","Type":"ContainerStarted","Data":"9fd76b8d5acc07251486167334077ee218e55ea0018501dcc37f72e8dbcb7b0e"}
Jul 22 13:46:39.380636 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.380599    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-79.ec2.internal" podStartSLOduration=21.380588204 podStartE2EDuration="21.380588204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:21.332284609 +0000 UTC m=+5.574379579" watchObservedRunningTime="2026-07-22 13:46:39.380588204 +0000 UTC m=+23.622683206"
Jul 22 13:46:39.380715 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.380658    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nppcl" podStartSLOduration=3.218755921 podStartE2EDuration="22.380655606s" totalImagesPullingTime="19.161899685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:39.380354183 +0000 UTC m=+23.622449147" watchObservedRunningTime="2026-07-22 13:46:39.380655606 +0000 UTC m=+23.622750570"
Jul 22 13:46:39.401793 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.401762    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k67cl" podStartSLOduration=3.399404099 podStartE2EDuration="22.401750853s" totalImagesPullingTime="19.002346754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:39.401596782 +0000 UTC m=+23.643691746" watchObservedRunningTime="2026-07-22 13:46:39.401750853 +0000 UTC m=+23.643845817"
Jul 22 13:46:39.429490 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.429458    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vl6w5" podStartSLOduration=3.396745013 podStartE2EDuration="22.429447364s" totalImagesPullingTime="19.032702351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:39.428930845 +0000 UTC m=+23.671025808" watchObservedRunningTime="2026-07-22 13:46:39.429447364 +0000 UTC m=+23.671542326"
Jul 22 13:46:39.446835 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.446801    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bl7wx" podStartSLOduration=3.41983557 podStartE2EDuration="22.446794842s" totalImagesPullingTime="19.026959272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:39.446720068 +0000 UTC m=+23.688815031" watchObservedRunningTime="2026-07-22 13:46:39.446794842 +0000 UTC m=+23.688889805"
Jul 22 13:46:39.492053 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.492020    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xvdhd" podStartSLOduration=3.46717426 podStartE2EDuration="22.492007652s" totalImagesPullingTime="19.024833392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:39.49198457 +0000 UTC m=+23.734079532" watchObservedRunningTime="2026-07-22 13:46:39.492007652 +0000 UTC m=+23.734102617"
Jul 22 13:46:39.652370 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.652348    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 13:46:39.911588 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:39.911519    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:40.220322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:40.220107    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T13:46:39.652365584Z","UUID":"d93c52d7-d5b2-481d-a17c-61ad9b6167ac","Handler":null,"Name":"","Endpoint":""}
Jul 22 13:46:40.221614 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:40.221589    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 13:46:40.221765 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:40.221662    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 13:46:40.251291 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:40.251255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:40.251291 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:40.251285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:40.251503 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:40.251351    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:40.251503 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:40.251355    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:40.251503 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:40.251418    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:40.251658 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:40.251520    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:40.367505 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:40.367473    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96" event={"ID":"d08202e9-deaa-4f76-8a08-c9a5b97e3da0","Type":"ContainerStarted","Data":"d1cb7ee57f20d9114d112040a3c58eab22996936340f20acb4db3365ca91848e"}
Jul 22 13:46:40.369287 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:40.369258    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kpg65" event={"ID":"e1cb3c35-a8ed-4f28-9d32-0e92cb642221","Type":"ContainerStarted","Data":"c320fee4f98706d8493032c3ddac724f6a251441a449c9b876775322c5a7e53a"}
Jul 22 13:46:40.393779 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:40.393726    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kpg65" podStartSLOduration=4.365502113 podStartE2EDuration="23.39370848s" totalImagesPullingTime="19.028206367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:40.393381971 +0000 UTC m=+24.635476934" watchObservedRunningTime="2026-07-22 13:46:40.39370848 +0000 UTC m=+24.635803446"
Jul 22 13:46:41.334095 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:41.334067    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:41.334736 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:41.334710    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:41.375650 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:41.375592    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 13:46:41.376094 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:41.376063    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76njp" event={"ID":"582ca5fa-2185-4721-8cbf-e6adfdaffa61","Type":"ContainerStarted","Data":"7b65bd19f4bfee53c4e075162e3216b8ff7b6cd77feccb9d118d449e92c1715c"}
Jul 22 13:46:41.378059 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:41.378032    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96" event={"ID":"d08202e9-deaa-4f76-8a08-c9a5b97e3da0","Type":"ContainerStarted","Data":"f61b20089037c0f885de5e0e70ac246e159d0b6392308c7b693ac9ddae34508d"}
Jul 22 13:46:41.378742 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:41.378717    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k67cl"
Jul 22 13:46:41.400662 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:41.400617    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62c96" podStartSLOduration=3.192315261 podStartE2EDuration="24.400596614s" totalImagesPullingTime="21.208281353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:41.399953477 +0000 UTC m=+25.642048466" watchObservedRunningTime="2026-07-22 13:46:41.400596614 +0000 UTC m=+25.642691578"
Jul 22 13:46:42.248076 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:42.247855    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:42.248257 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:42.247855    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:42.248257 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:42.248184    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:42.248257 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:42.247868    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:42.248406 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:42.248279    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:42.248406 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:42.248328    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:43.386626 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:43.386528    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 13:46:43.388033 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:43.386918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76njp" event={"ID":"582ca5fa-2185-4721-8cbf-e6adfdaffa61","Type":"ContainerStarted","Data":"001f5cb9a55c97c5f6685024ff4268a1bb696ba51d45dc0b464a157d5b7de4be"}
Jul 22 13:46:43.388033 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:43.387448    2578 scope.go:117] "RemoveContainer" containerID="128a3ae68c77d55dfb1f09d87930ac667fbfd165ed031ee98bb43b6df3af0bef"
Jul 22 13:46:44.251100 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.250935    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:44.251276 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.250992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:44.251276 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:44.251207    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:44.251276 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.250992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:44.251276 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:44.251237    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:44.251470 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:44.251321    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:44.390504 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.390443    2578 generic.go:356] "Generic (PLEG): container finished" podID="57f9f457-158b-4e7e-907c-a431f3892e96" containerID="320dc9c1caa9381b32f8ba1c12a4104a79da74f55559a365bcde5fb8c05766d6" exitCode=0
Jul 22 13:46:44.391006 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.390524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bdxf" event={"ID":"57f9f457-158b-4e7e-907c-a431f3892e96","Type":"ContainerDied","Data":"320dc9c1caa9381b32f8ba1c12a4104a79da74f55559a365bcde5fb8c05766d6"}
Jul 22 13:46:44.394219 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.394204    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 13:46:44.394536 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.394520    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76njp" event={"ID":"582ca5fa-2185-4721-8cbf-e6adfdaffa61","Type":"ContainerStarted","Data":"c48072fbece49a21feb544e5481973d292576589eb3ed350562aaf28dcee3b6e"}
Jul 22 13:46:44.394994 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.394975    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:44.395094 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.395072    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:44.395158 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.395127    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:44.411012 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.410992    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:44.411753 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.411738    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:46:44.444828 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:44.444789    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-76njp" podStartSLOduration=8.311801393 podStartE2EDuration="27.444778142s" totalImagesPullingTime="19.132976749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:44.443745565 +0000 UTC m=+28.685840528" watchObservedRunningTime="2026-07-22 13:46:44.444778142 +0000 UTC m=+28.686873105"
Jul 22 13:46:45.281433 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:45.281404    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q47d2"]
Jul 22 13:46:45.281659 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:45.281518    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:45.281659 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:45.281623    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:45.286023 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:45.285996    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhzsv"]
Jul 22 13:46:45.286173 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:45.286098    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:45.286261 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:45.286239    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:45.286588 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:45.286550    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hl66n"]
Jul 22 13:46:45.286682 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:45.286636    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:45.286743 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:45.286703    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:47.248395 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:47.248360    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:47.248395 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:47.248387    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:47.248893 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:47.248360    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:47.248893 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:47.248494    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:47.248893 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:47.248575    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:47.248893 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:47.248612    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:48.405572 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:48.405416    2578 generic.go:356] "Generic (PLEG): container finished" podID="57f9f457-158b-4e7e-907c-a431f3892e96" containerID="35067f1158bb6b1e7436cc0a8ed778af8a34a1fdfc7750c0384f522560033629" exitCode=0
Jul 22 13:46:48.405572 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:48.405494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bdxf" event={"ID":"57f9f457-158b-4e7e-907c-a431f3892e96","Type":"ContainerDied","Data":"35067f1158bb6b1e7436cc0a8ed778af8a34a1fdfc7750c0384f522560033629"}
Jul 22 13:46:49.247735 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:49.247699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:49.247735 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:49.247739    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:49.247985 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:49.247819    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:49.247985 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:49.247857    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:49.247985 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:49.247914    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:49.248123 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:49.248052    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:50.012051 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:50.011976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:50.012051 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:50.012019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:50.012051 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:50.012036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnp5\" (UniqueName: \"kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5\") pod \"network-check-target-hl66n\" (UID: \"ae59d001-6ba1-4e77-8808-d6e78d9d7c21\") " pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:50.012620 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:50.012196    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:50.012620 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:50.012251    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 13:46:50.012620 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:50.012265    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 13:46:50.012620 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:50.012270    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs podName:d252f413-c17e-4a0c-a75a-c4879f6402d4 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:22.012248317 +0000 UTC m=+66.254343281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs") pod "network-metrics-daemon-q47d2" (UID: "d252f413-c17e-4a0c-a75a-c4879f6402d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 13:46:50.012620 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:50.012273    2578 projected.go:196] Error preparing data for projected volume kube-api-access-fpnp5 for pod openshift-network-diagnostics/network-check-target-hl66n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:50.012620 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:50.012201    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:50.012620 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:50.012346    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5 podName:ae59d001-6ba1-4e77-8808-d6e78d9d7c21 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:22.01233506 +0000 UTC m=+66.254430002 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpnp5" (UniqueName: "kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5") pod "network-check-target-hl66n" (UID: "ae59d001-6ba1-4e77-8808-d6e78d9d7c21") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 13:46:50.012620 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:50.012361    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret podName:b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:22.012354634 +0000 UTC m=+66.254449576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret") pod "global-pull-secret-syncer-lhzsv" (UID: "b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6") : object "kube-system"/"original-pull-secret" not registered
Jul 22 13:46:50.411627 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:50.411553    2578 generic.go:356] "Generic (PLEG): container finished" podID="57f9f457-158b-4e7e-907c-a431f3892e96" containerID="5fccc60dcad920d49143f6f6590442850023fd8797dd7db1c46b1ca2df4b91ed" exitCode=0
Jul 22 13:46:50.411627 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:50.411600    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bdxf" event={"ID":"57f9f457-158b-4e7e-907c-a431f3892e96","Type":"ContainerDied","Data":"5fccc60dcad920d49143f6f6590442850023fd8797dd7db1c46b1ca2df4b91ed"}
Jul 22 13:46:51.248453 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:51.247993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:51.248453 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:51.248006    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:51.248453 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:51.248122    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:51.248453 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:51.248115    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl66n" podUID="ae59d001-6ba1-4e77-8808-d6e78d9d7c21"
Jul 22 13:46:51.248453 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:51.248225    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q47d2" podUID="d252f413-c17e-4a0c-a75a-c4879f6402d4"
Jul 22 13:46:51.248453 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:51.248307    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhzsv" podUID="b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6"
Jul 22 13:46:52.124268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.124192    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-79.ec2.internal" event="NodeReady"
Jul 22 13:46:52.124413 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.124350    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 13:46:52.185323 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.185298    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79b74b5dc5-nj6mm"]
Jul 22 13:46:52.187214 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.187184    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.189310 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.189282    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 13:46:52.189424 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.189354    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 13:46:52.189424 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.189381    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sqdjp\""
Jul 22 13:46:52.189530 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.189360    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 13:46:52.194778 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.194735    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 13:46:52.198757 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.198735    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gl2jr"]
Jul 22 13:46:52.200624 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.200605    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xfm7k"]
Jul 22 13:46:52.200752 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.200724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gl2jr"
Jul 22 13:46:52.202396 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.202379    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79b74b5dc5-nj6mm"]
Jul 22 13:46:52.202488 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.202469    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.203024 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.203004    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n8c66\""
Jul 22 13:46:52.203024 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.203006    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 13:46:52.203024 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.203045    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 13:46:52.203024 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.203009    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 13:46:52.204295 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.204279    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 13:46:52.204558 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.204542    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 13:46:52.204960 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.204784    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vvhl\""
Jul 22 13:46:52.214897 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.214873    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gl2jr"]
Jul 22 13:46:52.215664 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.215642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xfm7k"]
Jul 22 13:46:52.328849 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.328816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/261ac3a7-3d64-4f19-af51-06da5be38aca-ca-trust-extracted\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.329322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.328910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcdts\" (UniqueName: \"kubernetes.io/projected/be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c-kube-api-access-xcdts\") pod \"ingress-canary-gl2jr\" (UID: \"be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c\") " pod="openshift-ingress-canary/ingress-canary-gl2jr"
Jul 22 13:46:52.329322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.328964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvv7z\" (UniqueName: \"kubernetes.io/projected/de6d3f3c-6c8c-400b-b511-7078e838b585-kube-api-access-qvv7z\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.329322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.329039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-certificates\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.329322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.329098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.329322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.329157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-trusted-ca\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.329322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.329189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78kjn\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-kube-api-access-78kjn\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.329322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.329229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-image-registry-private-configuration\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.329322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.329254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-bound-sa-token\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.329322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.329300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de6d3f3c-6c8c-400b-b511-7078e838b585-config-volume\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.329322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.329320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.329741 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.329334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de6d3f3c-6c8c-400b-b511-7078e838b585-tmp-dir\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.329741 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.329349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c-cert\") pod \"ingress-canary-gl2jr\" (UID: \"be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c\") " pod="openshift-ingress-canary/ingress-canary-gl2jr"
Jul 22 13:46:52.329741 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.329371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-installation-pull-secrets\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.429861 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.429783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-certificates\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.429861 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.429826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.429861 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.429843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-trusted-ca\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.430126 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:52.429957    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 13:46:52.430126 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:52.429976    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79b74b5dc5-nj6mm: secret "image-registry-tls" not found
Jul 22 13:46:52.430126 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.429998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kjn\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-kube-api-access-78kjn\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.430126 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:52.430031    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls podName:261ac3a7-3d64-4f19-af51-06da5be38aca nodeName:}" failed. No retries permitted until 2026-07-22 13:46:52.930011081 +0000 UTC m=+37.172106024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls") pod "image-registry-79b74b5dc5-nj6mm" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca") : secret "image-registry-tls" not found
Jul 22 13:46:52.430126 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-image-registry-private-configuration\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.430126 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-bound-sa-token\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.430339 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de6d3f3c-6c8c-400b-b511-7078e838b585-config-volume\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.430339 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.430339 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de6d3f3c-6c8c-400b-b511-7078e838b585-tmp-dir\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.430339 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c-cert\") pod \"ingress-canary-gl2jr\" (UID: \"be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c\") " pod="openshift-ingress-canary/ingress-canary-gl2jr"
Jul 22 13:46:52.430339 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-installation-pull-secrets\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.430339 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/261ac3a7-3d64-4f19-af51-06da5be38aca-ca-trust-extracted\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.430510 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcdts\" (UniqueName: \"kubernetes.io/projected/be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c-kube-api-access-xcdts\") pod \"ingress-canary-gl2jr\" (UID: \"be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c\") " pod="openshift-ingress-canary/ingress-canary-gl2jr"
Jul 22 13:46:52.430510 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvv7z\" (UniqueName: \"kubernetes.io/projected/de6d3f3c-6c8c-400b-b511-7078e838b585-kube-api-access-qvv7z\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.430510 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-certificates\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.430640 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:52.430605    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 13:46:52.430689 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:52.430656    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls podName:de6d3f3c-6c8c-400b-b511-7078e838b585 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:52.930636988 +0000 UTC m=+37.172731944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls") pod "dns-default-xfm7k" (UID: "de6d3f3c-6c8c-400b-b511-7078e838b585") : secret "dns-default-metrics-tls" not found
Jul 22 13:46:52.430866 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-trusted-ca\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.430936 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.430846    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de6d3f3c-6c8c-400b-b511-7078e838b585-tmp-dir\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.431030 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.431010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/261ac3a7-3d64-4f19-af51-06da5be38aca-ca-trust-extracted\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.431091 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.431070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de6d3f3c-6c8c-400b-b511-7078e838b585-config-volume\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.434865 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.434845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-image-registry-private-configuration\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.434958 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.434894    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-installation-pull-secrets\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.435000 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.434974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c-cert\") pod \"ingress-canary-gl2jr\" (UID: \"be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c\") " pod="openshift-ingress-canary/ingress-canary-gl2jr"
Jul 22 13:46:52.443037 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.443012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-bound-sa-token\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.446157 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.444240    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78kjn\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-kube-api-access-78kjn\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.446157 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.444289    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcdts\" (UniqueName: \"kubernetes.io/projected/be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c-kube-api-access-xcdts\") pod \"ingress-canary-gl2jr\" (UID: \"be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c\") " pod="openshift-ingress-canary/ingress-canary-gl2jr"
Jul 22 13:46:52.446157 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.444642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvv7z\" (UniqueName: \"kubernetes.io/projected/de6d3f3c-6c8c-400b-b511-7078e838b585-kube-api-access-qvv7z\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.512223 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.512197    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gl2jr"
Jul 22 13:46:52.660414 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.660251    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gl2jr"]
Jul 22 13:46:52.664120 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:46:52.664093    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe7e8412_9c60_47f7_8e1f_82ebf2dc3e1c.slice/crio-c5403131c17034be0e2d2c8011c2f7556483480ad2faeb7d30a2f8e281568cd3 WatchSource:0}: Error finding container c5403131c17034be0e2d2c8011c2f7556483480ad2faeb7d30a2f8e281568cd3: Status 404 returned error can't find the container with id c5403131c17034be0e2d2c8011c2f7556483480ad2faeb7d30a2f8e281568cd3
Jul 22 13:46:52.935150 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.935099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:52.935316 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:52.935189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:52.935316 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:52.935243    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 13:46:52.935316 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:52.935313    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls podName:de6d3f3c-6c8c-400b-b511-7078e838b585 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:53.935294732 +0000 UTC m=+38.177389677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls") pod "dns-default-xfm7k" (UID: "de6d3f3c-6c8c-400b-b511-7078e838b585") : secret "dns-default-metrics-tls" not found
Jul 22 13:46:52.935496 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:52.935313    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 13:46:52.935496 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:52.935331    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79b74b5dc5-nj6mm: secret "image-registry-tls" not found
Jul 22 13:46:52.935496 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:52.935382    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls podName:261ac3a7-3d64-4f19-af51-06da5be38aca nodeName:}" failed. No retries permitted until 2026-07-22 13:46:53.935366463 +0000 UTC m=+38.177461488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls") pod "image-registry-79b74b5dc5-nj6mm" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca") : secret "image-registry-tls" not found
Jul 22 13:46:53.248673 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.248593    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:46:53.248673 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.248606    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:46:53.248896 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.248777    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:46:53.251700 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.251678    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 13:46:53.251835 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.251711    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 13:46:53.251835 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.251791    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 13:46:53.251938 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.251845    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 13:46:53.252760 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.252737    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-phx9h\""
Jul 22 13:46:53.252760 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.252751    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l6npf\""
Jul 22 13:46:53.420663 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.420630    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gl2jr" event={"ID":"be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c","Type":"ContainerStarted","Data":"c5403131c17034be0e2d2c8011c2f7556483480ad2faeb7d30a2f8e281568cd3"}
Jul 22 13:46:53.942591 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.942555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:53.942813 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:53.942628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:53.942813 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:53.942733    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 13:46:53.942813 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:53.942743    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79b74b5dc5-nj6mm: secret "image-registry-tls" not found
Jul 22 13:46:53.942813 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:53.942741    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 13:46:53.943046 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:53.942821    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls podName:261ac3a7-3d64-4f19-af51-06da5be38aca nodeName:}" failed. No retries permitted until 2026-07-22 13:46:55.94280331 +0000 UTC m=+40.184898255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls") pod "image-registry-79b74b5dc5-nj6mm" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca") : secret "image-registry-tls" not found
Jul 22 13:46:53.943046 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:53.942840    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls podName:de6d3f3c-6c8c-400b-b511-7078e838b585 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:55.942830642 +0000 UTC m=+40.184925588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls") pod "dns-default-xfm7k" (UID: "de6d3f3c-6c8c-400b-b511-7078e838b585") : secret "dns-default-metrics-tls" not found
Jul 22 13:46:54.425764 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:54.425732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bdxf" event={"ID":"57f9f457-158b-4e7e-907c-a431f3892e96","Type":"ContainerStarted","Data":"1a14d9421476522ad3e34112152e8b062efba384f3c0b47379c49aefabad07a6"}
Jul 22 13:46:55.432750 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:55.432718    2578 generic.go:356] "Generic (PLEG): container finished" podID="57f9f457-158b-4e7e-907c-a431f3892e96" containerID="1a14d9421476522ad3e34112152e8b062efba384f3c0b47379c49aefabad07a6" exitCode=0
Jul 22 13:46:55.433123 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:55.432771    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bdxf" event={"ID":"57f9f457-158b-4e7e-907c-a431f3892e96","Type":"ContainerDied","Data":"1a14d9421476522ad3e34112152e8b062efba384f3c0b47379c49aefabad07a6"}
Jul 22 13:46:55.956487 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:55.956459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:55.956623 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:55.956514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:55.956623 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:55.956608    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 13:46:55.956623 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:55.956611    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 13:46:55.956730 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:55.956631    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79b74b5dc5-nj6mm: secret "image-registry-tls" not found
Jul 22 13:46:55.956730 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:55.956656    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls podName:de6d3f3c-6c8c-400b-b511-7078e838b585 nodeName:}" failed. No retries permitted until 2026-07-22 13:46:59.956643699 +0000 UTC m=+44.198738641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls") pod "dns-default-xfm7k" (UID: "de6d3f3c-6c8c-400b-b511-7078e838b585") : secret "dns-default-metrics-tls" not found
Jul 22 13:46:55.956730 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:55.956683    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls podName:261ac3a7-3d64-4f19-af51-06da5be38aca nodeName:}" failed. No retries permitted until 2026-07-22 13:46:59.956669776 +0000 UTC m=+44.198764719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls") pod "image-registry-79b74b5dc5-nj6mm" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca") : secret "image-registry-tls" not found
Jul 22 13:46:56.438098 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:56.438062    2578 generic.go:356] "Generic (PLEG): container finished" podID="57f9f457-158b-4e7e-907c-a431f3892e96" containerID="9b71de08db538ff231e9790ad1533fd24fb333704b7ef95c87cf1a2c5f8c1f40" exitCode=0
Jul 22 13:46:56.438530 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:56.438148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bdxf" event={"ID":"57f9f457-158b-4e7e-907c-a431f3892e96","Type":"ContainerDied","Data":"9b71de08db538ff231e9790ad1533fd24fb333704b7ef95c87cf1a2c5f8c1f40"}
Jul 22 13:46:57.444947 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:57.444914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bdxf" event={"ID":"57f9f457-158b-4e7e-907c-a431f3892e96","Type":"ContainerStarted","Data":"6afffc0f38f4e06d16b92037ce782ce00d3dbe6dc2fd06a3ce3853adf5c478f7"}
Jul 22 13:46:57.469087 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:57.469042    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5bdxf" podStartSLOduration=10.144150128 podStartE2EDuration="41.469026413s" totalImagesPullingTime="31.324876285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:57.468275779 +0000 UTC m=+41.710370742" watchObservedRunningTime="2026-07-22 13:46:57.469026413 +0000 UTC m=+41.711121377"
Jul 22 13:46:58.448463 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:58.448371    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gl2jr" event={"ID":"be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c","Type":"ContainerStarted","Data":"9e90479b9bc27184d4d11633f3abcc3f2eb8f3821ef303c7c509f7ab915ca4ef"}
Jul 22 13:46:59.985157 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:59.985102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:46:59.985570 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:46:59.985190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:46:59.985570 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:59.985244    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 13:46:59.985570 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:59.985261    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79b74b5dc5-nj6mm: secret "image-registry-tls" not found
Jul 22 13:46:59.985570 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:59.985311    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls podName:261ac3a7-3d64-4f19-af51-06da5be38aca nodeName:}" failed. No retries permitted until 2026-07-22 13:47:07.985296263 +0000 UTC m=+52.227391206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls") pod "image-registry-79b74b5dc5-nj6mm" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca") : secret "image-registry-tls" not found
Jul 22 13:46:59.985570 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:59.985301    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 13:46:59.985570 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:46:59.985381    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls podName:de6d3f3c-6c8c-400b-b511-7078e838b585 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:07.985364937 +0000 UTC m=+52.227459886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls") pod "dns-default-xfm7k" (UID: "de6d3f3c-6c8c-400b-b511-7078e838b585") : secret "dns-default-metrics-tls" not found
Jul 22 13:47:00.254904 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.254819    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gl2jr" podStartSLOduration=2.7531367749999998 podStartE2EDuration="8.254802208s" totalImagesPullingTime="5.501665433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:46:58.465595994 +0000 UTC m=+42.707690958" watchObservedRunningTime="2026-07-22 13:47:00.254802208 +0000 UTC m=+44.496897166"
Jul 22 13:47:00.255124 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.255112    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p4pzr"]
Jul 22 13:47:00.276759 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.276737    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p4pzr"]
Jul 22 13:47:00.276878 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.276843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.279210 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.279189    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 13:47:00.279342 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.279194    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 13:47:00.279342 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.279251    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 13:47:00.280011 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.279996    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 13:47:00.280081 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.280027    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lrzs\""
Jul 22 13:47:00.387701 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.387682    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/213fb125-317a-4998-a425-21b3cff4da1d-crio-socket\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.387788 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.387736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.387788 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.387780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.387848 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.387824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/213fb125-317a-4998-a425-21b3cff4da1d-data-volume\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.387911 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.387890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vjpc\" (UniqueName: \"kubernetes.io/projected/213fb125-317a-4998-a425-21b3cff4da1d-kube-api-access-9vjpc\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.488775 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.488751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/213fb125-317a-4998-a425-21b3cff4da1d-data-volume\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.488852 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.488793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vjpc\" (UniqueName: \"kubernetes.io/projected/213fb125-317a-4998-a425-21b3cff4da1d-kube-api-access-9vjpc\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.488852 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.488822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/213fb125-317a-4998-a425-21b3cff4da1d-crio-socket\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.488908 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.488888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.488954 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.488915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.489008 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:00.488995    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 13:47:00.489047 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:00.489010    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 13:47:00.489047 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.489024    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/213fb125-317a-4998-a425-21b3cff4da1d-crio-socket\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.489111 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:00.489079    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm podName:213fb125-317a-4998-a425-21b3cff4da1d nodeName:}" failed. No retries permitted until 2026-07-22 13:47:00.989049574 +0000 UTC m=+45.231144536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4pzr" (UID: "213fb125-317a-4998-a425-21b3cff4da1d") : configmap "kube-rbac-proxy" not found
Jul 22 13:47:00.489111 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:00.489100    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls podName:213fb125-317a-4998-a425-21b3cff4da1d nodeName:}" failed. No retries permitted until 2026-07-22 13:47:00.989089183 +0000 UTC m=+45.231184139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4pzr" (UID: "213fb125-317a-4998-a425-21b3cff4da1d") : secret "insights-runtime-extractor-tls" not found
Jul 22 13:47:00.489111 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.489097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/213fb125-317a-4998-a425-21b3cff4da1d-data-volume\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.500585 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.500557    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vjpc\" (UniqueName: \"kubernetes.io/projected/213fb125-317a-4998-a425-21b3cff4da1d-kube-api-access-9vjpc\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.995730 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.995693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.996171 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:00.995739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:00.996171 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:00.995861    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 13:47:00.996171 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:00.995894    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 13:47:00.996171 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:00.995934    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls podName:213fb125-317a-4998-a425-21b3cff4da1d nodeName:}" failed. No retries permitted until 2026-07-22 13:47:01.9959176 +0000 UTC m=+46.238012545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4pzr" (UID: "213fb125-317a-4998-a425-21b3cff4da1d") : secret "insights-runtime-extractor-tls" not found
Jul 22 13:47:00.996171 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:00.995964    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm podName:213fb125-317a-4998-a425-21b3cff4da1d nodeName:}" failed. No retries permitted until 2026-07-22 13:47:01.995950505 +0000 UTC m=+46.238045448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4pzr" (UID: "213fb125-317a-4998-a425-21b3cff4da1d") : configmap "kube-rbac-proxy" not found
Jul 22 13:47:01.051545 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.051517    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2"]
Jul 22 13:47:01.067953 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.067931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2"
Jul 22 13:47:01.069989 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.069970    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gckzv\""
Jul 22 13:47:01.070082 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.069974    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 22 13:47:01.070749 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.070729    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 22 13:47:01.072081 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.072060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2"]
Jul 22 13:47:01.197829 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.197809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrftq\" (UniqueName: \"kubernetes.io/projected/60506615-cbfb-449d-bc37-af38df219308-kube-api-access-jrftq\") pod \"migrator-7cc9c7ffd7-k7ds2\" (UID: \"60506615-cbfb-449d-bc37-af38df219308\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2"
Jul 22 13:47:01.298204 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.298180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrftq\" (UniqueName: \"kubernetes.io/projected/60506615-cbfb-449d-bc37-af38df219308-kube-api-access-jrftq\") pod \"migrator-7cc9c7ffd7-k7ds2\" (UID: \"60506615-cbfb-449d-bc37-af38df219308\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2"
Jul 22 13:47:01.310372 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.310356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrftq\" (UniqueName: \"kubernetes.io/projected/60506615-cbfb-449d-bc37-af38df219308-kube-api-access-jrftq\") pod \"migrator-7cc9c7ffd7-k7ds2\" (UID: \"60506615-cbfb-449d-bc37-af38df219308\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2"
Jul 22 13:47:01.377235 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.377212    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2"
Jul 22 13:47:01.503351 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.503317    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2"]
Jul 22 13:47:01.506263 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:47:01.506241    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60506615_cbfb_449d_bc37_af38df219308.slice/crio-9133c8f1d60e59e94ce5362fd36f768cfb2851bec39f42656c1ab0841114283e WatchSource:0}: Error finding container 9133c8f1d60e59e94ce5362fd36f768cfb2851bec39f42656c1ab0841114283e: Status 404 returned error can't find the container with id 9133c8f1d60e59e94ce5362fd36f768cfb2851bec39f42656c1ab0841114283e
Jul 22 13:47:01.851727 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:01.851709    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bl7wx_b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc/dns-node-resolver/0.log"
Jul 22 13:47:02.004020 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.003993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:02.004340 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.004026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:02.004340 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:02.004128    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 13:47:02.004340 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:02.004129    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 13:47:02.004340 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:02.004190    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm podName:213fb125-317a-4998-a425-21b3cff4da1d nodeName:}" failed. No retries permitted until 2026-07-22 13:47:04.004177059 +0000 UTC m=+48.246272001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4pzr" (UID: "213fb125-317a-4998-a425-21b3cff4da1d") : configmap "kube-rbac-proxy" not found
Jul 22 13:47:02.004340 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:02.004202    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls podName:213fb125-317a-4998-a425-21b3cff4da1d nodeName:}" failed. No retries permitted until 2026-07-22 13:47:04.004195818 +0000 UTC m=+48.246290760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4pzr" (UID: "213fb125-317a-4998-a425-21b3cff4da1d") : secret "insights-runtime-extractor-tls" not found
Jul 22 13:47:02.458818 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.458789    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2" event={"ID":"60506615-cbfb-449d-bc37-af38df219308","Type":"ContainerStarted","Data":"9133c8f1d60e59e94ce5362fd36f768cfb2851bec39f42656c1ab0841114283e"}
Jul 22 13:47:02.692458 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.692431    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-ftfvk"]
Jul 22 13:47:02.720011 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.719951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-ftfvk"]
Jul 22 13:47:02.720120 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.720031    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-ftfvk"
Jul 22 13:47:02.722438 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.722418    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 22 13:47:02.722708 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.722687    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 22 13:47:02.723323 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.723307    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 22 13:47:02.723388 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.723310    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xlnj4\""
Jul 22 13:47:02.723572 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.723556    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 22 13:47:02.911308 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.911281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/08b9ed51-ce3d-456a-afff-b619cff9d1d4-signing-cabundle\") pod \"service-ca-58598695f7-ftfvk\" (UID: \"08b9ed51-ce3d-456a-afff-b619cff9d1d4\") " pod="openshift-service-ca/service-ca-58598695f7-ftfvk"
Jul 22 13:47:02.911431 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.911333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/08b9ed51-ce3d-456a-afff-b619cff9d1d4-signing-key\") pod \"service-ca-58598695f7-ftfvk\" (UID: \"08b9ed51-ce3d-456a-afff-b619cff9d1d4\") " pod="openshift-service-ca/service-ca-58598695f7-ftfvk"
Jul 22 13:47:02.911431 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:02.911403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh4ts\" (UniqueName: \"kubernetes.io/projected/08b9ed51-ce3d-456a-afff-b619cff9d1d4-kube-api-access-jh4ts\") pod \"service-ca-58598695f7-ftfvk\" (UID: \"08b9ed51-ce3d-456a-afff-b619cff9d1d4\") " pod="openshift-service-ca/service-ca-58598695f7-ftfvk"
Jul 22 13:47:03.011833 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:03.011780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/08b9ed51-ce3d-456a-afff-b619cff9d1d4-signing-key\") pod \"service-ca-58598695f7-ftfvk\" (UID: \"08b9ed51-ce3d-456a-afff-b619cff9d1d4\") " pod="openshift-service-ca/service-ca-58598695f7-ftfvk"
Jul 22 13:47:03.011833 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:03.011827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh4ts\" (UniqueName: \"kubernetes.io/projected/08b9ed51-ce3d-456a-afff-b619cff9d1d4-kube-api-access-jh4ts\") pod \"service-ca-58598695f7-ftfvk\" (UID: \"08b9ed51-ce3d-456a-afff-b619cff9d1d4\") " pod="openshift-service-ca/service-ca-58598695f7-ftfvk"
Jul 22 13:47:03.012204 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:03.011879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/08b9ed51-ce3d-456a-afff-b619cff9d1d4-signing-cabundle\") pod \"service-ca-58598695f7-ftfvk\" (UID: \"08b9ed51-ce3d-456a-afff-b619cff9d1d4\") " pod="openshift-service-ca/service-ca-58598695f7-ftfvk"
Jul 22 13:47:03.012520 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:03.012503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/08b9ed51-ce3d-456a-afff-b619cff9d1d4-signing-cabundle\") pod \"service-ca-58598695f7-ftfvk\" (UID: \"08b9ed51-ce3d-456a-afff-b619cff9d1d4\") " pod="openshift-service-ca/service-ca-58598695f7-ftfvk"
Jul 22 13:47:03.014287 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:03.014269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/08b9ed51-ce3d-456a-afff-b619cff9d1d4-signing-key\") pod \"service-ca-58598695f7-ftfvk\" (UID: \"08b9ed51-ce3d-456a-afff-b619cff9d1d4\") " pod="openshift-service-ca/service-ca-58598695f7-ftfvk"
Jul 22 13:47:03.019749 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:03.019725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh4ts\" (UniqueName: \"kubernetes.io/projected/08b9ed51-ce3d-456a-afff-b619cff9d1d4-kube-api-access-jh4ts\") pod \"service-ca-58598695f7-ftfvk\" (UID: \"08b9ed51-ce3d-456a-afff-b619cff9d1d4\") " pod="openshift-service-ca/service-ca-58598695f7-ftfvk"
Jul 22 13:47:03.028409 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:03.028393    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-ftfvk"
Jul 22 13:47:03.051720 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:03.051705    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvdhd_dca31c51-02c6-473f-8e76-1aace19d0a56/node-ca/0.log"
Jul 22 13:47:03.174740 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:03.174712    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-ftfvk"]
Jul 22 13:47:03.178559 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:47:03.178535    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b9ed51_ce3d_456a_afff_b619cff9d1d4.slice/crio-185e80ae453ee3db66eda00f2664c7ca9eef596585e8a593952ac34fdc2d7ac3 WatchSource:0}: Error finding container 185e80ae453ee3db66eda00f2664c7ca9eef596585e8a593952ac34fdc2d7ac3: Status 404 returned error can't find the container with id 185e80ae453ee3db66eda00f2664c7ca9eef596585e8a593952ac34fdc2d7ac3
Jul 22 13:47:03.462874 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:03.462845    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-ftfvk" event={"ID":"08b9ed51-ce3d-456a-afff-b619cff9d1d4","Type":"ContainerStarted","Data":"185e80ae453ee3db66eda00f2664c7ca9eef596585e8a593952ac34fdc2d7ac3"}
Jul 22 13:47:03.652503 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:03.652468    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gl2jr_be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c/serve-healthcheck-canary/0.log"
Jul 22 13:47:04.025170 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:04.025072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:04.025170 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:04.025110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:04.025706 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:04.025234    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 13:47:04.025706 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:04.025279    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 13:47:04.025706 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:04.025320    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm podName:213fb125-317a-4998-a425-21b3cff4da1d nodeName:}" failed. No retries permitted until 2026-07-22 13:47:08.025304003 +0000 UTC m=+52.267398945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p4pzr" (UID: "213fb125-317a-4998-a425-21b3cff4da1d") : configmap "kube-rbac-proxy" not found
Jul 22 13:47:04.025706 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:04.025364    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls podName:213fb125-317a-4998-a425-21b3cff4da1d nodeName:}" failed. No retries permitted until 2026-07-22 13:47:08.025345844 +0000 UTC m=+52.267440792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4pzr" (UID: "213fb125-317a-4998-a425-21b3cff4da1d") : secret "insights-runtime-extractor-tls" not found
Jul 22 13:47:05.469086 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:05.469045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2" event={"ID":"60506615-cbfb-449d-bc37-af38df219308","Type":"ContainerStarted","Data":"d85a3fe90053950f2b4a516dfe707f95a97dab41c6993aea21424809b612613c"}
Jul 22 13:47:05.469524 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:05.469108    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2" event={"ID":"60506615-cbfb-449d-bc37-af38df219308","Type":"ContainerStarted","Data":"bc90012cc21aa973596076a906f6a2bae9c3c4ad3c0026e5bb0af26d9ee123cc"}
Jul 22 13:47:05.470635 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:05.470607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-ftfvk" event={"ID":"08b9ed51-ce3d-456a-afff-b619cff9d1d4","Type":"ContainerStarted","Data":"0c4ad9550d0d7ee5323247d086228d255f4e5280165c157bc8a3fb154145c317"}
Jul 22 13:47:05.485186 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:05.485127    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-k7ds2" podStartSLOduration=1.529052176 podStartE2EDuration="4.485113512s" totalImagesPullingTime="2.956061336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:05.484106512 +0000 UTC m=+49.726201475" watchObservedRunningTime="2026-07-22 13:47:05.485113512 +0000 UTC m=+49.727208475"
Jul 22 13:47:05.498943 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:05.498899    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-ftfvk" podStartSLOduration=1.377734942 podStartE2EDuration="3.498882241s" totalImagesPullingTime="2.121147299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:05.498694658 +0000 UTC m=+49.740789621" watchObservedRunningTime="2026-07-22 13:47:05.498882241 +0000 UTC m=+49.740977205"
Jul 22 13:47:08.052604 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:08.052568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls\") pod \"image-registry-79b74b5dc5-nj6mm\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") " pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:47:08.053045 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:08.052655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:47:08.053045 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:08.052693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:08.053045 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:08.052721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:08.053045 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:08.052739    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 13:47:08.053045 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:08.052761    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79b74b5dc5-nj6mm: secret "image-registry-tls" not found
Jul 22 13:47:08.053045 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:08.052814    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 13:47:08.053045 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:08.052824    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 13:47:08.053045 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:08.052819    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls podName:261ac3a7-3d64-4f19-af51-06da5be38aca nodeName:}" failed. No retries permitted until 2026-07-22 13:47:24.052799345 +0000 UTC m=+68.294894292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls") pod "image-registry-79b74b5dc5-nj6mm" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca") : secret "image-registry-tls" not found
Jul 22 13:47:08.053045 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:08.052872    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls podName:213fb125-317a-4998-a425-21b3cff4da1d nodeName:}" failed. No retries permitted until 2026-07-22 13:47:16.052854842 +0000 UTC m=+60.294949803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p4pzr" (UID: "213fb125-317a-4998-a425-21b3cff4da1d") : secret "insights-runtime-extractor-tls" not found
Jul 22 13:47:08.053045 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:08.052891    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls podName:de6d3f3c-6c8c-400b-b511-7078e838b585 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:24.052881184 +0000 UTC m=+68.294976130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls") pod "dns-default-xfm7k" (UID: "de6d3f3c-6c8c-400b-b511-7078e838b585") : secret "dns-default-metrics-tls" not found
Jul 22 13:47:08.053566 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:08.053275    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/213fb125-317a-4998-a425-21b3cff4da1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:16.108899 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:16.108863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:16.111247 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:16.111223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/213fb125-317a-4998-a425-21b3cff4da1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p4pzr\" (UID: \"213fb125-317a-4998-a425-21b3cff4da1d\") " pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:16.187400 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:16.187373    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lrzs\""
Jul 22 13:47:16.196091 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:16.196068    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p4pzr"
Jul 22 13:47:16.323069 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:16.323042    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p4pzr"]
Jul 22 13:47:16.325935 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:47:16.325910    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod213fb125_317a_4998_a425_21b3cff4da1d.slice/crio-f28bb2a9e2b84709246cbb83dc90e5d30c2381d4c44bb5f54d52bfd43daf1e97 WatchSource:0}: Error finding container f28bb2a9e2b84709246cbb83dc90e5d30c2381d4c44bb5f54d52bfd43daf1e97: Status 404 returned error can't find the container with id f28bb2a9e2b84709246cbb83dc90e5d30c2381d4c44bb5f54d52bfd43daf1e97
Jul 22 13:47:16.408853 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:16.408805    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76njp"
Jul 22 13:47:16.499239 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:16.499212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4pzr" event={"ID":"213fb125-317a-4998-a425-21b3cff4da1d","Type":"ContainerStarted","Data":"f28bb2a9e2b84709246cbb83dc90e5d30c2381d4c44bb5f54d52bfd43daf1e97"}
Jul 22 13:47:21.517421 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.517334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4pzr" event={"ID":"213fb125-317a-4998-a425-21b3cff4da1d","Type":"ContainerStarted","Data":"cca325dcddb4ea620e836c177db7f53610f7cb3b1ad6cba84520a800dd454786"}
Jul 22 13:47:21.595379 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.595349    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8"]
Jul 22 13:47:21.597108 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.597086    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8"
Jul 22 13:47:21.598124 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.597318    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"]
Jul 22 13:47:21.599562 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.599544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.600656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.600636    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6t5ck\""
Jul 22 13:47:21.600755 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.600730    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 13:47:21.600910 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.600882    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 22 13:47:21.601350 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.601168    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 13:47:21.601350 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.601215    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 13:47:21.601475 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.601410    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 13:47:21.601973 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.601954    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 13:47:21.602086 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.602003    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 13:47:21.602086 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.602066    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 13:47:21.609631 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.609611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8"]
Jul 22 13:47:21.617008 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.616747    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"]
Jul 22 13:47:21.617008 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.616790    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79b74b5dc5-nj6mm"]
Jul 22 13:47:21.617008 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:21.616969    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm" podUID="261ac3a7-3d64-4f19-af51-06da5be38aca"
Jul 22 13:47:21.654331 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.654304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/57394ff7-71f2-4556-aa80-b6cb540e9130-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.654443 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.654337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.654443 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.654365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxjzq\" (UniqueName: \"kubernetes.io/projected/68564876-f77f-4b47-92af-050530115d65-kube-api-access-fxjzq\") pod \"managed-serviceaccount-addon-agent-b89f7c768-7ndq8\" (UID: \"68564876-f77f-4b47-92af-050530115d65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8"
Jul 22 13:47:21.654537 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.654469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-hub\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.654537 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.654510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68564876-f77f-4b47-92af-050530115d65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b89f7c768-7ndq8\" (UID: \"68564876-f77f-4b47-92af-050530115d65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8"
Jul 22 13:47:21.654597 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.654536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-ca\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.654597 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.654574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj7c4\" (UniqueName: \"kubernetes.io/projected/57394ff7-71f2-4556-aa80-b6cb540e9130-kube-api-access-dj7c4\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.654699 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.654649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.704096 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.704069    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cd6498b6-dmctp"]
Jul 22 13:47:21.706806 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.706370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.738033 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.738008    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cd6498b6-dmctp"]
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.755753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/57394ff7-71f2-4556-aa80-b6cb540e9130-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.755793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.755817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb1c2ab7-041c-4455-8212-d83a3fbde80c-bound-sa-token\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.755854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb1c2ab7-041c-4455-8212-d83a3fbde80c-ca-trust-extracted\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.755882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxjzq\" (UniqueName: \"kubernetes.io/projected/68564876-f77f-4b47-92af-050530115d65-kube-api-access-fxjzq\") pod \"managed-serviceaccount-addon-agent-b89f7c768-7ndq8\" (UID: \"68564876-f77f-4b47-92af-050530115d65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.755907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb1c2ab7-041c-4455-8212-d83a3fbde80c-registry-certificates\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.755964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-hub\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.755982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb1c2ab7-041c-4455-8212-d83a3fbde80c-image-registry-private-configuration\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.756003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4676\" (UniqueName: \"kubernetes.io/projected/bb1c2ab7-041c-4455-8212-d83a3fbde80c-kube-api-access-p4676\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.756029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68564876-f77f-4b47-92af-050530115d65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b89f7c768-7ndq8\" (UID: \"68564876-f77f-4b47-92af-050530115d65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.756048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-ca\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.756073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj7c4\" (UniqueName: \"kubernetes.io/projected/57394ff7-71f2-4556-aa80-b6cb540e9130-kube-api-access-dj7c4\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.756098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb1c2ab7-041c-4455-8212-d83a3fbde80c-trusted-ca\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.756151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.756268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.756175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb1c2ab7-041c-4455-8212-d83a3fbde80c-installation-pull-secrets\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.757026 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.756197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb1c2ab7-041c-4455-8212-d83a3fbde80c-registry-tls\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.757081 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.757062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/57394ff7-71f2-4556-aa80-b6cb540e9130-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.759962 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.759937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-ca\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.760678 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.760653    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-hub\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.760823 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.760801    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68564876-f77f-4b47-92af-050530115d65-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b89f7c768-7ndq8\" (UID: \"68564876-f77f-4b47-92af-050530115d65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8"
Jul 22 13:47:21.761695 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.761675    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.762881 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.762857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/57394ff7-71f2-4556-aa80-b6cb540e9130-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.773678 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.773638    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj7c4\" (UniqueName: \"kubernetes.io/projected/57394ff7-71f2-4556-aa80-b6cb540e9130-kube-api-access-dj7c4\") pod \"cluster-proxy-proxy-agent-5c6476464c-sb4zq\" (UID: \"57394ff7-71f2-4556-aa80-b6cb540e9130\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:21.774317 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.774270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxjzq\" (UniqueName: \"kubernetes.io/projected/68564876-f77f-4b47-92af-050530115d65-kube-api-access-fxjzq\") pod \"managed-serviceaccount-addon-agent-b89f7c768-7ndq8\" (UID: \"68564876-f77f-4b47-92af-050530115d65\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8"
Jul 22 13:47:21.857533 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.857507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb1c2ab7-041c-4455-8212-d83a3fbde80c-image-registry-private-configuration\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.857744 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.857542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4676\" (UniqueName: \"kubernetes.io/projected/bb1c2ab7-041c-4455-8212-d83a3fbde80c-kube-api-access-p4676\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.857744 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.857576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb1c2ab7-041c-4455-8212-d83a3fbde80c-trusted-ca\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.857870 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.857737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb1c2ab7-041c-4455-8212-d83a3fbde80c-installation-pull-secrets\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.857870 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.857775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb1c2ab7-041c-4455-8212-d83a3fbde80c-registry-tls\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.857870 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.857813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb1c2ab7-041c-4455-8212-d83a3fbde80c-bound-sa-token\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.857870 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.857853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb1c2ab7-041c-4455-8212-d83a3fbde80c-ca-trust-extracted\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.858098 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.857879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb1c2ab7-041c-4455-8212-d83a3fbde80c-registry-certificates\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.858382 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.858356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb1c2ab7-041c-4455-8212-d83a3fbde80c-ca-trust-extracted\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.859098 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.859071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb1c2ab7-041c-4455-8212-d83a3fbde80c-trusted-ca\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.859217 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.859110    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb1c2ab7-041c-4455-8212-d83a3fbde80c-registry-certificates\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.864603 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.864574    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb1c2ab7-041c-4455-8212-d83a3fbde80c-image-registry-private-configuration\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.864708 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.864603    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb1c2ab7-041c-4455-8212-d83a3fbde80c-registry-tls\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.865760 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.865736    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb1c2ab7-041c-4455-8212-d83a3fbde80c-installation-pull-secrets\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.872357 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.872327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4676\" (UniqueName: \"kubernetes.io/projected/bb1c2ab7-041c-4455-8212-d83a3fbde80c-kube-api-access-p4676\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.872805 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.872783    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb1c2ab7-041c-4455-8212-d83a3fbde80c-bound-sa-token\") pod \"image-registry-7cd6498b6-dmctp\" (UID: \"bb1c2ab7-041c-4455-8212-d83a3fbde80c\") " pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:21.918178 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.918152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8"
Jul 22 13:47:21.924873 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:21.924844    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"
Jul 22 13:47:22.030511 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.030306    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sqdjp\""
Jul 22 13:47:22.038218 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.038198    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:22.059865 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.059838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:47:22.060007 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.059879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnp5\" (UniqueName: \"kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5\") pod \"network-check-target-hl66n\" (UID: \"ae59d001-6ba1-4e77-8808-d6e78d9d7c21\") " pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:47:22.060007 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.059925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:47:22.062802 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.062768    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 13:47:22.062943 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.062894    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 13:47:22.062943 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.062919    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 13:47:22.073151 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.073112    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 13:47:22.074535 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.074513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d252f413-c17e-4a0c-a75a-c4879f6402d4-metrics-certs\") pod \"network-metrics-daemon-q47d2\" (UID: \"d252f413-c17e-4a0c-a75a-c4879f6402d4\") " pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:47:22.074779 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.074727    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8"]
Jul 22 13:47:22.078167 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.078060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6-original-pull-secret\") pod \"global-pull-secret-syncer-lhzsv\" (UID: \"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6\") " pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:47:22.078888 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:47:22.078855    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68564876_f77f_4b47_92af_050530115d65.slice/crio-c496a7b523a2894c9fc9eca97c7be32aff1ab5e3f688bbc1b8725badbdfe680d WatchSource:0}: Error finding container c496a7b523a2894c9fc9eca97c7be32aff1ab5e3f688bbc1b8725badbdfe680d: Status 404 returned error can't find the container with id c496a7b523a2894c9fc9eca97c7be32aff1ab5e3f688bbc1b8725badbdfe680d
Jul 22 13:47:22.084967 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.084925    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpnp5\" (UniqueName: \"kubernetes.io/projected/ae59d001-6ba1-4e77-8808-d6e78d9d7c21-kube-api-access-fpnp5\") pod \"network-check-target-hl66n\" (UID: \"ae59d001-6ba1-4e77-8808-d6e78d9d7c21\") " pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:47:22.100220 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.100159    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq"]
Jul 22 13:47:22.104276 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:47:22.104238    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57394ff7_71f2_4556_aa80_b6cb540e9130.slice/crio-b3094e12b09e15358cbcb1562c718f954cf601cd87b158cbb83d13fb51cba43b WatchSource:0}: Error finding container b3094e12b09e15358cbcb1562c718f954cf601cd87b158cbb83d13fb51cba43b: Status 404 returned error can't find the container with id b3094e12b09e15358cbcb1562c718f954cf601cd87b158cbb83d13fb51cba43b
Jul 22 13:47:22.191996 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.191967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cd6498b6-dmctp"]
Jul 22 13:47:22.196397 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:47:22.196368    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1c2ab7_041c_4455_8212_d83a3fbde80c.slice/crio-0726d0a7d1903830f5d84011672e95882841238389af019fb0506296cb1a5213 WatchSource:0}: Error finding container 0726d0a7d1903830f5d84011672e95882841238389af019fb0506296cb1a5213: Status 404 returned error can't find the container with id 0726d0a7d1903830f5d84011672e95882841238389af019fb0506296cb1a5213
Jul 22 13:47:22.360122 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.360050    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhzsv"
Jul 22 13:47:22.368187 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.368164    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-phx9h\""
Jul 22 13:47:22.374925 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.374897    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l6npf\""
Jul 22 13:47:22.376512 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.376490    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q47d2"
Jul 22 13:47:22.383024 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.382992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:47:22.525263 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.523333    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhzsv"]
Jul 22 13:47:22.526211 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.526095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8" event={"ID":"68564876-f77f-4b47-92af-050530115d65","Type":"ContainerStarted","Data":"c496a7b523a2894c9fc9eca97c7be32aff1ab5e3f688bbc1b8725badbdfe680d"}
Jul 22 13:47:22.531333 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.530338    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd6498b6-dmctp" event={"ID":"bb1c2ab7-041c-4455-8212-d83a3fbde80c","Type":"ContainerStarted","Data":"a988c85e3580b929b67080e26485244a5dd808910f5a16bd9e214a62493f3f0e"}
Jul 22 13:47:22.531333 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.530389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd6498b6-dmctp" event={"ID":"bb1c2ab7-041c-4455-8212-d83a3fbde80c","Type":"ContainerStarted","Data":"0726d0a7d1903830f5d84011672e95882841238389af019fb0506296cb1a5213"}
Jul 22 13:47:22.531333 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.530600    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:22.532436 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.532405    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:47:22.532653 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.532637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq" event={"ID":"57394ff7-71f2-4556-aa80-b6cb540e9130","Type":"ContainerStarted","Data":"b3094e12b09e15358cbcb1562c718f954cf601cd87b158cbb83d13fb51cba43b"}
Jul 22 13:47:22.542194 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.542121    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:47:22.545268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.545239    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q47d2"]
Jul 22 13:47:22.548212 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:47:22.548188    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd252f413_c17e_4a0c_a75a_c4879f6402d4.slice/crio-00b9f5d0f940e6da97690b73781a8f0d8442df3989c5407a011e8087a1af63d3 WatchSource:0}: Error finding container 00b9f5d0f940e6da97690b73781a8f0d8442df3989c5407a011e8087a1af63d3: Status 404 returned error can't find the container with id 00b9f5d0f940e6da97690b73781a8f0d8442df3989c5407a011e8087a1af63d3
Jul 22 13:47:22.554441 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.552603    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cd6498b6-dmctp" podStartSLOduration=1.5525857410000001 podStartE2EDuration="1.552585741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:22.55167255 +0000 UTC m=+66.793767514" watchObservedRunningTime="2026-07-22 13:47:22.552585741 +0000 UTC m=+66.794680705"
Jul 22 13:47:22.575117 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.575015    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hl66n"]
Jul 22 13:47:22.577442 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:47:22.577412    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae59d001_6ba1_4e77_8808_d6e78d9d7c21.slice/crio-ada7424abcfebd409190dffcd34e6fe28dc14adab1252ffd06517120e33b8d23 WatchSource:0}: Error finding container ada7424abcfebd409190dffcd34e6fe28dc14adab1252ffd06517120e33b8d23: Status 404 returned error can't find the container with id ada7424abcfebd409190dffcd34e6fe28dc14adab1252ffd06517120e33b8d23
Jul 22 13:47:22.664492 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.664402    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/261ac3a7-3d64-4f19-af51-06da5be38aca-ca-trust-extracted\") pod \"261ac3a7-3d64-4f19-af51-06da5be38aca\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") "
Jul 22 13:47:22.664492 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.664459    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-bound-sa-token\") pod \"261ac3a7-3d64-4f19-af51-06da5be38aca\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") "
Jul 22 13:47:22.664492 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.664491    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78kjn\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-kube-api-access-78kjn\") pod \"261ac3a7-3d64-4f19-af51-06da5be38aca\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") "
Jul 22 13:47:22.664753 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.664518    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-certificates\") pod \"261ac3a7-3d64-4f19-af51-06da5be38aca\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") "
Jul 22 13:47:22.664753 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.664560    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-image-registry-private-configuration\") pod \"261ac3a7-3d64-4f19-af51-06da5be38aca\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") "
Jul 22 13:47:22.664753 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.664608    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-installation-pull-secrets\") pod \"261ac3a7-3d64-4f19-af51-06da5be38aca\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") "
Jul 22 13:47:22.664753 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.664639    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-trusted-ca\") pod \"261ac3a7-3d64-4f19-af51-06da5be38aca\" (UID: \"261ac3a7-3d64-4f19-af51-06da5be38aca\") "
Jul 22 13:47:22.665505 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.665226    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/261ac3a7-3d64-4f19-af51-06da5be38aca-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "261ac3a7-3d64-4f19-af51-06da5be38aca" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:47:22.665505 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.665467    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "261ac3a7-3d64-4f19-af51-06da5be38aca" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:47:22.665659 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.665627    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "261ac3a7-3d64-4f19-af51-06da5be38aca" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:47:22.667614 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.667525    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "261ac3a7-3d64-4f19-af51-06da5be38aca" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:47:22.667614 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.667568    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "261ac3a7-3d64-4f19-af51-06da5be38aca" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:47:22.667614 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.667569    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-kube-api-access-78kjn" (OuterVolumeSpecName: "kube-api-access-78kjn") pod "261ac3a7-3d64-4f19-af51-06da5be38aca" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca"). InnerVolumeSpecName "kube-api-access-78kjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:47:22.667946 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.667914    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "261ac3a7-3d64-4f19-af51-06da5be38aca" (UID: "261ac3a7-3d64-4f19-af51-06da5be38aca"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:47:22.765967 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.765937    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-installation-pull-secrets\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 13:47:22.765967 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.765965    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-trusted-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 13:47:22.765967 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.765973    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/261ac3a7-3d64-4f19-af51-06da5be38aca-ca-trust-extracted\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 13:47:22.766203 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.765981    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-bound-sa-token\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 13:47:22.766203 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.765990    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78kjn\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-kube-api-access-78kjn\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 13:47:22.766203 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.765997    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-certificates\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 13:47:22.766203 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:22.766009    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/261ac3a7-3d64-4f19-af51-06da5be38aca-image-registry-private-configuration\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 13:47:23.537390 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:23.537356    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hl66n" event={"ID":"ae59d001-6ba1-4e77-8808-d6e78d9d7c21","Type":"ContainerStarted","Data":"ada7424abcfebd409190dffcd34e6fe28dc14adab1252ffd06517120e33b8d23"}
Jul 22 13:47:23.538622 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:23.538592    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q47d2" event={"ID":"d252f413-c17e-4a0c-a75a-c4879f6402d4","Type":"ContainerStarted","Data":"00b9f5d0f940e6da97690b73781a8f0d8442df3989c5407a011e8087a1af63d3"}
Jul 22 13:47:23.539722 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:23.539693    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhzsv" event={"ID":"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6","Type":"ContainerStarted","Data":"ed49abe97c2119ebca8b34295565048faeccee4e857d752716d32640490367cb"}
Jul 22 13:47:23.539821 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:23.539723    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79b74b5dc5-nj6mm"
Jul 22 13:47:23.592083 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:23.592056    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79b74b5dc5-nj6mm"]
Jul 22 13:47:23.595292 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:23.595269    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79b74b5dc5-nj6mm"]
Jul 22 13:47:23.674197 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:23.674158    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/261ac3a7-3d64-4f19-af51-06da5be38aca-registry-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 13:47:24.079089 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:24.078651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:47:24.083648 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:24.083527    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de6d3f3c-6c8c-400b-b511-7078e838b585-metrics-tls\") pod \"dns-default-xfm7k\" (UID: \"de6d3f3c-6c8c-400b-b511-7078e838b585\") " pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:47:24.253587 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:24.253387    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="261ac3a7-3d64-4f19-af51-06da5be38aca" path="/var/lib/kubelet/pods/261ac3a7-3d64-4f19-af51-06da5be38aca/volumes"
Jul 22 13:47:24.320890 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:24.320860    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vvhl\""
Jul 22 13:47:24.329656 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:24.329595    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:47:25.132717 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:25.132683    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xfm7k"]
Jul 22 13:47:25.439822 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:47:25.439796    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6d3f3c_6c8c_400b_b511_7078e838b585.slice/crio-e6215f2cc6a5f5404e87a672467f9863efd6bd9b3f82f7237735152a3d48e252 WatchSource:0}: Error finding container e6215f2cc6a5f5404e87a672467f9863efd6bd9b3f82f7237735152a3d48e252: Status 404 returned error can't find the container with id e6215f2cc6a5f5404e87a672467f9863efd6bd9b3f82f7237735152a3d48e252
Jul 22 13:47:25.550907 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:25.550824    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4pzr" event={"ID":"213fb125-317a-4998-a425-21b3cff4da1d","Type":"ContainerStarted","Data":"df723e73bb9ede3783597129e06a59bd4df577b0330891afea5953ca7ee10a7f"}
Jul 22 13:47:25.552459 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:25.552371    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xfm7k" event={"ID":"de6d3f3c-6c8c-400b-b511-7078e838b585","Type":"ContainerStarted","Data":"e6215f2cc6a5f5404e87a672467f9863efd6bd9b3f82f7237735152a3d48e252"}
Jul 22 13:47:26.562182 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:26.561449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q47d2" event={"ID":"d252f413-c17e-4a0c-a75a-c4879f6402d4","Type":"ContainerStarted","Data":"3aa82f1f2b66612bc0e3fb8e6e53a7f8bef64bdb75ae0e2282a1a47b8d9490b2"}
Jul 22 13:47:26.562182 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:26.561517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q47d2" event={"ID":"d252f413-c17e-4a0c-a75a-c4879f6402d4","Type":"ContainerStarted","Data":"f14615e539f218f5be9c980eaed555e5ff8bca09532204218c8087bdaf3733f1"}
Jul 22 13:47:26.581302 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:26.581245    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q47d2" podStartSLOduration=66.302475906 podStartE2EDuration="1m9.581224349s" totalImagesPullingTime="3.278748443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:26.580632316 +0000 UTC m=+70.822727280" watchObservedRunningTime="2026-07-22 13:47:26.581224349 +0000 UTC m=+70.823319311"
Jul 22 13:47:33.595513 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:33.594877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p4pzr" event={"ID":"213fb125-317a-4998-a425-21b3cff4da1d","Type":"ContainerStarted","Data":"ba07d4a91a648019c5ea0eba3b5d587664338a22afc7786863e61404e553eccb"}
Jul 22 13:47:33.601610 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:33.600443    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq" event={"ID":"57394ff7-71f2-4556-aa80-b6cb540e9130","Type":"ContainerStarted","Data":"3019289f5b6edf97c9204b26d42b165bd11b8bface881c5d4c8584085ed7a2c1"}
Jul 22 13:47:33.605011 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:33.604974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hl66n" event={"ID":"ae59d001-6ba1-4e77-8808-d6e78d9d7c21","Type":"ContainerStarted","Data":"7643c582496e52f3aa2d49fbbf97d75b6d420f8e8728fb22bc138318573f2af5"}
Jul 22 13:47:33.605219 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:33.605201    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:47:33.608696 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:33.608669    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhzsv" event={"ID":"b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6","Type":"ContainerStarted","Data":"c9d7cbdf56e3fc3d83953e7b61b88dabc54ce7a9f21fd4117cb26169b3d4915a"}
Jul 22 13:47:33.612917 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:33.612836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8" event={"ID":"68564876-f77f-4b47-92af-050530115d65","Type":"ContainerStarted","Data":"f99de6d5768e0f2f8db59eb75f21ad2a25bb06d9f02755861e3e2dfd1ce55938"}
Jul 22 13:47:33.615406 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:33.615043    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p4pzr" podStartSLOduration=16.66802338 podStartE2EDuration="33.615025144s" totalImagesPullingTime="16.947001764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:47:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:33.613367182 +0000 UTC m=+77.855462171" watchObservedRunningTime="2026-07-22 13:47:33.615025144 +0000 UTC m=+77.857120110"
Jul 22 13:47:33.617368 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:33.617301    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xfm7k" event={"ID":"de6d3f3c-6c8c-400b-b511-7078e838b585","Type":"ContainerStarted","Data":"7f5ed61e3c3c549543c184cf0d4f46578af312ed300aa4b5eaa28e16e4cd240f"}
Jul 22 13:47:33.631075 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:33.630540    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lhzsv" podStartSLOduration=65.734467323 podStartE2EDuration="1m16.630521658s" totalImagesPullingTime="10.896054335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:33.629164372 +0000 UTC m=+77.871259336" watchObservedRunningTime="2026-07-22 13:47:33.630521658 +0000 UTC m=+77.872616625"
Jul 22 13:47:33.647203 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:33.647086    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b89f7c768-7ndq8" podStartSLOduration=1.349552997 podStartE2EDuration="12.647066864s" totalImagesPullingTime="11.297513867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:33.647022297 +0000 UTC m=+77.889117263" watchObservedRunningTime="2026-07-22 13:47:33.647066864 +0000 UTC m=+77.889161828"
Jul 22 13:47:33.666788 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:33.666744    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hl66n" podStartSLOduration=66.868681179 podStartE2EDuration="1m17.666730619s" totalImagesPullingTime="10.79804944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:33.665339701 +0000 UTC m=+77.907434665" watchObservedRunningTime="2026-07-22 13:47:33.666730619 +0000 UTC m=+77.908825615"
Jul 22 13:47:34.625638 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:34.625604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq" event={"ID":"57394ff7-71f2-4556-aa80-b6cb540e9130","Type":"ContainerStarted","Data":"c36c72a7fd62ab13606e2c92e6096c56f4fb4e77b9394e977fc1f0c33833d396"}
Jul 22 13:47:34.626051 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:34.625652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq" event={"ID":"57394ff7-71f2-4556-aa80-b6cb540e9130","Type":"ContainerStarted","Data":"d9e946c455f0f9b1c1077c244b83f688768646d6163c000d7eb8ad459772eab2"}
Jul 22 13:47:34.627278 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:34.627250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xfm7k" event={"ID":"de6d3f3c-6c8c-400b-b511-7078e838b585","Type":"ContainerStarted","Data":"d0de4602953aeba268d647dba5a2419a3b2679509fb0b16918f0934bad11cd44"}
Jul 22 13:47:34.645471 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:34.645430    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6476464c-sb4zq" podStartSLOduration=2.372431667 podStartE2EDuration="13.645418767s" totalImagesPullingTime="11.2729871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:34.645039209 +0000 UTC m=+78.887134174" watchObservedRunningTime="2026-07-22 13:47:34.645418767 +0000 UTC m=+78.887513724"
Jul 22 13:47:34.661514 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:34.661477    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xfm7k" podStartSLOduration=34.6707492 podStartE2EDuration="42.661464761s" totalImagesPullingTime="7.990715561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:34.660239091 +0000 UTC m=+78.902334054" watchObservedRunningTime="2026-07-22 13:47:34.661464761 +0000 UTC m=+78.903559723"
Jul 22 13:47:35.631033 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:35.630990    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:47:42.043887 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:42.043433    2578 patch_prober.go:28] interesting pod/image-registry-7cd6498b6-dmctp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 22 13:47:42.043887 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:42.043780    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7cd6498b6-dmctp" podUID="bb1c2ab7-041c-4455-8212-d83a3fbde80c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 13:47:43.544302 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:43.544274    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cd6498b6-dmctp"
Jul 22 13:47:45.635911 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:45.635881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xfm7k"
Jul 22 13:47:54.894307 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:54.894272    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4m69c"]
Jul 22 13:47:55.001314 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.001285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.004085 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.004059    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 13:47:55.004263 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.004200    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 13:47:55.004590 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.004558    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 13:47:55.004710 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.004598    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 13:47:55.004710 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.004571    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 13:47:55.005108 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.005090    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 13:47:55.005326 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.005312    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cmg6q\""
Jul 22 13:47:55.106273 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.106171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.106273 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.106214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.106273 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.106239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg52m\" (UniqueName: \"kubernetes.io/projected/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-kube-api-access-xg52m\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.106273 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.106264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-textfile\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.106537 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.106289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-root\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.106537 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.106323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-sys\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.106537 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.106345    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-metrics-client-ca\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.106537 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.106405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-tls\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.106537 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.106427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-wtmp\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.207603 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.207574    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.207739 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.207614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.207739 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.207642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg52m\" (UniqueName: \"kubernetes.io/projected/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-kube-api-access-xg52m\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.207739 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.207665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-textfile\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.207739 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.207689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-root\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.207739 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.207716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-sys\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.207739 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.207739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-metrics-client-ca\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.207954 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.207784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-tls\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.207954 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.207806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-wtmp\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.208015 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.207992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-wtmp\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.208237 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.208217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-accelerators-collector-config\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.208299 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.208286    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-sys\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.208525 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.208511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-textfile\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.208572 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.208559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-root\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.208652 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:55.208639    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 13:47:55.208874 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:47:55.208693    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-tls podName:3ce9363a-82d2-46ca-a400-e74fbdbb6f32 nodeName:}" failed. No retries permitted until 2026-07-22 13:47:55.708675676 +0000 UTC m=+99.950770623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-tls") pod "node-exporter-4m69c" (UID: "3ce9363a-82d2-46ca-a400-e74fbdbb6f32") : secret "node-exporter-tls" not found
Jul 22 13:47:55.208874 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.208709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-metrics-client-ca\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.211019 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.211000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.220012 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.219989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg52m\" (UniqueName: \"kubernetes.io/projected/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-kube-api-access-xg52m\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.711984 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.711953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-tls\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.714347 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.714330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ce9363a-82d2-46ca-a400-e74fbdbb6f32-node-exporter-tls\") pod \"node-exporter-4m69c\" (UID: \"3ce9363a-82d2-46ca-a400-e74fbdbb6f32\") " pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.912991 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:55.912958    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4m69c"
Jul 22 13:47:55.981741 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:47:55.981719    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce9363a_82d2_46ca_a400_e74fbdbb6f32.slice/crio-5fc34dfc4c1b37ab74c3ee252cec86d46b3301cbd34045565d7b3712037522a1 WatchSource:0}: Error finding container 5fc34dfc4c1b37ab74c3ee252cec86d46b3301cbd34045565d7b3712037522a1: Status 404 returned error can't find the container with id 5fc34dfc4c1b37ab74c3ee252cec86d46b3301cbd34045565d7b3712037522a1
Jul 22 13:47:56.700035 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:56.699994    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m69c" event={"ID":"3ce9363a-82d2-46ca-a400-e74fbdbb6f32","Type":"ContainerStarted","Data":"5fc34dfc4c1b37ab74c3ee252cec86d46b3301cbd34045565d7b3712037522a1"}
Jul 22 13:47:57.704821 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:57.704787    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m69c" event={"ID":"3ce9363a-82d2-46ca-a400-e74fbdbb6f32","Type":"ContainerStarted","Data":"6e4ba775b6e8d6bb8c3374301250b15ef1b4c6c980d8e2890822780867fff590"}
Jul 22 13:47:58.709539 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:58.709511    2578 generic.go:356] "Generic (PLEG): container finished" podID="3ce9363a-82d2-46ca-a400-e74fbdbb6f32" containerID="6e4ba775b6e8d6bb8c3374301250b15ef1b4c6c980d8e2890822780867fff590" exitCode=0
Jul 22 13:47:58.709918 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:58.709550    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m69c" event={"ID":"3ce9363a-82d2-46ca-a400-e74fbdbb6f32","Type":"ContainerDied","Data":"6e4ba775b6e8d6bb8c3374301250b15ef1b4c6c980d8e2890822780867fff590"}
Jul 22 13:47:59.715618 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:59.715580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m69c" event={"ID":"3ce9363a-82d2-46ca-a400-e74fbdbb6f32","Type":"ContainerStarted","Data":"0c762e80c7d21027f5856d53760bdca42a58b1888d1578b23a04539faf02b0f7"}
Jul 22 13:47:59.716072 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:59.715634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4m69c" event={"ID":"3ce9363a-82d2-46ca-a400-e74fbdbb6f32","Type":"ContainerStarted","Data":"3100b98cd21e9ff1bea5e0abc28b4a93cb51481782c1ad0ace76c03e35f83e48"}
Jul 22 13:47:59.742474 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:47:59.742425    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4m69c" podStartSLOduration=4.090390897 podStartE2EDuration="5.74240984s" totalImagesPullingTime="1.569179365s" totalInitContainerRuntime="82.839578ms" isStatefulPod=true podCreationTimestamp="2026-07-22 13:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:47:59.741176665 +0000 UTC m=+103.983271632" watchObservedRunningTime="2026-07-22 13:47:59.74240984 +0000 UTC m=+103.984504803"
Jul 22 13:48:04.630019 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:48:04.629987    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hl66n"
Jul 22 13:48:11.468603 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:48:11.468573    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gl2jr_be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c/serve-healthcheck-canary/0.log"
Jul 22 13:51:16.153345 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:51:16.153312    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 13:51:16.157773 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:51:16.157752    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 13:51:16.159846 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:51:16.159828    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 13:52:14.572234 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.572162    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"]
Jul 22 13:52:14.574425 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.574408    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.577492 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.577461    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 13:52:14.577633 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.577503    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n778k\""
Jul 22 13:52:14.577633 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.577521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 13:52:14.577633 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.577547    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 13:52:14.577860 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.577820    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 13:52:14.598242 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.598223    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"]
Jul 22 13:52:14.707367 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.707344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b13809ff-28f4-4758-9c08-9410140094a3-webhook-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.707476 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.707388    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b13809ff-28f4-4758-9c08-9410140094a3-manifests\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.707476 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.707410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b13809ff-28f4-4758-9c08-9410140094a3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.707476 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.707447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b13809ff-28f4-4758-9c08-9410140094a3-tmp\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.707476 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.707467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckj2q\" (UniqueName: \"kubernetes.io/projected/b13809ff-28f4-4758-9c08-9410140094a3-kube-api-access-ckj2q\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.808147 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.808111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b13809ff-28f4-4758-9c08-9410140094a3-manifests\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.808248 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.808162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b13809ff-28f4-4758-9c08-9410140094a3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.808248 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.808190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b13809ff-28f4-4758-9c08-9410140094a3-tmp\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.808248 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.808208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckj2q\" (UniqueName: \"kubernetes.io/projected/b13809ff-28f4-4758-9c08-9410140094a3-kube-api-access-ckj2q\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.808248 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.808230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b13809ff-28f4-4758-9c08-9410140094a3-webhook-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.808554 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.808515    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b13809ff-28f4-4758-9c08-9410140094a3-manifests\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.810605 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.810582    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b13809ff-28f4-4758-9c08-9410140094a3-tmp\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.810699 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.810624    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b13809ff-28f4-4758-9c08-9410140094a3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.810807 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.810727    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b13809ff-28f4-4758-9c08-9410140094a3-webhook-cert\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.816426 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.816391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckj2q\" (UniqueName: \"kubernetes.io/projected/b13809ff-28f4-4758-9c08-9410140094a3-kube-api-access-ckj2q\") pod \"opendatahub-operator-controller-manager-65657c6f45-24g6c\" (UID: \"b13809ff-28f4-4758-9c08-9410140094a3\") " pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:14.884279 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:14.884225    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:15.015092 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:15.015066    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"]
Jul 22 13:52:15.016933 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:52:15.016904    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13809ff_28f4_4758_9c08_9410140094a3.slice/crio-1e184f87609d76ec67ccfc75c7d7a62788791c80e96af9f53672f7ca2338142f WatchSource:0}: Error finding container 1e184f87609d76ec67ccfc75c7d7a62788791c80e96af9f53672f7ca2338142f: Status 404 returned error can't find the container with id 1e184f87609d76ec67ccfc75c7d7a62788791c80e96af9f53672f7ca2338142f
Jul 22 13:52:15.018679 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:15.018662    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 13:52:15.499631 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:15.499601    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c" event={"ID":"b13809ff-28f4-4758-9c08-9410140094a3","Type":"ContainerStarted","Data":"1e184f87609d76ec67ccfc75c7d7a62788791c80e96af9f53672f7ca2338142f"}
Jul 22 13:52:18.512223 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:18.512182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c" event={"ID":"b13809ff-28f4-4758-9c08-9410140094a3","Type":"ContainerStarted","Data":"d7026c81c6710d4c9fb87d1ae9fef49caad9c1296018c7807bc29778e19383d1"}
Jul 22 13:52:19.516954 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:19.516925    2578 generic.go:356] "Generic (PLEG): container finished" podID="b13809ff-28f4-4758-9c08-9410140094a3" containerID="d7026c81c6710d4c9fb87d1ae9fef49caad9c1296018c7807bc29778e19383d1" exitCode=0
Jul 22 13:52:19.517333 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:19.516993    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c" event={"ID":"b13809ff-28f4-4758-9c08-9410140094a3","Type":"ContainerDied","Data":"d7026c81c6710d4c9fb87d1ae9fef49caad9c1296018c7807bc29778e19383d1"}
Jul 22 13:52:20.522930 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:20.522895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c" event={"ID":"b13809ff-28f4-4758-9c08-9410140094a3","Type":"ContainerStarted","Data":"c4a5466f0115c03b606875e6dcbc167678f1ef668adfec0575c60aa812bfe10d"}
Jul 22 13:52:20.523302 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:20.522987    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:20.547823 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:20.547766    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c" podStartSLOduration=2.436756963 podStartE2EDuration="6.547750634s" totalImagesPullingTime="3.14198399s" totalInitContainerRuntime="969.009681ms" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:20.546450166 +0000 UTC m=+364.788545129" watchObservedRunningTime="2026-07-22 13:52:20.547750634 +0000 UTC m=+364.789845598"
Jul 22 13:52:31.528478 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:31.528445    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65657c6f45-24g6c"
Jul 22 13:52:34.090097 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.090065    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hbtbr"]
Jul 22 13:52:34.100532 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.100507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr"
Jul 22 13:52:34.102673 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.102648    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hbtbr"]
Jul 22 13:52:34.102823 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.102801    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4cdcn\""
Jul 22 13:52:34.102947 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.102730    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 22 13:52:34.240634 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.240599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcd4m\" (UniqueName: \"kubernetes.io/projected/b58d1e15-745d-4b8e-b2ab-a146faa236db-kube-api-access-wcd4m\") pod \"odh-model-controller-7998c67dc4-hbtbr\" (UID: \"b58d1e15-745d-4b8e-b2ab-a146faa236db\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr"
Jul 22 13:52:34.240819 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.240669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58d1e15-745d-4b8e-b2ab-a146faa236db-cert\") pod \"odh-model-controller-7998c67dc4-hbtbr\" (UID: \"b58d1e15-745d-4b8e-b2ab-a146faa236db\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr"
Jul 22 13:52:34.341670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.341571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58d1e15-745d-4b8e-b2ab-a146faa236db-cert\") pod \"odh-model-controller-7998c67dc4-hbtbr\" (UID: \"b58d1e15-745d-4b8e-b2ab-a146faa236db\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr"
Jul 22 13:52:34.341670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.341665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcd4m\" (UniqueName: \"kubernetes.io/projected/b58d1e15-745d-4b8e-b2ab-a146faa236db-kube-api-access-wcd4m\") pod \"odh-model-controller-7998c67dc4-hbtbr\" (UID: \"b58d1e15-745d-4b8e-b2ab-a146faa236db\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr"
Jul 22 13:52:34.341905 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:52:34.341725    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 22 13:52:34.341905 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:52:34.341785    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58d1e15-745d-4b8e-b2ab-a146faa236db-cert podName:b58d1e15-745d-4b8e-b2ab-a146faa236db nodeName:}" failed. No retries permitted until 2026-07-22 13:52:34.841767707 +0000 UTC m=+379.083862649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b58d1e15-745d-4b8e-b2ab-a146faa236db-cert") pod "odh-model-controller-7998c67dc4-hbtbr" (UID: "b58d1e15-745d-4b8e-b2ab-a146faa236db") : secret "odh-model-controller-webhook-cert" not found
Jul 22 13:52:34.353418 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.353378    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcd4m\" (UniqueName: \"kubernetes.io/projected/b58d1e15-745d-4b8e-b2ab-a146faa236db-kube-api-access-wcd4m\") pod \"odh-model-controller-7998c67dc4-hbtbr\" (UID: \"b58d1e15-745d-4b8e-b2ab-a146faa236db\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr"
Jul 22 13:52:34.709080 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.709013    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bzv47"]
Jul 22 13:52:34.711433 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.711418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bzv47"
Jul 22 13:52:34.716233 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.716211    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 22 13:52:34.723221 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.723199    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bzv47"]
Jul 22 13:52:34.845158 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.845096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxf88\" (UniqueName: \"kubernetes.io/projected/ea680b58-c815-4c08-abb7-a3111862c3b5-kube-api-access-mxf88\") pod \"model-serving-api-54d89bd5fc-bzv47\" (UID: \"ea680b58-c815-4c08-abb7-a3111862c3b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-bzv47"
Jul 22 13:52:34.845158 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.845156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea680b58-c815-4c08-abb7-a3111862c3b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-bzv47\" (UID: \"ea680b58-c815-4c08-abb7-a3111862c3b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-bzv47"
Jul 22 13:52:34.845376 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.845201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58d1e15-745d-4b8e-b2ab-a146faa236db-cert\") pod \"odh-model-controller-7998c67dc4-hbtbr\" (UID: \"b58d1e15-745d-4b8e-b2ab-a146faa236db\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr"
Jul 22 13:52:34.847821 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.847782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58d1e15-745d-4b8e-b2ab-a146faa236db-cert\") pod \"odh-model-controller-7998c67dc4-hbtbr\" (UID: \"b58d1e15-745d-4b8e-b2ab-a146faa236db\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr"
Jul 22 13:52:34.946380 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.946341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxf88\" (UniqueName: \"kubernetes.io/projected/ea680b58-c815-4c08-abb7-a3111862c3b5-kube-api-access-mxf88\") pod \"model-serving-api-54d89bd5fc-bzv47\" (UID: \"ea680b58-c815-4c08-abb7-a3111862c3b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-bzv47"
Jul 22 13:52:34.946567 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.946385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea680b58-c815-4c08-abb7-a3111862c3b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-bzv47\" (UID: \"ea680b58-c815-4c08-abb7-a3111862c3b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-bzv47"
Jul 22 13:52:34.946567 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:52:34.946509    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 22 13:52:34.946684 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:52:34.946587    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea680b58-c815-4c08-abb7-a3111862c3b5-tls-certs podName:ea680b58-c815-4c08-abb7-a3111862c3b5 nodeName:}" failed. No retries permitted until 2026-07-22 13:52:35.446565169 +0000 UTC m=+379.688660129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ea680b58-c815-4c08-abb7-a3111862c3b5-tls-certs") pod "model-serving-api-54d89bd5fc-bzv47" (UID: "ea680b58-c815-4c08-abb7-a3111862c3b5") : secret "model-serving-api-tls" not found
Jul 22 13:52:34.956444 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:34.956411    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxf88\" (UniqueName: \"kubernetes.io/projected/ea680b58-c815-4c08-abb7-a3111862c3b5-kube-api-access-mxf88\") pod \"model-serving-api-54d89bd5fc-bzv47\" (UID: \"ea680b58-c815-4c08-abb7-a3111862c3b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-bzv47"
Jul 22 13:52:35.013813 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:35.013734    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr"
Jul 22 13:52:35.138355 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:35.138317    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hbtbr"]
Jul 22 13:52:35.141634 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:52:35.141605    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58d1e15_745d_4b8e_b2ab_a146faa236db.slice/crio-5c24dc7aadc568fdde395ef672d4400039f9034c09f6bccb2531bb4b8a8f80ec WatchSource:0}: Error finding container 5c24dc7aadc568fdde395ef672d4400039f9034c09f6bccb2531bb4b8a8f80ec: Status 404 returned error can't find the container with id 5c24dc7aadc568fdde395ef672d4400039f9034c09f6bccb2531bb4b8a8f80ec
Jul 22 13:52:35.450296 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:35.450257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea680b58-c815-4c08-abb7-a3111862c3b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-bzv47\" (UID: \"ea680b58-c815-4c08-abb7-a3111862c3b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-bzv47"
Jul 22 13:52:35.452690 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:35.452658    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea680b58-c815-4c08-abb7-a3111862c3b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-bzv47\" (UID: \"ea680b58-c815-4c08-abb7-a3111862c3b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-bzv47"
Jul 22 13:52:35.571177 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:35.571143    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr" event={"ID":"b58d1e15-745d-4b8e-b2ab-a146faa236db","Type":"ContainerStarted","Data":"5c24dc7aadc568fdde395ef672d4400039f9034c09f6bccb2531bb4b8a8f80ec"}
Jul 22 13:52:35.622148 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:35.622102    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bzv47"
Jul 22 13:52:35.753162 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:35.753058    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bzv47"]
Jul 22 13:52:36.576781 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:36.576748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bzv47" event={"ID":"ea680b58-c815-4c08-abb7-a3111862c3b5","Type":"ContainerStarted","Data":"ed8a8d3e3da5bf060e4d880bd6161c714dda20fefafb078de30308bc36f1a725"}
Jul 22 13:52:38.586489 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:38.586455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr" event={"ID":"b58d1e15-745d-4b8e-b2ab-a146faa236db","Type":"ContainerStarted","Data":"c68b767d5d208763886724aa753bf07693000df0d0f961adfeacd84a4b892d2b"}
Jul 22 13:52:38.586901 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:38.586619    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr"
Jul 22 13:52:38.605836 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:38.605735    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr" podStartSLOduration=2.032686345 podStartE2EDuration="4.605713488s" totalImagesPullingTime="2.573027143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:38.604758444 +0000 UTC m=+382.846853435" watchObservedRunningTime="2026-07-22 13:52:38.605713488 +0000 UTC m=+382.847808452"
Jul 22 13:52:39.591332 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:39.591290    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bzv47" event={"ID":"ea680b58-c815-4c08-abb7-a3111862c3b5","Type":"ContainerStarted","Data":"fb25a86729208fbf583e03525c72656ed6ba960a6e6bb8f778e8e5c29ef2737b"}
Jul 22 13:52:39.591715 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:39.591528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-bzv47"
Jul 22 13:52:39.608488 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:39.608443    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-bzv47" podStartSLOduration=2.5450141410000002 podStartE2EDuration="5.608429329s" totalImagesPullingTime="3.063415188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:39.607000429 +0000 UTC m=+383.849095395" watchObservedRunningTime="2026-07-22 13:52:39.608429329 +0000 UTC m=+383.850524293"
Jul 22 13:52:43.899288 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:43.899259    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ps925"]
Jul 22 13:52:43.902086 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:43.902070    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925"
Jul 22 13:52:43.904689 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:43.904668    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hrhwh\""
Jul 22 13:52:43.905430 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:43.905399    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 22 13:52:43.913152 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:43.913114    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ps925"]
Jul 22 13:52:43.919813 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:43.919784    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"]
Jul 22 13:52:43.923095 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:43.923080    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"
Jul 22 13:52:43.926283 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:43.926217    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-s98j4\""
Jul 22 13:52:43.926283 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:43.926225    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 22 13:52:43.937054 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:43.936983    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"]
Jul 22 13:52:44.024030 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.024002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvn4x\" (UniqueName: \"kubernetes.io/projected/ae658cde-f494-4fb8-87db-85c3339f572e-kube-api-access-nvn4x\") pod \"llmisvc-controller-manager-777c6bd7d5-j445x\" (UID: \"ae658cde-f494-4fb8-87db-85c3339f572e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"
Jul 22 13:52:44.024236 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.024054    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65300060-834d-49fd-8de5-dc49e640cd36-cert\") pod \"kserve-controller-manager-d6f4b65b8-ps925\" (UID: \"65300060-834d-49fd-8de5-dc49e640cd36\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925"
Jul 22 13:52:44.024236 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.024164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae658cde-f494-4fb8-87db-85c3339f572e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j445x\" (UID: \"ae658cde-f494-4fb8-87db-85c3339f572e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"
Jul 22 13:52:44.024236 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.024229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk77v\" (UniqueName: \"kubernetes.io/projected/65300060-834d-49fd-8de5-dc49e640cd36-kube-api-access-nk77v\") pod \"kserve-controller-manager-d6f4b65b8-ps925\" (UID: \"65300060-834d-49fd-8de5-dc49e640cd36\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925"
Jul 22 13:52:44.125582 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.125547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk77v\" (UniqueName: \"kubernetes.io/projected/65300060-834d-49fd-8de5-dc49e640cd36-kube-api-access-nk77v\") pod \"kserve-controller-manager-d6f4b65b8-ps925\" (UID: \"65300060-834d-49fd-8de5-dc49e640cd36\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925"
Jul 22 13:52:44.125708 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.125610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvn4x\" (UniqueName: \"kubernetes.io/projected/ae658cde-f494-4fb8-87db-85c3339f572e-kube-api-access-nvn4x\") pod \"llmisvc-controller-manager-777c6bd7d5-j445x\" (UID: \"ae658cde-f494-4fb8-87db-85c3339f572e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"
Jul 22 13:52:44.125708 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.125647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65300060-834d-49fd-8de5-dc49e640cd36-cert\") pod \"kserve-controller-manager-d6f4b65b8-ps925\" (UID: \"65300060-834d-49fd-8de5-dc49e640cd36\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925"
Jul 22 13:52:44.125708 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.125682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae658cde-f494-4fb8-87db-85c3339f572e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j445x\" (UID: \"ae658cde-f494-4fb8-87db-85c3339f572e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"
Jul 22 13:52:44.125863 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:52:44.125774    2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 22 13:52:44.125863 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:52:44.125779    2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 22 13:52:44.125863 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:52:44.125835    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae658cde-f494-4fb8-87db-85c3339f572e-cert podName:ae658cde-f494-4fb8-87db-85c3339f572e nodeName:}" failed. No retries permitted until 2026-07-22 13:52:44.625814418 +0000 UTC m=+388.867909366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ae658cde-f494-4fb8-87db-85c3339f572e-cert") pod "llmisvc-controller-manager-777c6bd7d5-j445x" (UID: "ae658cde-f494-4fb8-87db-85c3339f572e") : secret "llmisvc-webhook-server-cert" not found
Jul 22 13:52:44.125863 ip-10-0-131-79 kubenswrapper[2578]: E0722 13:52:44.125851    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65300060-834d-49fd-8de5-dc49e640cd36-cert podName:65300060-834d-49fd-8de5-dc49e640cd36 nodeName:}" failed. No retries permitted until 2026-07-22 13:52:44.625842601 +0000 UTC m=+388.867937549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/65300060-834d-49fd-8de5-dc49e640cd36-cert") pod "kserve-controller-manager-d6f4b65b8-ps925" (UID: "65300060-834d-49fd-8de5-dc49e640cd36") : secret "kserve-webhook-server-cert" not found
Jul 22 13:52:44.136822 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.136788    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvn4x\" (UniqueName: \"kubernetes.io/projected/ae658cde-f494-4fb8-87db-85c3339f572e-kube-api-access-nvn4x\") pod \"llmisvc-controller-manager-777c6bd7d5-j445x\" (UID: \"ae658cde-f494-4fb8-87db-85c3339f572e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"
Jul 22 13:52:44.138832 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.138810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk77v\" (UniqueName: \"kubernetes.io/projected/65300060-834d-49fd-8de5-dc49e640cd36-kube-api-access-nk77v\") pod \"kserve-controller-manager-d6f4b65b8-ps925\" (UID: \"65300060-834d-49fd-8de5-dc49e640cd36\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925"
Jul 22 13:52:44.436172 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.436125    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"]
Jul 22 13:52:44.439378 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.439355    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"
Jul 22 13:52:44.441677 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.441656    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 13:52:44.441802 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.441661    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 13:52:44.442004 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.441990    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 13:52:44.442078 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.442007    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2qglk\""
Jul 22 13:52:44.442078 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.441994    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 13:52:44.449002 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.448982    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"]
Jul 22 13:52:44.628945 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.628919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe65266c-2a0d-4684-9304-0b94d5363ed3-tls-certs\") pod \"kube-auth-proxy-6cd5b47b7c-nnkb2\" (UID: \"fe65266c-2a0d-4684-9304-0b94d5363ed3\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"
Jul 22 13:52:44.629082 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.628954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe65266c-2a0d-4684-9304-0b94d5363ed3-tmp\") pod \"kube-auth-proxy-6cd5b47b7c-nnkb2\" (UID: \"fe65266c-2a0d-4684-9304-0b94d5363ed3\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"
Jul 22 13:52:44.629082 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.629027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65300060-834d-49fd-8de5-dc49e640cd36-cert\") pod \"kserve-controller-manager-d6f4b65b8-ps925\" (UID: \"65300060-834d-49fd-8de5-dc49e640cd36\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925"
Jul 22 13:52:44.629224 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.629094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5dff\" (UniqueName: \"kubernetes.io/projected/fe65266c-2a0d-4684-9304-0b94d5363ed3-kube-api-access-w5dff\") pod \"kube-auth-proxy-6cd5b47b7c-nnkb2\" (UID: \"fe65266c-2a0d-4684-9304-0b94d5363ed3\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"
Jul 22 13:52:44.629224 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.629147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae658cde-f494-4fb8-87db-85c3339f572e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j445x\" (UID: \"ae658cde-f494-4fb8-87db-85c3339f572e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"
Jul 22 13:52:44.631426 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.631404    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65300060-834d-49fd-8de5-dc49e640cd36-cert\") pod \"kserve-controller-manager-d6f4b65b8-ps925\" (UID: \"65300060-834d-49fd-8de5-dc49e640cd36\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925"
Jul 22 13:52:44.631426 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.631418    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae658cde-f494-4fb8-87db-85c3339f572e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j445x\" (UID: \"ae658cde-f494-4fb8-87db-85c3339f572e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"
Jul 22 13:52:44.729668 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.729618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dff\" (UniqueName: \"kubernetes.io/projected/fe65266c-2a0d-4684-9304-0b94d5363ed3-kube-api-access-w5dff\") pod \"kube-auth-proxy-6cd5b47b7c-nnkb2\" (UID: \"fe65266c-2a0d-4684-9304-0b94d5363ed3\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"
Jul 22 13:52:44.729668 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.729665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe65266c-2a0d-4684-9304-0b94d5363ed3-tls-certs\") pod \"kube-auth-proxy-6cd5b47b7c-nnkb2\" (UID: \"fe65266c-2a0d-4684-9304-0b94d5363ed3\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"
Jul 22 13:52:44.729803 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.729684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe65266c-2a0d-4684-9304-0b94d5363ed3-tmp\") pod \"kube-auth-proxy-6cd5b47b7c-nnkb2\" (UID: \"fe65266c-2a0d-4684-9304-0b94d5363ed3\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"
Jul 22 13:52:44.731704 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.731682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe65266c-2a0d-4684-9304-0b94d5363ed3-tmp\") pod \"kube-auth-proxy-6cd5b47b7c-nnkb2\" (UID: \"fe65266c-2a0d-4684-9304-0b94d5363ed3\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"
Jul 22 13:52:44.731880 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.731866    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe65266c-2a0d-4684-9304-0b94d5363ed3-tls-certs\") pod \"kube-auth-proxy-6cd5b47b7c-nnkb2\" (UID: \"fe65266c-2a0d-4684-9304-0b94d5363ed3\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"
Jul 22 13:52:44.739740 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.739719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5dff\" (UniqueName: \"kubernetes.io/projected/fe65266c-2a0d-4684-9304-0b94d5363ed3-kube-api-access-w5dff\") pod \"kube-auth-proxy-6cd5b47b7c-nnkb2\" (UID: \"fe65266c-2a0d-4684-9304-0b94d5363ed3\") " pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"
Jul 22 13:52:44.749555 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.749536    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"
Jul 22 13:52:44.813294 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.813259    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925"
Jul 22 13:52:44.835694 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.835669    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"
Jul 22 13:52:44.885509 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.883974    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2"]
Jul 22 13:52:44.887499 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:52:44.887122    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe65266c_2a0d_4684_9304_0b94d5363ed3.slice/crio-8859b67615f4f611401ac2fa9141bb49ff9d0523c206e47c5931ced944e40bb9 WatchSource:0}: Error finding container 8859b67615f4f611401ac2fa9141bb49ff9d0523c206e47c5931ced944e40bb9: Status 404 returned error can't find the container with id 8859b67615f4f611401ac2fa9141bb49ff9d0523c206e47c5931ced944e40bb9
Jul 22 13:52:44.971880 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.971853    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ps925"]
Jul 22 13:52:44.974101 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:52:44.974078    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65300060_834d_49fd_8de5_dc49e640cd36.slice/crio-7c4c779b57b55a47c485d66326124349f4524584e2a161c4de6c42c14673c6df WatchSource:0}: Error finding container 7c4c779b57b55a47c485d66326124349f4524584e2a161c4de6c42c14673c6df: Status 404 returned error can't find the container with id 7c4c779b57b55a47c485d66326124349f4524584e2a161c4de6c42c14673c6df
Jul 22 13:52:44.980699 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:44.980585    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"]
Jul 22 13:52:44.982893 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:52:44.982869    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podae658cde_f494_4fb8_87db_85c3339f572e.slice/crio-de7750295459873274f2e99010ce3896d5b83a4287abf28ba3b1880094304cf1 WatchSource:0}: Error finding container de7750295459873274f2e99010ce3896d5b83a4287abf28ba3b1880094304cf1: Status 404 returned error can't find the container with id de7750295459873274f2e99010ce3896d5b83a4287abf28ba3b1880094304cf1
Jul 22 13:52:45.611906 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:45.611872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2" event={"ID":"fe65266c-2a0d-4684-9304-0b94d5363ed3","Type":"ContainerStarted","Data":"8859b67615f4f611401ac2fa9141bb49ff9d0523c206e47c5931ced944e40bb9"}
Jul 22 13:52:45.613022 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:45.613004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x" event={"ID":"ae658cde-f494-4fb8-87db-85c3339f572e","Type":"ContainerStarted","Data":"de7750295459873274f2e99010ce3896d5b83a4287abf28ba3b1880094304cf1"}
Jul 22 13:52:45.614038 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:45.614020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925" event={"ID":"65300060-834d-49fd-8de5-dc49e640cd36","Type":"ContainerStarted","Data":"7c4c779b57b55a47c485d66326124349f4524584e2a161c4de6c42c14673c6df"}
Jul 22 13:52:46.198751 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.197997    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"]
Jul 22 13:52:46.202188 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.202162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.205297 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.204930    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 22 13:52:46.205297 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.204959    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 13:52:46.205297 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.205255    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 22 13:52:46.205557 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.205314    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 22 13:52:46.205557 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.205347    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rkjwb\""
Jul 22 13:52:46.217773 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.215823    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"]
Jul 22 13:52:46.244710 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.244683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3737d350-7f2b-461c-bc39-2b9320dd4f20-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.244931 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.244904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.245070 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.244947    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.245070 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.244977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpdz8\" (UniqueName: \"kubernetes.io/projected/3737d350-7f2b-461c-bc39-2b9320dd4f20-kube-api-access-lpdz8\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.245070 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.245027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3737d350-7f2b-461c-bc39-2b9320dd4f20-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.245265 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.245081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.245265 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.245110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.345807 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.345769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3737d350-7f2b-461c-bc39-2b9320dd4f20-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.345807 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.345813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.346030 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.345837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.346030 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.345870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpdz8\" (UniqueName: \"kubernetes.io/projected/3737d350-7f2b-461c-bc39-2b9320dd4f20-kube-api-access-lpdz8\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.346030 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.345896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3737d350-7f2b-461c-bc39-2b9320dd4f20-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.346030 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.345949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.346030 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.345975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.346721 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.346603    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.349007 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.348984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3737d350-7f2b-461c-bc39-2b9320dd4f20-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.349223 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.349198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.349368 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.349344    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3737d350-7f2b-461c-bc39-2b9320dd4f20-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.349859 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.349819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.355705 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.355681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpdz8\" (UniqueName: \"kubernetes.io/projected/3737d350-7f2b-461c-bc39-2b9320dd4f20-kube-api-access-lpdz8\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.355883 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.355855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3737d350-7f2b-461c-bc39-2b9320dd4f20-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-q9vrm\" (UID: \"3737d350-7f2b-461c-bc39-2b9320dd4f20\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.519637 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.519556    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:46.737983 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:46.737946    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"]
Jul 22 13:52:46.743558 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:52:46.743526    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3737d350_7f2b_461c_bc39_2b9320dd4f20.slice/crio-66f01698bf9bb92c0a428a2c13e7394b94e90559a54128186310799e16ec86d1 WatchSource:0}: Error finding container 66f01698bf9bb92c0a428a2c13e7394b94e90559a54128186310799e16ec86d1: Status 404 returned error can't find the container with id 66f01698bf9bb92c0a428a2c13e7394b94e90559a54128186310799e16ec86d1
Jul 22 13:52:47.624958 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:47.624915    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm" event={"ID":"3737d350-7f2b-461c-bc39-2b9320dd4f20","Type":"ContainerStarted","Data":"66f01698bf9bb92c0a428a2c13e7394b94e90559a54128186310799e16ec86d1"}
Jul 22 13:52:49.593987 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:49.593959    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hbtbr"
Jul 22 13:52:49.646795 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:49.646756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2" event={"ID":"fe65266c-2a0d-4684-9304-0b94d5363ed3","Type":"ContainerStarted","Data":"0df71590fedbb12c74f9b4f7fee2f71092bf6bd981848b2b6243ef2a453b911b"}
Jul 22 13:52:49.649402 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:49.649359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x" event={"ID":"ae658cde-f494-4fb8-87db-85c3339f572e","Type":"ContainerStarted","Data":"806d5f8c0f1a519df19c47dd3497652dc98f2426906403169bb0c479cbbed1a8"}
Jul 22 13:52:49.649670 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:49.649628    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"
Jul 22 13:52:49.651387 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:49.651363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925" event={"ID":"65300060-834d-49fd-8de5-dc49e640cd36","Type":"ContainerStarted","Data":"e211ae056f99b4d85988a94699cb8b0d8624ccc2f485c3e47bbd1de7ecd57cb9"}
Jul 22 13:52:49.651514 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:49.651498    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925"
Jul 22 13:52:49.663210 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:49.663159    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6cd5b47b7c-nnkb2" podStartSLOduration=1.927574728 podStartE2EDuration="5.663114165s" totalImagesPullingTime="3.735539437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:49.66279255 +0000 UTC m=+393.904887515" watchObservedRunningTime="2026-07-22 13:52:49.663114165 +0000 UTC m=+393.905209130"
Jul 22 13:52:49.683631 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:49.682805    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925" podStartSLOduration=3.03148198 podStartE2EDuration="6.682786473s" totalImagesPullingTime="3.651304493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:49.681618608 +0000 UTC m=+393.923713572" watchObservedRunningTime="2026-07-22 13:52:49.682786473 +0000 UTC m=+393.924881438"
Jul 22 13:52:49.698249 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:49.698196    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x" podStartSLOduration=3.050471939 podStartE2EDuration="6.6981746s" totalImagesPullingTime="3.647702661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:49.696962941 +0000 UTC m=+393.939057903" watchObservedRunningTime="2026-07-22 13:52:49.6981746 +0000 UTC m=+393.940269565"
Jul 22 13:52:50.482857 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:50.482816    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 13:52:50.482929 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:50.482882    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 13:52:50.599462 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:50.599437    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-bzv47"
Jul 22 13:52:50.657626 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:50.657553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm" event={"ID":"3737d350-7f2b-461c-bc39-2b9320dd4f20","Type":"ContainerStarted","Data":"4ce26f5ede3012dd2143b17591891f7862842d8ef21eabe58d5285f50903bb2c"}
Jul 22 13:52:50.679234 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:50.679186    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm" podStartSLOduration=0.943543072 podStartE2EDuration="4.679171354s" totalImagesPullingTime="3.735628282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:52:50.678387056 +0000 UTC m=+394.920482020" watchObservedRunningTime="2026-07-22 13:52:50.679171354 +0000 UTC m=+394.921266318"
Jul 22 13:52:51.661776 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:51.661748    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:52:51.663248 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:51.663215    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-q9vrm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 13:52:51.663386 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:51.663294    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm" podUID="3737d350-7f2b-461c-bc39-2b9320dd4f20" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 13:52:52.665755 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:52:52.665731    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-q9vrm"
Jul 22 13:53:20.659722 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:53:20.659689    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j445x"
Jul 22 13:53:20.662457 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:53:20.662437    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ps925"
Jul 22 13:54:15.359156 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.359107    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj"]
Jul 22 13:54:15.361304 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.361287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj"
Jul 22 13:54:15.364968 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.364944    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 13:54:15.365103 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.365049    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-62r7n\""
Jul 22 13:54:15.365294 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.365278    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 13:54:15.387581 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.387562    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj"]
Jul 22 13:54:15.479744 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.479715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsv2l\" (UniqueName: \"kubernetes.io/projected/df8b4bf0-39a6-4a39-a184-bc08bd7d8d9a-kube-api-access-fsv2l\") pod \"authorino-operator-75cc8d5cb7-f9dfj\" (UID: \"df8b4bf0-39a6-4a39-a184-bc08bd7d8d9a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj"
Jul 22 13:54:15.580203 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.580176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsv2l\" (UniqueName: \"kubernetes.io/projected/df8b4bf0-39a6-4a39-a184-bc08bd7d8d9a-kube-api-access-fsv2l\") pod \"authorino-operator-75cc8d5cb7-f9dfj\" (UID: \"df8b4bf0-39a6-4a39-a184-bc08bd7d8d9a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj"
Jul 22 13:54:15.593216 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.593193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsv2l\" (UniqueName: \"kubernetes.io/projected/df8b4bf0-39a6-4a39-a184-bc08bd7d8d9a-kube-api-access-fsv2l\") pod \"authorino-operator-75cc8d5cb7-f9dfj\" (UID: \"df8b4bf0-39a6-4a39-a184-bc08bd7d8d9a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj"
Jul 22 13:54:15.671550 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.671486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj"
Jul 22 13:54:15.804998 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.804959    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj"]
Jul 22 13:54:15.807158 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:54:15.807114    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8b4bf0_39a6_4a39_a184_bc08bd7d8d9a.slice/crio-66e2457d262ae85e3eceae124064c716c86f92d5a98c2b1b18b73f6bf32e732f WatchSource:0}: Error finding container 66e2457d262ae85e3eceae124064c716c86f92d5a98c2b1b18b73f6bf32e732f: Status 404 returned error can't find the container with id 66e2457d262ae85e3eceae124064c716c86f92d5a98c2b1b18b73f6bf32e732f
Jul 22 13:54:15.982377 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:15.982296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj" event={"ID":"df8b4bf0-39a6-4a39-a184-bc08bd7d8d9a","Type":"ContainerStarted","Data":"66e2457d262ae85e3eceae124064c716c86f92d5a98c2b1b18b73f6bf32e732f"}
Jul 22 13:54:17.991966 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:17.991930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj" event={"ID":"df8b4bf0-39a6-4a39-a184-bc08bd7d8d9a","Type":"ContainerStarted","Data":"6fe611c2d2740ec1aad036d31c755b0836b0a9ea44d55c93aef21ed943e9c651"}
Jul 22 13:54:17.992322 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:17.992018    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj"
Jul 22 13:54:18.011388 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:18.011208    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj" podStartSLOduration=0.969218296 podStartE2EDuration="3.011189087s" totalImagesPullingTime="2.041970791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:54:18.010595094 +0000 UTC m=+482.252690087" watchObservedRunningTime="2026-07-22 13:54:18.011189087 +0000 UTC m=+482.253284050"
Jul 22 13:54:28.999232 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:28.999200    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f9dfj"
Jul 22 13:54:30.961033 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:30.961001    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"]
Jul 22 13:54:30.964864 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:30.964825    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 13:54:30.967854 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:30.967830    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hcrqc\""
Jul 22 13:54:30.981968 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:30.981950    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"]
Jul 22 13:54:30.992380 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:30.992355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1baf88e4-584d-42c3-98cc-4a12887a5b17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ml8bd\" (UID: \"1baf88e4-584d-42c3-98cc-4a12887a5b17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 13:54:30.992486 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:30.992400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrkj6\" (UniqueName: \"kubernetes.io/projected/1baf88e4-584d-42c3-98cc-4a12887a5b17-kube-api-access-lrkj6\") pod \"kuadrant-operator-controller-manager-86878c769f-ml8bd\" (UID: \"1baf88e4-584d-42c3-98cc-4a12887a5b17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 13:54:31.092878 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:31.092846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrkj6\" (UniqueName: \"kubernetes.io/projected/1baf88e4-584d-42c3-98cc-4a12887a5b17-kube-api-access-lrkj6\") pod \"kuadrant-operator-controller-manager-86878c769f-ml8bd\" (UID: \"1baf88e4-584d-42c3-98cc-4a12887a5b17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 13:54:31.093020 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:31.092900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1baf88e4-584d-42c3-98cc-4a12887a5b17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ml8bd\" (UID: \"1baf88e4-584d-42c3-98cc-4a12887a5b17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 13:54:31.093235 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:31.093220    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1baf88e4-584d-42c3-98cc-4a12887a5b17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ml8bd\" (UID: \"1baf88e4-584d-42c3-98cc-4a12887a5b17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 13:54:31.110652 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:31.110627    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrkj6\" (UniqueName: \"kubernetes.io/projected/1baf88e4-584d-42c3-98cc-4a12887a5b17-kube-api-access-lrkj6\") pod \"kuadrant-operator-controller-manager-86878c769f-ml8bd\" (UID: \"1baf88e4-584d-42c3-98cc-4a12887a5b17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 13:54:31.273936 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:31.273910    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 13:54:31.404152 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:31.404112    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"]
Jul 22 13:54:31.406311 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:54:31.406274    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1baf88e4_584d_42c3_98cc_4a12887a5b17.slice/crio-4916b165341251107935102d086e2259c98a4e38fbbea65e4f2b6dc1560c3048 WatchSource:0}: Error finding container 4916b165341251107935102d086e2259c98a4e38fbbea65e4f2b6dc1560c3048: Status 404 returned error can't find the container with id 4916b165341251107935102d086e2259c98a4e38fbbea65e4f2b6dc1560c3048
Jul 22 13:54:32.048102 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:32.048062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd" event={"ID":"1baf88e4-584d-42c3-98cc-4a12887a5b17","Type":"ContainerStarted","Data":"4916b165341251107935102d086e2259c98a4e38fbbea65e4f2b6dc1560c3048"}
Jul 22 13:54:37.070608 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:37.070574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd" event={"ID":"1baf88e4-584d-42c3-98cc-4a12887a5b17","Type":"ContainerStarted","Data":"8a16a07300fdba5c280063254027ec80ba2b637047bb47a53a37893ab2aa9e73"}
Jul 22 13:54:37.071027 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:37.070714    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 13:54:37.094841 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:37.094789    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd" podStartSLOduration=2.125257595 podStartE2EDuration="7.094774052s" totalImagesPullingTime="4.969516457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:54:37.093865742 +0000 UTC m=+501.335960731" watchObservedRunningTime="2026-07-22 13:54:37.094774052 +0000 UTC m=+501.336869017"
Jul 22 13:54:48.076950 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:54:48.076920    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 13:56:16.177739 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:16.177707    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 13:56:16.179313 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:16.179285    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 13:56:54.258754 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.258719    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"]
Jul 22 13:56:54.261268 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.261246    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.263375 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.263356    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s6zft\""
Jul 22 13:56:54.263720 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.263703    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 13:56:54.264238 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.264211    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 13:56:54.264238 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.264237    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 22 13:56:54.279012 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.278981    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"]
Jul 22 13:56:54.335207 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.335180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.335335 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.335216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.335335 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.335236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrzqf\" (UniqueName: \"kubernetes.io/projected/f3dd58c5-60b2-4e78-a41a-c01509c22e98-kube-api-access-nrzqf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.335335 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.335300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.335335 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.335324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3dd58c5-60b2-4e78-a41a-c01509c22e98-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.335486 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.335381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.436739 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.436711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.436739 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.436742    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.436933 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.436758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrzqf\" (UniqueName: \"kubernetes.io/projected/f3dd58c5-60b2-4e78-a41a-c01509c22e98-kube-api-access-nrzqf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.436933 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.436805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.436933 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.436842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3dd58c5-60b2-4e78-a41a-c01509c22e98-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.436933 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.436883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.437254 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.437211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.437254 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.437229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.437570 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.437262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.438793 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.438775    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3dd58c5-60b2-4e78-a41a-c01509c22e98-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.439209 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.439186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3dd58c5-60b2-4e78-a41a-c01509c22e98-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.445802 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.445771    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrzqf\" (UniqueName: \"kubernetes.io/projected/f3dd58c5-60b2-4e78-a41a-c01509c22e98-kube-api-access-nrzqf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pwpht\" (UID: \"f3dd58c5-60b2-4e78-a41a-c01509c22e98\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.571236 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.571196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:56:54.700628 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:54.700604    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"]
Jul 22 13:56:54.704049 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:56:54.704021    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3dd58c5_60b2_4e78_a41a_c01509c22e98.slice/crio-febac8a5ffa14789e61b6d76b859eb9bbdc068dc8f11eafb64ba60ec0ccd910f WatchSource:0}: Error finding container febac8a5ffa14789e61b6d76b859eb9bbdc068dc8f11eafb64ba60ec0ccd910f: Status 404 returned error can't find the container with id febac8a5ffa14789e61b6d76b859eb9bbdc068dc8f11eafb64ba60ec0ccd910f
Jul 22 13:56:55.618546 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:55.618508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht" event={"ID":"f3dd58c5-60b2-4e78-a41a-c01509c22e98","Type":"ContainerStarted","Data":"febac8a5ffa14789e61b6d76b859eb9bbdc068dc8f11eafb64ba60ec0ccd910f"}
Jul 22 13:56:56.623928 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:56:56.623884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht" event={"ID":"f3dd58c5-60b2-4e78-a41a-c01509c22e98","Type":"ContainerStarted","Data":"b161eb6d0841b3120bb776319181164af5e0a2afab47c98c68d4ddf9e6cde5f4"}
Jul 22 13:57:04.572219 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:04.572188    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:57:04.572568 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:04.572444    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:57:04.584529 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:04.584501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:57:04.604918 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:04.604869    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht" podStartSLOduration=8.763249093 podStartE2EDuration="10.604850388s" totalImagesPullingTime="1.841601295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:56:56.641962253 +0000 UTC m=+640.884057229" watchObservedRunningTime="2026-07-22 13:57:04.604850388 +0000 UTC m=+648.846945353"
Jul 22 13:57:04.667899 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:04.667873    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pwpht"
Jul 22 13:57:10.676264 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.676229    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"]
Jul 22 13:57:10.679592 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.679573    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.682028 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.682006    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 22 13:57:10.694356 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.694333    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"]
Jul 22 13:57:10.861882 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.861844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.862042 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.861889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.862042 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.861915    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htvmp\" (UniqueName: \"kubernetes.io/projected/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-kube-api-access-htvmp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.862042 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.861974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.862042 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.861997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.862253 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.862078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.962769 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.962703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htvmp\" (UniqueName: \"kubernetes.io/projected/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-kube-api-access-htvmp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.962769 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.962752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.962959 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.962778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.962959 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.962803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.962959 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.962826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.962959 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.962850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.963257 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.963225    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.963257 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.963239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.963404 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.963323    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.965197 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.965178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.965474 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.965454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.972080 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.972056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htvmp\" (UniqueName: \"kubernetes.io/projected/b4b789f9-7ed1-493f-ad0e-668a6f0a7268-kube-api-access-htvmp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-l2tzm\" (UID: \"b4b789f9-7ed1-493f-ad0e-668a6f0a7268\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:10.990784 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:10.990762    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:11.122486 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:11.122457    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"]
Jul 22 13:57:11.124126 ip-10-0-131-79 kubenswrapper[2578]: W0722 13:57:11.124086    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b789f9_7ed1_493f_ad0e_668a6f0a7268.slice/crio-d669a617f9f1168b1cf420cae0b598e4bc670907096aa32e0b04f9e796f9c1de WatchSource:0}: Error finding container d669a617f9f1168b1cf420cae0b598e4bc670907096aa32e0b04f9e796f9c1de: Status 404 returned error can't find the container with id d669a617f9f1168b1cf420cae0b598e4bc670907096aa32e0b04f9e796f9c1de
Jul 22 13:57:11.685051 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:11.685014    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm" event={"ID":"b4b789f9-7ed1-493f-ad0e-668a6f0a7268","Type":"ContainerStarted","Data":"d669a617f9f1168b1cf420cae0b598e4bc670907096aa32e0b04f9e796f9c1de"}
Jul 22 13:57:12.690583 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:12.690545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm" event={"ID":"b4b789f9-7ed1-493f-ad0e-668a6f0a7268","Type":"ContainerStarted","Data":"5e78edbbd7895bb1787ed896b0c0ff073d556ca9203cd0988b316bef00863102"}
Jul 22 13:57:12.710360 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:12.710311    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm" podStartSLOduration=2.04798147 podStartE2EDuration="2.7102933s" totalImagesPullingTime="662.31183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:57:12.708801861 +0000 UTC m=+656.950896840" watchObservedRunningTime="2026-07-22 13:57:12.7102933 +0000 UTC m=+656.952388263"
Jul 22 13:57:20.991736 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:20.991702    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:20.992158 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:20.991758    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:21.005469 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:21.005441    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 13:57:21.737535 ip-10-0-131-79 kubenswrapper[2578]: I0722 13:57:21.737506    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-l2tzm"
Jul 22 14:00:00.147112 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:00.147076    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w"]
Jul 22 14:00:00.150332 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:00.150314    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w"
Jul 22 14:00:00.152503 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:00.152483    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:00:00.157690 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:00.157298    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w"]
Jul 22 14:00:00.161241 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:00.161216    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w"
Jul 22 14:00:00.305204 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:00.305030    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w"]
Jul 22 14:00:00.308403 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:00:00.308364    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9a488d_3994_4e86_aa33_5984cdf75498.slice/crio-f7560d264496ff9b204aad176f8e8969681c4ff16561f3ea2965dae5e989dc0e WatchSource:0}: Error finding container f7560d264496ff9b204aad176f8e8969681c4ff16561f3ea2965dae5e989dc0e: Status 404 returned error can't find the container with id f7560d264496ff9b204aad176f8e8969681c4ff16561f3ea2965dae5e989dc0e
Jul 22 14:00:00.310395 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:00.310379    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 14:00:00.397008 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:00.396975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w" event={"ID":"fa9a488d-3994-4e86-aa33-5984cdf75498","Type":"ContainerStarted","Data":"f7560d264496ff9b204aad176f8e8969681c4ff16561f3ea2965dae5e989dc0e"}
Jul 22 14:00:03.413345 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:03.413308    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w" event={"ID":"fa9a488d-3994-4e86-aa33-5984cdf75498","Type":"ContainerStarted","Data":"2f8dd7fe7ee6c12940781daeaf7b22ad64b0b62889f1233b67f1aa35525dfa03"}
Jul 22 14:00:03.432300 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:03.432242    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w" podStartSLOduration=0.799854715 podStartE2EDuration="3.432224582s" totalImagesPullingTime="2.632369867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:00:03.430678378 +0000 UTC m=+827.672773352" watchObservedRunningTime="2026-07-22 14:00:03.432224582 +0000 UTC m=+827.674319599"
Jul 22 14:00:04.419463 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:04.419432    2578 generic.go:356] "Generic (PLEG): container finished" podID="fa9a488d-3994-4e86-aa33-5984cdf75498" containerID="2f8dd7fe7ee6c12940781daeaf7b22ad64b0b62889f1233b67f1aa35525dfa03" exitCode=0
Jul 22 14:00:04.419837 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:04.419510    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w" event={"ID":"fa9a488d-3994-4e86-aa33-5984cdf75498","Type":"ContainerDied","Data":"2f8dd7fe7ee6c12940781daeaf7b22ad64b0b62889f1233b67f1aa35525dfa03"}
Jul 22 14:00:05.549826 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:05.549801    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w"
Jul 22 14:00:06.429501 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:06.429467    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w" event={"ID":"fa9a488d-3994-4e86-aa33-5984cdf75498","Type":"ContainerDied","Data":"f7560d264496ff9b204aad176f8e8969681c4ff16561f3ea2965dae5e989dc0e"}
Jul 22 14:00:06.429501 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:06.429493    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745480-ds66w"
Jul 22 14:00:06.429697 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:06.429517    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7560d264496ff9b204aad176f8e8969681c4ff16561f3ea2965dae5e989dc0e"
Jul 22 14:00:40.749662 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.749623    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-8s4ts"]
Jul 22 14:00:40.750244 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.750166    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9a488d-3994-4e86-aa33-5984cdf75498" containerName="cleanup"
Jul 22 14:00:40.750244 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.750186    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9a488d-3994-4e86-aa33-5984cdf75498" containerName="cleanup"
Jul 22 14:00:40.750374 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.750262    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa9a488d-3994-4e86-aa33-5984cdf75498" containerName="cleanup"
Jul 22 14:00:40.753467 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.753443    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:00:40.756396 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.756379    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 14:00:40.756493 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.756380    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 14:00:40.756493 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.756386    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h2x5c\""
Jul 22 14:00:40.764759 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.764738    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-8s4ts"]
Jul 22 14:00:40.821453 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.821431    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4xbj\" (UniqueName: \"kubernetes.io/projected/39556569-d654-4f45-8ae2-80108045c643-kube-api-access-v4xbj\") pod \"maas-controller-7fdc48c68d-8s4ts\" (UID: \"39556569-d654-4f45-8ae2-80108045c643\") " pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:00:40.821542 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.821464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39556569-d654-4f45-8ae2-80108045c643-webhook-cert\") pod \"maas-controller-7fdc48c68d-8s4ts\" (UID: \"39556569-d654-4f45-8ae2-80108045c643\") " pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:00:40.921863 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.921840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4xbj\" (UniqueName: \"kubernetes.io/projected/39556569-d654-4f45-8ae2-80108045c643-kube-api-access-v4xbj\") pod \"maas-controller-7fdc48c68d-8s4ts\" (UID: \"39556569-d654-4f45-8ae2-80108045c643\") " pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:00:40.921948 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.921874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39556569-d654-4f45-8ae2-80108045c643-webhook-cert\") pod \"maas-controller-7fdc48c68d-8s4ts\" (UID: \"39556569-d654-4f45-8ae2-80108045c643\") " pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:00:40.924235 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.924212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39556569-d654-4f45-8ae2-80108045c643-webhook-cert\") pod \"maas-controller-7fdc48c68d-8s4ts\" (UID: \"39556569-d654-4f45-8ae2-80108045c643\") " pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:00:40.930776 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:40.930759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4xbj\" (UniqueName: \"kubernetes.io/projected/39556569-d654-4f45-8ae2-80108045c643-kube-api-access-v4xbj\") pod \"maas-controller-7fdc48c68d-8s4ts\" (UID: \"39556569-d654-4f45-8ae2-80108045c643\") " pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:00:41.063242 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:41.063223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:00:41.189586 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:41.189563    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-8s4ts"]
Jul 22 14:00:41.191028 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:00:41.191006    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39556569_d654_4f45_8ae2_80108045c643.slice/crio-1aa8e96acb07f7a785532d83f1fa655a8ea3f97422ef13409706627c3be2e549 WatchSource:0}: Error finding container 1aa8e96acb07f7a785532d83f1fa655a8ea3f97422ef13409706627c3be2e549: Status 404 returned error can't find the container with id 1aa8e96acb07f7a785532d83f1fa655a8ea3f97422ef13409706627c3be2e549
Jul 22 14:00:41.591672 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:41.591642    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts" event={"ID":"39556569-d654-4f45-8ae2-80108045c643","Type":"ContainerStarted","Data":"1aa8e96acb07f7a785532d83f1fa655a8ea3f97422ef13409706627c3be2e549"}
Jul 22 14:00:44.609455 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:44.609419    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts" event={"ID":"39556569-d654-4f45-8ae2-80108045c643","Type":"ContainerStarted","Data":"8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98"}
Jul 22 14:00:44.609845 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:44.609516    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:00:44.626619 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:44.626288    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts" podStartSLOduration=2.275110906 podStartE2EDuration="4.626269975s" totalImagesPullingTime="2.351159069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:00:44.625787349 +0000 UTC m=+868.867882310" watchObservedRunningTime="2026-07-22 14:00:44.626269975 +0000 UTC m=+868.868364941"
Jul 22 14:00:55.617051 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:00:55.617022    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:01:00.243826 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.243791    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-8s4ts"]
Jul 22 14:01:00.244239 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.243964    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts" podUID="39556569-d654-4f45-8ae2-80108045c643" containerName="manager" containerID="cri-o://8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98" gracePeriod=30
Jul 22 14:01:00.471195 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.471168    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:01:00.601785 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.601749    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39556569-d654-4f45-8ae2-80108045c643-webhook-cert\") pod \"39556569-d654-4f45-8ae2-80108045c643\" (UID: \"39556569-d654-4f45-8ae2-80108045c643\") "
Jul 22 14:01:00.601941 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.601806    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4xbj\" (UniqueName: \"kubernetes.io/projected/39556569-d654-4f45-8ae2-80108045c643-kube-api-access-v4xbj\") pod \"39556569-d654-4f45-8ae2-80108045c643\" (UID: \"39556569-d654-4f45-8ae2-80108045c643\") "
Jul 22 14:01:00.604062 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.604032    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39556569-d654-4f45-8ae2-80108045c643-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "39556569-d654-4f45-8ae2-80108045c643" (UID: "39556569-d654-4f45-8ae2-80108045c643"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:01:00.604232 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.604069    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39556569-d654-4f45-8ae2-80108045c643-kube-api-access-v4xbj" (OuterVolumeSpecName: "kube-api-access-v4xbj") pod "39556569-d654-4f45-8ae2-80108045c643" (UID: "39556569-d654-4f45-8ae2-80108045c643"). InnerVolumeSpecName "kube-api-access-v4xbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:01:00.676445 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.676416    2578 generic.go:356] "Generic (PLEG): container finished" podID="39556569-d654-4f45-8ae2-80108045c643" containerID="8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98" exitCode=0
Jul 22 14:01:00.676580 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.676466    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts"
Jul 22 14:01:00.676580 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.676495    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts" event={"ID":"39556569-d654-4f45-8ae2-80108045c643","Type":"ContainerDied","Data":"8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98"}
Jul 22 14:01:00.676580 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.676557    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fdc48c68d-8s4ts" event={"ID":"39556569-d654-4f45-8ae2-80108045c643","Type":"ContainerDied","Data":"1aa8e96acb07f7a785532d83f1fa655a8ea3f97422ef13409706627c3be2e549"}
Jul 22 14:01:00.676580 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.676579    2578 scope.go:117] "RemoveContainer" containerID="8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98"
Jul 22 14:01:00.685112 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.685092    2578 scope.go:117] "RemoveContainer" containerID="8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98"
Jul 22 14:01:00.685405 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:01:00.685385    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98\": container with ID starting with 8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98 not found: ID does not exist" containerID="8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98"
Jul 22 14:01:00.685476 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.685412    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98"} err="failed to get container status \"8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98\": rpc error: code = NotFound desc = could not find container \"8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98\": container with ID starting with 8800c2598cddb058fcfd4bec8cfaef30bc867f9f885429c5b28b80bfa9b45c98 not found: ID does not exist"
Jul 22 14:01:00.696478 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.696455    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-8s4ts"]
Jul 22 14:01:00.698660 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.698634    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-8s4ts"]
Jul 22 14:01:00.702616 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.702602    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39556569-d654-4f45-8ae2-80108045c643-webhook-cert\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:01:00.702673 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:00.702624    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4xbj\" (UniqueName: \"kubernetes.io/projected/39556569-d654-4f45-8ae2-80108045c643-kube-api-access-v4xbj\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:01:01.506311 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.506282    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-stwrm"]
Jul 22 14:01:01.506650 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.506584    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39556569-d654-4f45-8ae2-80108045c643" containerName="manager"
Jul 22 14:01:01.506650 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.506595    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="39556569-d654-4f45-8ae2-80108045c643" containerName="manager"
Jul 22 14:01:01.506650 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.506649    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="39556569-d654-4f45-8ae2-80108045c643" containerName="manager"
Jul 22 14:01:01.510833 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.510816    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fdc48c68d-stwrm"
Jul 22 14:01:01.514310 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.514282    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 14:01:01.514310 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.514296    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 14:01:01.514486 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.514323    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h2x5c\""
Jul 22 14:01:01.524654 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.524589    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-stwrm"]
Jul 22 14:01:01.610882 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.610854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbbl5\" (UniqueName: \"kubernetes.io/projected/d8abf520-dd24-45ed-a317-6f3859e34a61-kube-api-access-kbbl5\") pod \"maas-controller-7fdc48c68d-stwrm\" (UID: \"d8abf520-dd24-45ed-a317-6f3859e34a61\") " pod="opendatahub/maas-controller-7fdc48c68d-stwrm"
Jul 22 14:01:01.611021 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.610904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8abf520-dd24-45ed-a317-6f3859e34a61-webhook-cert\") pod \"maas-controller-7fdc48c68d-stwrm\" (UID: \"d8abf520-dd24-45ed-a317-6f3859e34a61\") " pod="opendatahub/maas-controller-7fdc48c68d-stwrm"
Jul 22 14:01:01.711868 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.711832    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbbl5\" (UniqueName: \"kubernetes.io/projected/d8abf520-dd24-45ed-a317-6f3859e34a61-kube-api-access-kbbl5\") pod \"maas-controller-7fdc48c68d-stwrm\" (UID: \"d8abf520-dd24-45ed-a317-6f3859e34a61\") " pod="opendatahub/maas-controller-7fdc48c68d-stwrm"
Jul 22 14:01:01.712014 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.711910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8abf520-dd24-45ed-a317-6f3859e34a61-webhook-cert\") pod \"maas-controller-7fdc48c68d-stwrm\" (UID: \"d8abf520-dd24-45ed-a317-6f3859e34a61\") " pod="opendatahub/maas-controller-7fdc48c68d-stwrm"
Jul 22 14:01:01.714390 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.714362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8abf520-dd24-45ed-a317-6f3859e34a61-webhook-cert\") pod \"maas-controller-7fdc48c68d-stwrm\" (UID: \"d8abf520-dd24-45ed-a317-6f3859e34a61\") " pod="opendatahub/maas-controller-7fdc48c68d-stwrm"
Jul 22 14:01:01.721455 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.721428    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbbl5\" (UniqueName: \"kubernetes.io/projected/d8abf520-dd24-45ed-a317-6f3859e34a61-kube-api-access-kbbl5\") pod \"maas-controller-7fdc48c68d-stwrm\" (UID: \"d8abf520-dd24-45ed-a317-6f3859e34a61\") " pod="opendatahub/maas-controller-7fdc48c68d-stwrm"
Jul 22 14:01:01.820263 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.820196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fdc48c68d-stwrm"
Jul 22 14:01:01.955902 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:01.955879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fdc48c68d-stwrm"]
Jul 22 14:01:01.958429 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:01:01.958399    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8abf520_dd24_45ed_a317_6f3859e34a61.slice/crio-3fcf4734ea79c34662333816c2c1b4d09ad83d48484401527813e879adaa4881 WatchSource:0}: Error finding container 3fcf4734ea79c34662333816c2c1b4d09ad83d48484401527813e879adaa4881: Status 404 returned error can't find the container with id 3fcf4734ea79c34662333816c2c1b4d09ad83d48484401527813e879adaa4881
Jul 22 14:01:02.254522 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:02.254446    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39556569-d654-4f45-8ae2-80108045c643" path="/var/lib/kubelet/pods/39556569-d654-4f45-8ae2-80108045c643/volumes"
Jul 22 14:01:02.687201 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:02.687154    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fdc48c68d-stwrm" event={"ID":"d8abf520-dd24-45ed-a317-6f3859e34a61","Type":"ContainerStarted","Data":"3fcf4734ea79c34662333816c2c1b4d09ad83d48484401527813e879adaa4881"}
Jul 22 14:01:04.696693 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:04.696660    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fdc48c68d-stwrm" event={"ID":"d8abf520-dd24-45ed-a317-6f3859e34a61","Type":"ContainerStarted","Data":"04ff33fa298ca5c0f69bc45c25ac8fca0fc683067f4001e357468cd97b735a7d"}
Jul 22 14:01:04.697066 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:04.696805    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fdc48c68d-stwrm"
Jul 22 14:01:04.715989 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:04.715937    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fdc48c68d-stwrm" podStartSLOduration=2.030471901 podStartE2EDuration="3.715921794s" totalImagesPullingTime="1.685449893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:01:04.713773934 +0000 UTC m=+888.955868910" watchObservedRunningTime="2026-07-22 14:01:04.715921794 +0000 UTC m=+888.958016781"
Jul 22 14:01:15.703407 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:15.703320    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fdc48c68d-stwrm"
Jul 22 14:01:16.210615 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:16.210586    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:01:16.210867 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:01:16.210825    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:05:49.200328 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:49.200232    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"]
Jul 22 14:05:49.202934 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:49.200460    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd" podUID="1baf88e4-584d-42c3-98cc-4a12887a5b17" containerName="manager" containerID="cri-o://8a16a07300fdba5c280063254027ec80ba2b637047bb47a53a37893ab2aa9e73" gracePeriod=10
Jul 22 14:05:51.936364 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:51.936336    2578 generic.go:356] "Generic (PLEG): container finished" podID="1baf88e4-584d-42c3-98cc-4a12887a5b17" containerID="8a16a07300fdba5c280063254027ec80ba2b637047bb47a53a37893ab2aa9e73" exitCode=0
Jul 22 14:05:51.936725 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:51.936408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd" event={"ID":"1baf88e4-584d-42c3-98cc-4a12887a5b17","Type":"ContainerDied","Data":"8a16a07300fdba5c280063254027ec80ba2b637047bb47a53a37893ab2aa9e73"}
Jul 22 14:05:52.150601 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.150579    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 14:05:52.206512 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.206451    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1baf88e4-584d-42c3-98cc-4a12887a5b17-extensions-socket-volume\") pod \"1baf88e4-584d-42c3-98cc-4a12887a5b17\" (UID: \"1baf88e4-584d-42c3-98cc-4a12887a5b17\") "
Jul 22 14:05:52.206512 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.206480    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrkj6\" (UniqueName: \"kubernetes.io/projected/1baf88e4-584d-42c3-98cc-4a12887a5b17-kube-api-access-lrkj6\") pod \"1baf88e4-584d-42c3-98cc-4a12887a5b17\" (UID: \"1baf88e4-584d-42c3-98cc-4a12887a5b17\") "
Jul 22 14:05:52.206772 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.206751    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1baf88e4-584d-42c3-98cc-4a12887a5b17-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1baf88e4-584d-42c3-98cc-4a12887a5b17" (UID: "1baf88e4-584d-42c3-98cc-4a12887a5b17"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 14:05:52.208740 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.208718    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1baf88e4-584d-42c3-98cc-4a12887a5b17-kube-api-access-lrkj6" (OuterVolumeSpecName: "kube-api-access-lrkj6") pod "1baf88e4-584d-42c3-98cc-4a12887a5b17" (UID: "1baf88e4-584d-42c3-98cc-4a12887a5b17"). InnerVolumeSpecName "kube-api-access-lrkj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:05:52.307074 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.307046    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1baf88e4-584d-42c3-98cc-4a12887a5b17-extensions-socket-volume\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:05:52.307074 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.307069    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrkj6\" (UniqueName: \"kubernetes.io/projected/1baf88e4-584d-42c3-98cc-4a12887a5b17-kube-api-access-lrkj6\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:05:52.943115 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.943084    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"
Jul 22 14:05:52.943549 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.943081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd" event={"ID":"1baf88e4-584d-42c3-98cc-4a12887a5b17","Type":"ContainerDied","Data":"4916b165341251107935102d086e2259c98a4e38fbbea65e4f2b6dc1560c3048"}
Jul 22 14:05:52.943549 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.943219    2578 scope.go:117] "RemoveContainer" containerID="8a16a07300fdba5c280063254027ec80ba2b637047bb47a53a37893ab2aa9e73"
Jul 22 14:05:52.961029 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.961007    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"]
Jul 22 14:05:52.962487 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:52.962466    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ml8bd"]
Jul 22 14:05:54.253009 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:05:54.252974    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1baf88e4-584d-42c3-98cc-4a12887a5b17" path="/var/lib/kubelet/pods/1baf88e4-584d-42c3-98cc-4a12887a5b17/volumes"
Jul 22 14:06:16.236970 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:16.236941    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:06:16.238434 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:16.238412    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:06:50.348887 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.348855    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"]
Jul 22 14:06:50.349365 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.349193    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1baf88e4-584d-42c3-98cc-4a12887a5b17" containerName="manager"
Jul 22 14:06:50.349365 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.349203    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1baf88e4-584d-42c3-98cc-4a12887a5b17" containerName="manager"
Jul 22 14:06:50.349365 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.349262    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1baf88e4-584d-42c3-98cc-4a12887a5b17" containerName="manager"
Jul 22 14:06:50.352099 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.352084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"
Jul 22 14:06:50.354343 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.354324    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hcrqc\""
Jul 22 14:06:50.365167 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.365119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"]
Jul 22 14:06:50.431913 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.431878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75d6v\" (UniqueName: \"kubernetes.io/projected/5eca4adb-7a50-45f4-9f36-4acea7978ed0-kube-api-access-75d6v\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2tj\" (UID: \"5eca4adb-7a50-45f4-9f36-4acea7978ed0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"
Jul 22 14:06:50.432026 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.431934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5eca4adb-7a50-45f4-9f36-4acea7978ed0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2tj\" (UID: \"5eca4adb-7a50-45f4-9f36-4acea7978ed0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"
Jul 22 14:06:50.532633 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.532604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75d6v\" (UniqueName: \"kubernetes.io/projected/5eca4adb-7a50-45f4-9f36-4acea7978ed0-kube-api-access-75d6v\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2tj\" (UID: \"5eca4adb-7a50-45f4-9f36-4acea7978ed0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"
Jul 22 14:06:50.532728 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.532647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5eca4adb-7a50-45f4-9f36-4acea7978ed0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2tj\" (UID: \"5eca4adb-7a50-45f4-9f36-4acea7978ed0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"
Jul 22 14:06:50.532991 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.532974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5eca4adb-7a50-45f4-9f36-4acea7978ed0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2tj\" (UID: \"5eca4adb-7a50-45f4-9f36-4acea7978ed0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"
Jul 22 14:06:50.543609 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.543584    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75d6v\" (UniqueName: \"kubernetes.io/projected/5eca4adb-7a50-45f4-9f36-4acea7978ed0-kube-api-access-75d6v\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2tj\" (UID: \"5eca4adb-7a50-45f4-9f36-4acea7978ed0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"
Jul 22 14:06:50.661453 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.661391    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"
Jul 22 14:06:50.800036 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:50.800014    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"]
Jul 22 14:06:50.802190 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:06:50.802164    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eca4adb_7a50_45f4_9f36_4acea7978ed0.slice/crio-748e59675b4a5bbabe7c19eeb500281e7863bf26f5fabda1017d009807e6d2db WatchSource:0}: Error finding container 748e59675b4a5bbabe7c19eeb500281e7863bf26f5fabda1017d009807e6d2db: Status 404 returned error can't find the container with id 748e59675b4a5bbabe7c19eeb500281e7863bf26f5fabda1017d009807e6d2db
Jul 22 14:06:51.202279 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:51.202241    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj" event={"ID":"5eca4adb-7a50-45f4-9f36-4acea7978ed0","Type":"ContainerStarted","Data":"76aa532012781e3cf61dddd295267b23b6802866aee88d791dbd6945e347d10b"}
Jul 22 14:06:51.202616 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:51.202305    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj" event={"ID":"5eca4adb-7a50-45f4-9f36-4acea7978ed0","Type":"ContainerStarted","Data":"748e59675b4a5bbabe7c19eeb500281e7863bf26f5fabda1017d009807e6d2db"}
Jul 22 14:06:51.202616 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:51.202386    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"
Jul 22 14:06:51.229383 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:06:51.229333    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj" podStartSLOduration=1.229314585 podStartE2EDuration="1.229314585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:06:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:06:51.226958446 +0000 UTC m=+1235.469053411" watchObservedRunningTime="2026-07-22 14:06:51.229314585 +0000 UTC m=+1235.471409550"
Jul 22 14:07:02.209455 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:07:02.209425    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2tj"
Jul 22 14:11:16.262873 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:11:16.262848    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:11:16.265075 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:11:16.265055    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:14:21.558511 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:21.558470    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"]
Jul 22 14:14:21.561609 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:21.561588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"
Jul 22 14:14:21.563620 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:21.563601    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:14:21.563850 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:21.563833    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 14:14:21.569994 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:21.569675    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"]
Jul 22 14:14:21.597262 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:21.597239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ca9c7a-5275-4c7d-9d5b-562229bff9b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6\" (UID: \"76ca9c7a-5275-4c7d-9d5b-562229bff9b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"
Jul 22 14:14:21.697898 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:21.697874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ca9c7a-5275-4c7d-9d5b-562229bff9b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6\" (UID: \"76ca9c7a-5275-4c7d-9d5b-562229bff9b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"
Jul 22 14:14:21.698495 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:21.698475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ca9c7a-5275-4c7d-9d5b-562229bff9b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6\" (UID: \"76ca9c7a-5275-4c7d-9d5b-562229bff9b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"
Jul 22 14:14:21.874356 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:21.874290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"
Jul 22 14:14:22.005431 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:22.005400    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"]
Jul 22 14:14:22.008661 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:14:22.008628    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ca9c7a_5275_4c7d_9d5b_562229bff9b9.slice/crio-ba790661f38d3e5f0c7395e28f3626fea047acd9f5ca1f1afc54d675dd3f7fc1 WatchSource:0}: Error finding container ba790661f38d3e5f0c7395e28f3626fea047acd9f5ca1f1afc54d675dd3f7fc1: Status 404 returned error can't find the container with id ba790661f38d3e5f0c7395e28f3626fea047acd9f5ca1f1afc54d675dd3f7fc1
Jul 22 14:14:22.138538 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:22.138482    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6" event={"ID":"76ca9c7a-5275-4c7d-9d5b-562229bff9b9","Type":"ContainerStarted","Data":"ba790661f38d3e5f0c7395e28f3626fea047acd9f5ca1f1afc54d675dd3f7fc1"}
Jul 22 14:14:23.144891 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:23.144857    2578 generic.go:356] "Generic (PLEG): container finished" podID="76ca9c7a-5275-4c7d-9d5b-562229bff9b9" containerID="d971da00ed4ef54331e0db58096b73ca74599e41b17f1160f16c57188d8afa9f" exitCode=0
Jul 22 14:14:23.145288 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:23.144913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6" event={"ID":"76ca9c7a-5275-4c7d-9d5b-562229bff9b9","Type":"ContainerDied","Data":"d971da00ed4ef54331e0db58096b73ca74599e41b17f1160f16c57188d8afa9f"}
Jul 22 14:14:24.280072 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:24.280047    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"
Jul 22 14:14:24.319427 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:24.319403    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ca9c7a-5275-4c7d-9d5b-562229bff9b9-maas-api-service-ca\") pod \"76ca9c7a-5275-4c7d-9d5b-562229bff9b9\" (UID: \"76ca9c7a-5275-4c7d-9d5b-562229bff9b9\") "
Jul 22 14:14:24.319720 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:24.319699    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76ca9c7a-5275-4c7d-9d5b-562229bff9b9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "76ca9c7a-5275-4c7d-9d5b-562229bff9b9" (UID: "76ca9c7a-5275-4c7d-9d5b-562229bff9b9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:14:24.420911 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:24.420851    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ca9c7a-5275-4c7d-9d5b-562229bff9b9-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:14:25.153770 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:25.153740    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"
Jul 22 14:14:25.153770 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:25.153759    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6" event={"ID":"76ca9c7a-5275-4c7d-9d5b-562229bff9b9","Type":"ContainerDied","Data":"ba790661f38d3e5f0c7395e28f3626fea047acd9f5ca1f1afc54d675dd3f7fc1"}
Jul 22 14:14:25.153965 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:25.153801    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba790661f38d3e5f0c7395e28f3626fea047acd9f5ca1f1afc54d675dd3f7fc1"
Jul 22 14:14:36.650376 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:36.650344    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"]
Jul 22 14:14:36.655508 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:36.655485    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4c2bb423-zvqr6"]
Jul 22 14:14:38.252962 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:38.252932    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76ca9c7a-5275-4c7d-9d5b-562229bff9b9" path="/var/lib/kubelet/pods/76ca9c7a-5275-4c7d-9d5b-562229bff9b9/volumes"
Jul 22 14:14:40.559116 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.559085    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"]
Jul 22 14:14:40.559554 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.559511    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ca9c7a-5275-4c7d-9d5b-562229bff9b9" containerName="revoke-keys"
Jul 22 14:14:40.559554 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.559529    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ca9c7a-5275-4c7d-9d5b-562229bff9b9" containerName="revoke-keys"
Jul 22 14:14:40.559629 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.559615    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ca9c7a-5275-4c7d-9d5b-562229bff9b9" containerName="revoke-keys"
Jul 22 14:14:40.563102 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.563078    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:40.565518 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.565496    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-592a7c5a-serving-cert\""
Jul 22 14:14:40.565628 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.565498    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 14:14:40.565628 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.565506    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 14:14:40.566215 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.566199    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tpv8w\""
Jul 22 14:14:40.572758 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.572735    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"]
Jul 22 14:14:40.651608 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.651576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwbmr\" (UniqueName: \"kubernetes.io/projected/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-kube-api-access-bwbmr\") pod \"maas-api-e2e-migrate-592a7c5a-794789b576-848jv\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:40.651780 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.651667    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-openshift-service-ca\") pod \"maas-api-e2e-migrate-592a7c5a-794789b576-848jv\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:40.651780 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.651707    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-maas-api-tls\") pod \"maas-api-e2e-migrate-592a7c5a-794789b576-848jv\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:40.752895 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.752866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-openshift-service-ca\") pod \"maas-api-e2e-migrate-592a7c5a-794789b576-848jv\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:40.753033 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.752900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-maas-api-tls\") pod \"maas-api-e2e-migrate-592a7c5a-794789b576-848jv\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:40.753033 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.752951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwbmr\" (UniqueName: \"kubernetes.io/projected/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-kube-api-access-bwbmr\") pod \"maas-api-e2e-migrate-592a7c5a-794789b576-848jv\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:40.753583 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.753565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-openshift-service-ca\") pod \"maas-api-e2e-migrate-592a7c5a-794789b576-848jv\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:40.755743 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.755723    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-maas-api-tls\") pod \"maas-api-e2e-migrate-592a7c5a-794789b576-848jv\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:40.762152 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.762106    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwbmr\" (UniqueName: \"kubernetes.io/projected/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-kube-api-access-bwbmr\") pod \"maas-api-e2e-migrate-592a7c5a-794789b576-848jv\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:40.876303 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:40.876239    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:41.016045 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:41.015857    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"]
Jul 22 14:14:41.018215 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:14:41.018187    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7a82fc_d4f7_48e8_b21a_cff16e8fdccc.slice/crio-50455b4c1158e0d3b16e5bbe9c2d3f49aa4a06619b3caf7a6375e90e26de2f78 WatchSource:0}: Error finding container 50455b4c1158e0d3b16e5bbe9c2d3f49aa4a06619b3caf7a6375e90e26de2f78: Status 404 returned error can't find the container with id 50455b4c1158e0d3b16e5bbe9c2d3f49aa4a06619b3caf7a6375e90e26de2f78
Jul 22 14:14:41.019546 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:41.019526    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 14:14:41.223841 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:41.223756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv" event={"ID":"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc","Type":"ContainerStarted","Data":"50455b4c1158e0d3b16e5bbe9c2d3f49aa4a06619b3caf7a6375e90e26de2f78"}
Jul 22 14:14:43.233543 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:43.233509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv" event={"ID":"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc","Type":"ContainerStarted","Data":"8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584"}
Jul 22 14:14:43.233932 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:43.233633    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:14:43.268707 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:43.268662    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv" podStartSLOduration=1.7758095329999999 podStartE2EDuration="3.26864891s" totalImagesPullingTime="1.492839377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:14:43.267070509 +0000 UTC m=+1707.509165475" watchObservedRunningTime="2026-07-22 14:14:43.26864891 +0000 UTC m=+1707.510743876"
Jul 22 14:14:49.244746 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:14:49.244716    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:15:00.130992 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:00.130944    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64"]
Jul 22 14:15:00.134286 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:00.134264    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz"]
Jul 22 14:15:00.134411 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:00.134395    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64"
Jul 22 14:15:00.136701 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:00.136679    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:15:00.137331 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:00.137314    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz"
Jul 22 14:15:00.144815 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:00.144794    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz"]
Jul 22 14:15:00.146588 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:00.146564    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64"]
Jul 22 14:15:00.148145 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:00.148113    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64"
Jul 22 14:15:00.153363 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:00.153344    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz"
Jul 22 14:15:00.501031 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:00.501000    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz"]
Jul 22 14:15:00.503765 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:15:00.503733    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329cb59d_8cf9_4f24_a522_bffbdb8a1701.slice/crio-9c1c30d569c979e29f128d692e22731e970d2f12ccdbef26b1d3477af80e2dec WatchSource:0}: Error finding container 9c1c30d569c979e29f128d692e22731e970d2f12ccdbef26b1d3477af80e2dec: Status 404 returned error can't find the container with id 9c1c30d569c979e29f128d692e22731e970d2f12ccdbef26b1d3477af80e2dec
Jul 22 14:15:00.520018 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:00.519999    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64"]
Jul 22 14:15:00.523202 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:15:00.523171    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750b7f5f_e33a_442a_960c_235a33968feb.slice/crio-97617fc918f7cb139df0843861ca1ba16ec584276ec03f2d5825a3d94dacf4dd WatchSource:0}: Error finding container 97617fc918f7cb139df0843861ca1ba16ec584276ec03f2d5825a3d94dacf4dd: Status 404 returned error can't find the container with id 97617fc918f7cb139df0843861ca1ba16ec584276ec03f2d5825a3d94dacf4dd
Jul 22 14:15:01.308698 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:01.308661    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz" event={"ID":"329cb59d-8cf9-4f24-a522-bffbdb8a1701","Type":"ContainerStarted","Data":"4cf58cee408a82d53cf9417ee3e645ba534d457740dac26585e7608422478676"}
Jul 22 14:15:01.309152 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:01.308769    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz" event={"ID":"329cb59d-8cf9-4f24-a522-bffbdb8a1701","Type":"ContainerStarted","Data":"9c1c30d569c979e29f128d692e22731e970d2f12ccdbef26b1d3477af80e2dec"}
Jul 22 14:15:01.310388 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:01.310357    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64" event={"ID":"750b7f5f-e33a-442a-960c-235a33968feb","Type":"ContainerStarted","Data":"be3221cbc06ba08d698198b910c2b15416bae0fb1e9adb152029dea3a52e9ed5"}
Jul 22 14:15:01.310523 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:01.310416    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64" event={"ID":"750b7f5f-e33a-442a-960c-235a33968feb","Type":"ContainerStarted","Data":"97617fc918f7cb139df0843861ca1ba16ec584276ec03f2d5825a3d94dacf4dd"}
Jul 22 14:15:01.324648 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:01.324594    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz" podStartSLOduration=1.324573818 podStartE2EDuration="1.324573818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:15:01.323311655 +0000 UTC m=+1725.565406623" watchObservedRunningTime="2026-07-22 14:15:01.324573818 +0000 UTC m=+1725.566668784"
Jul 22 14:15:01.338513 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:01.338466    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64" podStartSLOduration=1.3384508880000001 podStartE2EDuration="1.338450888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:15:01.336896038 +0000 UTC m=+1725.578991020" watchObservedRunningTime="2026-07-22 14:15:01.338450888 +0000 UTC m=+1725.580545853"
Jul 22 14:15:02.316255 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:02.316221    2578 generic.go:356] "Generic (PLEG): container finished" podID="329cb59d-8cf9-4f24-a522-bffbdb8a1701" containerID="4cf58cee408a82d53cf9417ee3e645ba534d457740dac26585e7608422478676" exitCode=0
Jul 22 14:15:02.316677 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:02.316313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz" event={"ID":"329cb59d-8cf9-4f24-a522-bffbdb8a1701","Type":"ContainerDied","Data":"4cf58cee408a82d53cf9417ee3e645ba534d457740dac26585e7608422478676"}
Jul 22 14:15:02.317789 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:02.317764    2578 generic.go:356] "Generic (PLEG): container finished" podID="750b7f5f-e33a-442a-960c-235a33968feb" containerID="be3221cbc06ba08d698198b910c2b15416bae0fb1e9adb152029dea3a52e9ed5" exitCode=0
Jul 22 14:15:02.317898 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:02.317809    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64" event={"ID":"750b7f5f-e33a-442a-960c-235a33968feb","Type":"ContainerDied","Data":"be3221cbc06ba08d698198b910c2b15416bae0fb1e9adb152029dea3a52e9ed5"}
Jul 22 14:15:03.450123 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:03.450090    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64"
Jul 22 14:15:03.483741 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:03.483718    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz"
Jul 22 14:15:04.328683 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:04.328658    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64"
Jul 22 14:15:04.328817 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:04.328714    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745495-q5r64" event={"ID":"750b7f5f-e33a-442a-960c-235a33968feb","Type":"ContainerDied","Data":"97617fc918f7cb139df0843861ca1ba16ec584276ec03f2d5825a3d94dacf4dd"}
Jul 22 14:15:04.328817 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:04.328770    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97617fc918f7cb139df0843861ca1ba16ec584276ec03f2d5825a3d94dacf4dd"
Jul 22 14:15:04.330039 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:04.330011    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz"
Jul 22 14:15:04.330158 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:04.330010    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz" event={"ID":"329cb59d-8cf9-4f24-a522-bffbdb8a1701","Type":"ContainerDied","Data":"9c1c30d569c979e29f128d692e22731e970d2f12ccdbef26b1d3477af80e2dec"}
Jul 22 14:15:04.330230 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:04.330170    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c1c30d569c979e29f128d692e22731e970d2f12ccdbef26b1d3477af80e2dec"
Jul 22 14:15:05.384034 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.384005    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"]
Jul 22 14:15:05.384411 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.384372    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="750b7f5f-e33a-442a-960c-235a33968feb" containerName="cleanup"
Jul 22 14:15:05.384411 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.384387    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="750b7f5f-e33a-442a-960c-235a33968feb" containerName="cleanup"
Jul 22 14:15:05.384411 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.384397    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="329cb59d-8cf9-4f24-a522-bffbdb8a1701" containerName="cleanup"
Jul 22 14:15:05.384411 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.384403    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="329cb59d-8cf9-4f24-a522-bffbdb8a1701" containerName="cleanup"
Jul 22 14:15:05.384536 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.384454    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="329cb59d-8cf9-4f24-a522-bffbdb8a1701" containerName="cleanup"
Jul 22 14:15:05.384536 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.384465    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="750b7f5f-e33a-442a-960c-235a33968feb" containerName="cleanup"
Jul 22 14:15:05.387471 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.387451    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"
Jul 22 14:15:05.390226 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.390207    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:15:05.398907 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.398888    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"]
Jul 22 14:15:05.553773 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.553741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1a2a0bc-9a28-47f3-8945-5259d5b34a14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8\" (UID: \"c1a2a0bc-9a28-47f3-8945-5259d5b34a14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"
Jul 22 14:15:05.654454 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.654379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1a2a0bc-9a28-47f3-8945-5259d5b34a14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8\" (UID: \"c1a2a0bc-9a28-47f3-8945-5259d5b34a14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"
Jul 22 14:15:05.654993 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.654974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1a2a0bc-9a28-47f3-8945-5259d5b34a14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8\" (UID: \"c1a2a0bc-9a28-47f3-8945-5259d5b34a14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"
Jul 22 14:15:05.697204 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.697176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"
Jul 22 14:15:05.831432 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:05.831404    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"]
Jul 22 14:15:05.833509 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:15:05.833481    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a2a0bc_9a28_47f3_8945_5259d5b34a14.slice/crio-25740839ca03c7133aa8d12a727baf5ea65b6baecba7f32d5e5ef55cdd9efb73 WatchSource:0}: Error finding container 25740839ca03c7133aa8d12a727baf5ea65b6baecba7f32d5e5ef55cdd9efb73: Status 404 returned error can't find the container with id 25740839ca03c7133aa8d12a727baf5ea65b6baecba7f32d5e5ef55cdd9efb73
Jul 22 14:15:06.340688 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:06.340651    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8" event={"ID":"c1a2a0bc-9a28-47f3-8945-5259d5b34a14","Type":"ContainerStarted","Data":"30a2323ed7935e19d92c09c0b0887f67b1320e00ca70140b1f628309db6b295a"}
Jul 22 14:15:06.340875 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:06.340701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8" event={"ID":"c1a2a0bc-9a28-47f3-8945-5259d5b34a14","Type":"ContainerStarted","Data":"25740839ca03c7133aa8d12a727baf5ea65b6baecba7f32d5e5ef55cdd9efb73"}
Jul 22 14:15:06.358363 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:06.358322    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8" podStartSLOduration=1.358309308 podStartE2EDuration="1.358309308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:15:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:15:06.356954619 +0000 UTC m=+1730.599049601" watchObservedRunningTime="2026-07-22 14:15:06.358309308 +0000 UTC m=+1730.600404272"
Jul 22 14:15:07.345907 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:07.345872    2578 generic.go:356] "Generic (PLEG): container finished" podID="c1a2a0bc-9a28-47f3-8945-5259d5b34a14" containerID="30a2323ed7935e19d92c09c0b0887f67b1320e00ca70140b1f628309db6b295a" exitCode=0
Jul 22 14:15:07.346299 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:07.345927    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8" event={"ID":"c1a2a0bc-9a28-47f3-8945-5259d5b34a14","Type":"ContainerDied","Data":"30a2323ed7935e19d92c09c0b0887f67b1320e00ca70140b1f628309db6b295a"}
Jul 22 14:15:08.479865 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:08.479844    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"
Jul 22 14:15:08.575363 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:08.575338    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1a2a0bc-9a28-47f3-8945-5259d5b34a14-maas-api-service-ca\") pod \"c1a2a0bc-9a28-47f3-8945-5259d5b34a14\" (UID: \"c1a2a0bc-9a28-47f3-8945-5259d5b34a14\") "
Jul 22 14:15:08.575666 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:08.575642    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1a2a0bc-9a28-47f3-8945-5259d5b34a14-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c1a2a0bc-9a28-47f3-8945-5259d5b34a14" (UID: "c1a2a0bc-9a28-47f3-8945-5259d5b34a14"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:15:08.676015 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:08.675953    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1a2a0bc-9a28-47f3-8945-5259d5b34a14-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:15:09.356197 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:09.356164    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8" event={"ID":"c1a2a0bc-9a28-47f3-8945-5259d5b34a14","Type":"ContainerDied","Data":"25740839ca03c7133aa8d12a727baf5ea65b6baecba7f32d5e5ef55cdd9efb73"}
Jul 22 14:15:09.356197 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:09.356191    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"
Jul 22 14:15:09.356401 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:09.356218    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25740839ca03c7133aa8d12a727baf5ea65b6baecba7f32d5e5ef55cdd9efb73"
Jul 22 14:15:15.841332 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:15.841298    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"]
Jul 22 14:15:15.841791 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:15.841540    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv" podUID="fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc" containerName="maas-api" containerID="cri-o://8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584" gracePeriod=30
Jul 22 14:15:15.866219 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:15.866185    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz"]
Jul 22 14:15:15.872128 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:15.872098    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-592a7c5a-29745495-9mgqz"]
Jul 22 14:15:16.091730 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.091680    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:15:16.134218 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.134194    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwbmr\" (UniqueName: \"kubernetes.io/projected/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-kube-api-access-bwbmr\") pod \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") "
Jul 22 14:15:16.134373 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.134251    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-openshift-service-ca\") pod \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") "
Jul 22 14:15:16.134373 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.134271    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-maas-api-tls\") pod \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\" (UID: \"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc\") "
Jul 22 14:15:16.134629 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.134606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc" (UID: "fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:15:16.136600 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.136570    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-kube-api-access-bwbmr" (OuterVolumeSpecName: "kube-api-access-bwbmr") pod "fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc" (UID: "fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc"). InnerVolumeSpecName "kube-api-access-bwbmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:15:16.136694 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.136576    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc" (UID: "fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:15:16.235022 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.234990    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwbmr\" (UniqueName: \"kubernetes.io/projected/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-kube-api-access-bwbmr\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:15:16.235022 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.235017    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-openshift-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:15:16.235022 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.235028    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc-maas-api-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:15:16.258738 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.258699    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="329cb59d-8cf9-4f24-a522-bffbdb8a1701" path="/var/lib/kubelet/pods/329cb59d-8cf9-4f24-a522-bffbdb8a1701/volumes"
Jul 22 14:15:16.390871 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.390804    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc" containerID="8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584" exitCode=0
Jul 22 14:15:16.390871 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.390854    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"
Jul 22 14:15:16.390871 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.390867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv" event={"ID":"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc","Type":"ContainerDied","Data":"8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584"}
Jul 22 14:15:16.391046 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.390907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv" event={"ID":"fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc","Type":"ContainerDied","Data":"50455b4c1158e0d3b16e5bbe9c2d3f49aa4a06619b3caf7a6375e90e26de2f78"}
Jul 22 14:15:16.391046 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.390927    2578 scope.go:117] "RemoveContainer" containerID="8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584"
Jul 22 14:15:16.401174 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.401088    2578 scope.go:117] "RemoveContainer" containerID="8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584"
Jul 22 14:15:16.401489 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:15:16.401464    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584\": container with ID starting with 8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584 not found: ID does not exist" containerID="8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584"
Jul 22 14:15:16.401564 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.401502    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584"} err="failed to get container status \"8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584\": rpc error: code = NotFound desc = could not find container \"8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584\": container with ID starting with 8196afc8801149343fab671ac822a3e2e93f3df2a09531f9034faff3eeeca584 not found: ID does not exist"
Jul 22 14:15:16.416012 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.415985    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"]
Jul 22 14:15:16.421815 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:16.421794    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-592a7c5a-794789b576-848jv"]
Jul 22 14:15:18.253388 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:18.253359    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc" path="/var/lib/kubelet/pods/fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc/volumes"
Jul 22 14:15:20.457860 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:20.457823    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"]
Jul 22 14:15:20.460480 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:20.460451    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-592a7c5a-vgxr8"]
Jul 22 14:15:22.253147 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:22.253109    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1a2a0bc-9a28-47f3-8945-5259d5b34a14" path="/var/lib/kubelet/pods/c1a2a0bc-9a28-47f3-8945-5259d5b34a14/volumes"
Jul 22 14:15:23.659215 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.659186    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"]
Jul 22 14:15:23.659581 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.659514    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc" containerName="maas-api"
Jul 22 14:15:23.659581 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.659526    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc" containerName="maas-api"
Jul 22 14:15:23.659581 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.659538    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1a2a0bc-9a28-47f3-8945-5259d5b34a14" containerName="revoke-keys"
Jul 22 14:15:23.659581 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.659544    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1a2a0bc-9a28-47f3-8945-5259d5b34a14" containerName="revoke-keys"
Jul 22 14:15:23.659707 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.659608    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1a2a0bc-9a28-47f3-8945-5259d5b34a14" containerName="revoke-keys"
Jul 22 14:15:23.659707 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.659618    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe7a82fc-d4f7-48e8-b21a-cff16e8fdccc" containerName="maas-api"
Jul 22 14:15:23.664378 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.664359    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:23.666728 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.666708    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 14:15:23.666835 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.666780    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tpv8w\""
Jul 22 14:15:23.666835 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.666804    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b2bcc8b0-serving-cert\""
Jul 22 14:15:23.667268 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.667251    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 14:15:23.673208 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.673186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"]
Jul 22 14:15:23.687396 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.687370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3393d317-9829-4a96-aabb-2ad71027c4c3-openshift-service-ca\") pod \"maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:23.687497 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.687423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3393d317-9829-4a96-aabb-2ad71027c4c3-maas-api-tls\") pod \"maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:23.687548 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.687493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chl6q\" (UniqueName: \"kubernetes.io/projected/3393d317-9829-4a96-aabb-2ad71027c4c3-kube-api-access-chl6q\") pod \"maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:23.788109 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.788076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3393d317-9829-4a96-aabb-2ad71027c4c3-openshift-service-ca\") pod \"maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:23.788314 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.788118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3393d317-9829-4a96-aabb-2ad71027c4c3-maas-api-tls\") pod \"maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:23.788314 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.788165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chl6q\" (UniqueName: \"kubernetes.io/projected/3393d317-9829-4a96-aabb-2ad71027c4c3-kube-api-access-chl6q\") pod \"maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:23.788436 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:15:23.788311    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-serving-cert: secret "maas-api-e2e-ait-b2bcc8b0-serving-cert" not found
Jul 22 14:15:23.788436 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:15:23.788392    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3393d317-9829-4a96-aabb-2ad71027c4c3-maas-api-tls podName:3393d317-9829-4a96-aabb-2ad71027c4c3 nodeName:}" failed. No retries permitted until 2026-07-22 14:15:24.288369217 +0000 UTC m=+1748.530464175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3393d317-9829-4a96-aabb-2ad71027c4c3-maas-api-tls") pod "maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg" (UID: "3393d317-9829-4a96-aabb-2ad71027c4c3") : secret "maas-api-e2e-ait-b2bcc8b0-serving-cert" not found
Jul 22 14:15:23.788889 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.788867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3393d317-9829-4a96-aabb-2ad71027c4c3-openshift-service-ca\") pod \"maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:23.799090 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:23.799064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chl6q\" (UniqueName: \"kubernetes.io/projected/3393d317-9829-4a96-aabb-2ad71027c4c3-kube-api-access-chl6q\") pod \"maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:24.292504 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:24.292457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3393d317-9829-4a96-aabb-2ad71027c4c3-maas-api-tls\") pod \"maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:24.295082 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:24.295058    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3393d317-9829-4a96-aabb-2ad71027c4c3-maas-api-tls\") pod \"maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:24.577091 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:24.577008    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:24.752214 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:24.752192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"]
Jul 22 14:15:24.754322 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:15:24.754295    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3393d317_9829_4a96_aabb_2ad71027c4c3.slice/crio-5869bf1714fafe8190ea6a45c21ff85edac1374f2dc68f38262cee369b795df1 WatchSource:0}: Error finding container 5869bf1714fafe8190ea6a45c21ff85edac1374f2dc68f38262cee369b795df1: Status 404 returned error can't find the container with id 5869bf1714fafe8190ea6a45c21ff85edac1374f2dc68f38262cee369b795df1
Jul 22 14:15:25.438105 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:25.438069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg" event={"ID":"3393d317-9829-4a96-aabb-2ad71027c4c3","Type":"ContainerStarted","Data":"9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb"}
Jul 22 14:15:25.438290 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:25.438128    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg" event={"ID":"3393d317-9829-4a96-aabb-2ad71027c4c3","Type":"ContainerStarted","Data":"5869bf1714fafe8190ea6a45c21ff85edac1374f2dc68f38262cee369b795df1"}
Jul 22 14:15:25.438290 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:25.438194    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:25.455857 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:25.455811    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg" podStartSLOduration=1.983439453 podStartE2EDuration="2.455797698s" totalImagesPullingTime="472.358245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:15:25.45472466 +0000 UTC m=+1749.696819625" watchObservedRunningTime="2026-07-22 14:15:25.455797698 +0000 UTC m=+1749.697892663"
Jul 22 14:15:31.450202 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:31.450174    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:15:49.232684 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:49.232649    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"]
Jul 22 14:15:49.235613 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:49.235597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"
Jul 22 14:15:49.237637 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:49.237620    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:15:49.243587 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:49.243558    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"]
Jul 22 14:15:49.292887 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:49.292860    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6705a832-8c24-4e01-84ec-1c8f22cb449c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc\" (UID: \"6705a832-8c24-4e01-84ec-1c8f22cb449c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"
Jul 22 14:15:49.394204 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:49.394175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6705a832-8c24-4e01-84ec-1c8f22cb449c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc\" (UID: \"6705a832-8c24-4e01-84ec-1c8f22cb449c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"
Jul 22 14:15:49.394746 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:49.394726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6705a832-8c24-4e01-84ec-1c8f22cb449c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc\" (UID: \"6705a832-8c24-4e01-84ec-1c8f22cb449c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"
Jul 22 14:15:49.547548 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:49.547527    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"
Jul 22 14:15:49.692681 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:49.680223    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"]
Jul 22 14:15:49.692681 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:15:49.683021    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6705a832_8c24_4e01_84ec_1c8f22cb449c.slice/crio-aa29fb9100fce82bdaea6fa2a22ad9de3ccd8542285d90b68cfe00dbf049242d WatchSource:0}: Error finding container aa29fb9100fce82bdaea6fa2a22ad9de3ccd8542285d90b68cfe00dbf049242d: Status 404 returned error can't find the container with id aa29fb9100fce82bdaea6fa2a22ad9de3ccd8542285d90b68cfe00dbf049242d
Jul 22 14:15:50.561914 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:50.561884    2578 generic.go:356] "Generic (PLEG): container finished" podID="6705a832-8c24-4e01-84ec-1c8f22cb449c" containerID="bd697220d0ef7d93aa07f48f080c48d5c0ba01c12593d2e2107b2e8a38f0b3a9" exitCode=0
Jul 22 14:15:50.562304 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:50.561957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc" event={"ID":"6705a832-8c24-4e01-84ec-1c8f22cb449c","Type":"ContainerDied","Data":"bd697220d0ef7d93aa07f48f080c48d5c0ba01c12593d2e2107b2e8a38f0b3a9"}
Jul 22 14:15:50.562304 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:50.562006    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc" event={"ID":"6705a832-8c24-4e01-84ec-1c8f22cb449c","Type":"ContainerStarted","Data":"aa29fb9100fce82bdaea6fa2a22ad9de3ccd8542285d90b68cfe00dbf049242d"}
Jul 22 14:15:51.692949 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:51.692924    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"
Jul 22 14:15:51.815488 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:51.815463    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6705a832-8c24-4e01-84ec-1c8f22cb449c-maas-api-service-ca\") pod \"6705a832-8c24-4e01-84ec-1c8f22cb449c\" (UID: \"6705a832-8c24-4e01-84ec-1c8f22cb449c\") "
Jul 22 14:15:51.815825 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:51.815804    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6705a832-8c24-4e01-84ec-1c8f22cb449c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6705a832-8c24-4e01-84ec-1c8f22cb449c" (UID: "6705a832-8c24-4e01-84ec-1c8f22cb449c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:15:51.916997 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:51.916931    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6705a832-8c24-4e01-84ec-1c8f22cb449c-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:15:52.571729 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:52.571703    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"
Jul 22 14:15:52.571884 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:52.571740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc" event={"ID":"6705a832-8c24-4e01-84ec-1c8f22cb449c","Type":"ContainerDied","Data":"aa29fb9100fce82bdaea6fa2a22ad9de3ccd8542285d90b68cfe00dbf049242d"}
Jul 22 14:15:52.571884 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:52.571790    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa29fb9100fce82bdaea6fa2a22ad9de3ccd8542285d90b68cfe00dbf049242d"
Jul 22 14:15:59.678382 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:59.678354    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"]
Jul 22 14:15:59.678874 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:59.678574    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg" podUID="3393d317-9829-4a96-aabb-2ad71027c4c3" containerName="maas-api" containerID="cri-o://9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb" gracePeriod=30
Jul 22 14:15:59.932224 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:15:59.932165    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:16:00.081781 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.081748    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3393d317-9829-4a96-aabb-2ad71027c4c3-maas-api-tls\") pod \"3393d317-9829-4a96-aabb-2ad71027c4c3\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") "
Jul 22 14:16:00.081943 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.081788    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chl6q\" (UniqueName: \"kubernetes.io/projected/3393d317-9829-4a96-aabb-2ad71027c4c3-kube-api-access-chl6q\") pod \"3393d317-9829-4a96-aabb-2ad71027c4c3\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") "
Jul 22 14:16:00.081943 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.081876    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3393d317-9829-4a96-aabb-2ad71027c4c3-openshift-service-ca\") pod \"3393d317-9829-4a96-aabb-2ad71027c4c3\" (UID: \"3393d317-9829-4a96-aabb-2ad71027c4c3\") "
Jul 22 14:16:00.082294 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.082266    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3393d317-9829-4a96-aabb-2ad71027c4c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3393d317-9829-4a96-aabb-2ad71027c4c3" (UID: "3393d317-9829-4a96-aabb-2ad71027c4c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:16:00.084021 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.083996    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3393d317-9829-4a96-aabb-2ad71027c4c3-kube-api-access-chl6q" (OuterVolumeSpecName: "kube-api-access-chl6q") pod "3393d317-9829-4a96-aabb-2ad71027c4c3" (UID: "3393d317-9829-4a96-aabb-2ad71027c4c3"). InnerVolumeSpecName "kube-api-access-chl6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:16:00.084119 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.084050    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3393d317-9829-4a96-aabb-2ad71027c4c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3393d317-9829-4a96-aabb-2ad71027c4c3" (UID: "3393d317-9829-4a96-aabb-2ad71027c4c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:16:00.182926 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.182867    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3393d317-9829-4a96-aabb-2ad71027c4c3-maas-api-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:16:00.182926 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.182892    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chl6q\" (UniqueName: \"kubernetes.io/projected/3393d317-9829-4a96-aabb-2ad71027c4c3-kube-api-access-chl6q\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:16:00.182926 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.182903    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3393d317-9829-4a96-aabb-2ad71027c4c3-openshift-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:16:00.609600 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.609572    2578 generic.go:356] "Generic (PLEG): container finished" podID="3393d317-9829-4a96-aabb-2ad71027c4c3" containerID="9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb" exitCode=0
Jul 22 14:16:00.609763 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.609616    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"
Jul 22 14:16:00.609763 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.609641    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg" event={"ID":"3393d317-9829-4a96-aabb-2ad71027c4c3","Type":"ContainerDied","Data":"9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb"}
Jul 22 14:16:00.609763 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.609681    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg" event={"ID":"3393d317-9829-4a96-aabb-2ad71027c4c3","Type":"ContainerDied","Data":"5869bf1714fafe8190ea6a45c21ff85edac1374f2dc68f38262cee369b795df1"}
Jul 22 14:16:00.609763 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.609701    2578 scope.go:117] "RemoveContainer" containerID="9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb"
Jul 22 14:16:00.618274 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.618245    2578 scope.go:117] "RemoveContainer" containerID="9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb"
Jul 22 14:16:00.618502 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:16:00.618484    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb\": container with ID starting with 9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb not found: ID does not exist" containerID="9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb"
Jul 22 14:16:00.618548 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.618509    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb"} err="failed to get container status \"9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb\": rpc error: code = NotFound desc = could not find container \"9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb\": container with ID starting with 9d0cbaba95fc1ee0f2d9bb12522bb5be3aa5038ab752aabcf682769a3b0c2cfb not found: ID does not exist"
Jul 22 14:16:00.626338 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.626317    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"]
Jul 22 14:16:00.632551 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:00.632526    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2bcc8b0-7dcdd54454-q48rg"]
Jul 22 14:16:02.253840 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:02.253809    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3393d317-9829-4a96-aabb-2ad71027c4c3" path="/var/lib/kubelet/pods/3393d317-9829-4a96-aabb-2ad71027c4c3/volumes"
Jul 22 14:16:04.318702 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:04.318672    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"]
Jul 22 14:16:04.322392 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:04.322370    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2bcc8b0-8gvwc"]
Jul 22 14:16:06.253705 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:06.253672    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6705a832-8c24-4e01-84ec-1c8f22cb449c" path="/var/lib/kubelet/pods/6705a832-8c24-4e01-84ec-1c8f22cb449c/volumes"
Jul 22 14:16:08.857224 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.857151    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"]
Jul 22 14:16:08.857590 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.857524    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3393d317-9829-4a96-aabb-2ad71027c4c3" containerName="maas-api"
Jul 22 14:16:08.857590 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.857536    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3393d317-9829-4a96-aabb-2ad71027c4c3" containerName="maas-api"
Jul 22 14:16:08.857590 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.857558    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6705a832-8c24-4e01-84ec-1c8f22cb449c" containerName="revoke-keys"
Jul 22 14:16:08.857590 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.857563    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6705a832-8c24-4e01-84ec-1c8f22cb449c" containerName="revoke-keys"
Jul 22 14:16:08.857755 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.857617    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3393d317-9829-4a96-aabb-2ad71027c4c3" containerName="maas-api"
Jul 22 14:16:08.857755 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.857630    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6705a832-8c24-4e01-84ec-1c8f22cb449c" containerName="revoke-keys"
Jul 22 14:16:08.862057 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.862036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:08.864223 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.864195    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tpv8w\""
Jul 22 14:16:08.864472 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.864452    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-a098ef76-serving-cert\""
Jul 22 14:16:08.864530 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.864473    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 14:16:08.864937 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.864923    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 14:16:08.870184 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.869865    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"]
Jul 22 14:16:08.952906 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.952872    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2198c1dc-8245-48d1-8373-f331f7a5d363-openshift-service-ca\") pod \"maas-api-e2e-derive-a098ef76-77c5597547-mjfp4\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:08.953052 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.952919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2198c1dc-8245-48d1-8373-f331f7a5d363-maas-api-tls\") pod \"maas-api-e2e-derive-a098ef76-77c5597547-mjfp4\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:08.953097 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:08.953044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmxc8\" (UniqueName: \"kubernetes.io/projected/2198c1dc-8245-48d1-8373-f331f7a5d363-kube-api-access-mmxc8\") pod \"maas-api-e2e-derive-a098ef76-77c5597547-mjfp4\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:09.054022 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:09.053994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmxc8\" (UniqueName: \"kubernetes.io/projected/2198c1dc-8245-48d1-8373-f331f7a5d363-kube-api-access-mmxc8\") pod \"maas-api-e2e-derive-a098ef76-77c5597547-mjfp4\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:09.054194 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:09.054038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2198c1dc-8245-48d1-8373-f331f7a5d363-openshift-service-ca\") pod \"maas-api-e2e-derive-a098ef76-77c5597547-mjfp4\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:09.054328 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:09.054303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2198c1dc-8245-48d1-8373-f331f7a5d363-maas-api-tls\") pod \"maas-api-e2e-derive-a098ef76-77c5597547-mjfp4\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:09.054446 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:16:09.054428    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-serving-cert: secret "maas-api-e2e-derive-a098ef76-serving-cert" not found
Jul 22 14:16:09.054529 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:16:09.054516    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2198c1dc-8245-48d1-8373-f331f7a5d363-maas-api-tls podName:2198c1dc-8245-48d1-8373-f331f7a5d363 nodeName:}" failed. No retries permitted until 2026-07-22 14:16:09.554495543 +0000 UTC m=+1793.796590491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2198c1dc-8245-48d1-8373-f331f7a5d363-maas-api-tls") pod "maas-api-e2e-derive-a098ef76-77c5597547-mjfp4" (UID: "2198c1dc-8245-48d1-8373-f331f7a5d363") : secret "maas-api-e2e-derive-a098ef76-serving-cert" not found
Jul 22 14:16:09.054713 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:09.054696    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2198c1dc-8245-48d1-8373-f331f7a5d363-openshift-service-ca\") pod \"maas-api-e2e-derive-a098ef76-77c5597547-mjfp4\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:09.064413 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:09.064393    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmxc8\" (UniqueName: \"kubernetes.io/projected/2198c1dc-8245-48d1-8373-f331f7a5d363-kube-api-access-mmxc8\") pod \"maas-api-e2e-derive-a098ef76-77c5597547-mjfp4\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:09.559632 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:09.559596    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2198c1dc-8245-48d1-8373-f331f7a5d363-maas-api-tls\") pod \"maas-api-e2e-derive-a098ef76-77c5597547-mjfp4\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:09.562052 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:09.562027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2198c1dc-8245-48d1-8373-f331f7a5d363-maas-api-tls\") pod \"maas-api-e2e-derive-a098ef76-77c5597547-mjfp4\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:09.773310 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:09.773268    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:09.921409 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:09.921385    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"]
Jul 22 14:16:09.923325 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:16:09.923297    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2198c1dc_8245_48d1_8373_f331f7a5d363.slice/crio-28e5baa0c1bbc22f474eb988d6a5e1f26bc73804046979e1f2399e5b0581eb8e WatchSource:0}: Error finding container 28e5baa0c1bbc22f474eb988d6a5e1f26bc73804046979e1f2399e5b0581eb8e: Status 404 returned error can't find the container with id 28e5baa0c1bbc22f474eb988d6a5e1f26bc73804046979e1f2399e5b0581eb8e
Jul 22 14:16:10.663660 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:10.663618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4" event={"ID":"2198c1dc-8245-48d1-8373-f331f7a5d363","Type":"ContainerStarted","Data":"28e5baa0c1bbc22f474eb988d6a5e1f26bc73804046979e1f2399e5b0581eb8e"}
Jul 22 14:16:11.669152 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:11.669055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4" event={"ID":"2198c1dc-8245-48d1-8373-f331f7a5d363","Type":"ContainerStarted","Data":"de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47"}
Jul 22 14:16:11.669490 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:11.669208    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:11.686949 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:11.686908    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4" podStartSLOduration=2.275526329 podStartE2EDuration="3.686894596s" totalImagesPullingTime="1.411368267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:16:11.686289789 +0000 UTC m=+1795.928384754" watchObservedRunningTime="2026-07-22 14:16:11.686894596 +0000 UTC m=+1795.928989560"
Jul 22 14:16:16.294411 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:16.294383    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:16:16.296661 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:16.296638    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:16:17.678771 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:17.678742    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:33.666989 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:33.666954    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"]
Jul 22 14:16:33.670535 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:33.670511    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"
Jul 22 14:16:33.672723 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:33.672701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:16:33.680350 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:33.680324    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"]
Jul 22 14:16:33.747443 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:33.747417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b4b831-13c2-4c01-a5a6-e239f152cae4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7\" (UID: \"e3b4b831-13c2-4c01-a5a6-e239f152cae4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"
Jul 22 14:16:33.848056 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:33.848033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b4b831-13c2-4c01-a5a6-e239f152cae4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7\" (UID: \"e3b4b831-13c2-4c01-a5a6-e239f152cae4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"
Jul 22 14:16:33.848666 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:33.848648    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b4b831-13c2-4c01-a5a6-e239f152cae4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7\" (UID: \"e3b4b831-13c2-4c01-a5a6-e239f152cae4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"
Jul 22 14:16:33.981603 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:33.981546    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"
Jul 22 14:16:34.111780 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:34.111756    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"]
Jul 22 14:16:34.113982 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:16:34.113956    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b4b831_13c2_4c01_a5a6_e239f152cae4.slice/crio-3fd680a8b4ef507d801e0821a6e5015b0d9259b6cce78451cacac1105c82df6e WatchSource:0}: Error finding container 3fd680a8b4ef507d801e0821a6e5015b0d9259b6cce78451cacac1105c82df6e: Status 404 returned error can't find the container with id 3fd680a8b4ef507d801e0821a6e5015b0d9259b6cce78451cacac1105c82df6e
Jul 22 14:16:34.771667 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:34.771637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7" event={"ID":"e3b4b831-13c2-4c01-a5a6-e239f152cae4","Type":"ContainerStarted","Data":"e3d1832feabc79a0b9c443b3074fc8fc55ce7582e0b98f0edf3a6dc614bb2ab6"}
Jul 22 14:16:34.772016 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:34.771700    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7" event={"ID":"e3b4b831-13c2-4c01-a5a6-e239f152cae4","Type":"ContainerStarted","Data":"3fd680a8b4ef507d801e0821a6e5015b0d9259b6cce78451cacac1105c82df6e"}
Jul 22 14:16:34.788511 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:34.788463    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7" podStartSLOduration=1.788447649 podStartE2EDuration="1.788447649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:16:34.786887766 +0000 UTC m=+1819.028982731" watchObservedRunningTime="2026-07-22 14:16:34.788447649 +0000 UTC m=+1819.030542614"
Jul 22 14:16:35.778532 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:35.778499    2578 generic.go:356] "Generic (PLEG): container finished" podID="e3b4b831-13c2-4c01-a5a6-e239f152cae4" containerID="e3d1832feabc79a0b9c443b3074fc8fc55ce7582e0b98f0edf3a6dc614bb2ab6" exitCode=0
Jul 22 14:16:35.778910 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:35.778590    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7" event={"ID":"e3b4b831-13c2-4c01-a5a6-e239f152cae4","Type":"ContainerDied","Data":"e3d1832feabc79a0b9c443b3074fc8fc55ce7582e0b98f0edf3a6dc614bb2ab6"}
Jul 22 14:16:36.910557 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:36.910536    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"
Jul 22 14:16:36.974720 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:36.974693    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b4b831-13c2-4c01-a5a6-e239f152cae4-maas-api-service-ca\") pod \"e3b4b831-13c2-4c01-a5a6-e239f152cae4\" (UID: \"e3b4b831-13c2-4c01-a5a6-e239f152cae4\") "
Jul 22 14:16:36.975011 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:36.974991    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3b4b831-13c2-4c01-a5a6-e239f152cae4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e3b4b831-13c2-4c01-a5a6-e239f152cae4" (UID: "e3b4b831-13c2-4c01-a5a6-e239f152cae4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:16:37.075792 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:37.075725    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b4b831-13c2-4c01-a5a6-e239f152cae4-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:16:37.791815 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:37.791790    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"
Jul 22 14:16:37.791979 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:37.791814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7" event={"ID":"e3b4b831-13c2-4c01-a5a6-e239f152cae4","Type":"ContainerDied","Data":"3fd680a8b4ef507d801e0821a6e5015b0d9259b6cce78451cacac1105c82df6e"}
Jul 22 14:16:37.791979 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:37.791877    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fd680a8b4ef507d801e0821a6e5015b0d9259b6cce78451cacac1105c82df6e"
Jul 22 14:16:44.198306 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.198261    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"]
Jul 22 14:16:44.198733 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.198528    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4" podUID="2198c1dc-8245-48d1-8373-f331f7a5d363" containerName="maas-api" containerID="cri-o://de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47" gracePeriod=30
Jul 22 14:16:44.438547 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.438525    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:44.532851 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.532823    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2198c1dc-8245-48d1-8373-f331f7a5d363-maas-api-tls\") pod \"2198c1dc-8245-48d1-8373-f331f7a5d363\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") "
Jul 22 14:16:44.533004 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.532873    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmxc8\" (UniqueName: \"kubernetes.io/projected/2198c1dc-8245-48d1-8373-f331f7a5d363-kube-api-access-mmxc8\") pod \"2198c1dc-8245-48d1-8373-f331f7a5d363\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") "
Jul 22 14:16:44.533004 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.532928    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2198c1dc-8245-48d1-8373-f331f7a5d363-openshift-service-ca\") pod \"2198c1dc-8245-48d1-8373-f331f7a5d363\" (UID: \"2198c1dc-8245-48d1-8373-f331f7a5d363\") "
Jul 22 14:16:44.533373 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.533347    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2198c1dc-8245-48d1-8373-f331f7a5d363-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2198c1dc-8245-48d1-8373-f331f7a5d363" (UID: "2198c1dc-8245-48d1-8373-f331f7a5d363"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:16:44.535027 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.535005    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2198c1dc-8245-48d1-8373-f331f7a5d363-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2198c1dc-8245-48d1-8373-f331f7a5d363" (UID: "2198c1dc-8245-48d1-8373-f331f7a5d363"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:16:44.535107 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.535077    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2198c1dc-8245-48d1-8373-f331f7a5d363-kube-api-access-mmxc8" (OuterVolumeSpecName: "kube-api-access-mmxc8") pod "2198c1dc-8245-48d1-8373-f331f7a5d363" (UID: "2198c1dc-8245-48d1-8373-f331f7a5d363"). InnerVolumeSpecName "kube-api-access-mmxc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:16:44.634244 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.634216    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmxc8\" (UniqueName: \"kubernetes.io/projected/2198c1dc-8245-48d1-8373-f331f7a5d363-kube-api-access-mmxc8\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:16:44.634244 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.634240    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2198c1dc-8245-48d1-8373-f331f7a5d363-openshift-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:16:44.634385 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.634250    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2198c1dc-8245-48d1-8373-f331f7a5d363-maas-api-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:16:44.824360 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.824286    2578 generic.go:356] "Generic (PLEG): container finished" podID="2198c1dc-8245-48d1-8373-f331f7a5d363" containerID="de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47" exitCode=0
Jul 22 14:16:44.824360 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.824330    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"
Jul 22 14:16:44.824360 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.824343    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4" event={"ID":"2198c1dc-8245-48d1-8373-f331f7a5d363","Type":"ContainerDied","Data":"de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47"}
Jul 22 14:16:44.824609 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.824403    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4" event={"ID":"2198c1dc-8245-48d1-8373-f331f7a5d363","Type":"ContainerDied","Data":"28e5baa0c1bbc22f474eb988d6a5e1f26bc73804046979e1f2399e5b0581eb8e"}
Jul 22 14:16:44.824609 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.824425    2578 scope.go:117] "RemoveContainer" containerID="de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47"
Jul 22 14:16:44.833410 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.833393    2578 scope.go:117] "RemoveContainer" containerID="de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47"
Jul 22 14:16:44.833658 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:16:44.833639    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47\": container with ID starting with de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47 not found: ID does not exist" containerID="de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47"
Jul 22 14:16:44.833704 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.833666    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47"} err="failed to get container status \"de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47\": rpc error: code = NotFound desc = could not find container \"de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47\": container with ID starting with de7831329cd80d198e40d1b52125bf98baff5dab9eb43742e0554e818151dd47 not found: ID does not exist"
Jul 22 14:16:44.858758 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.858713    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"]
Jul 22 14:16:44.864174 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:44.864152    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a098ef76-77c5597547-mjfp4"]
Jul 22 14:16:46.254800 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:46.254768    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2198c1dc-8245-48d1-8373-f331f7a5d363" path="/var/lib/kubelet/pods/2198c1dc-8245-48d1-8373-f331f7a5d363/volumes"
Jul 22 14:16:48.743837 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:48.743805    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"]
Jul 22 14:16:48.746547 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:48.746523    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a098ef76-5b2f7"]
Jul 22 14:16:50.253307 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:16:50.253277    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3b4b831-13c2-4c01-a5a6-e239f152cae4" path="/var/lib/kubelet/pods/e3b4b831-13c2-4c01-a5a6-e239f152cae4/volumes"
Jul 22 14:18:30.262256 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.262223    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"]
Jul 22 14:18:30.262723 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.262546    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2198c1dc-8245-48d1-8373-f331f7a5d363" containerName="maas-api"
Jul 22 14:18:30.262723 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.262558    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2198c1dc-8245-48d1-8373-f331f7a5d363" containerName="maas-api"
Jul 22 14:18:30.262723 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.262586    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3b4b831-13c2-4c01-a5a6-e239f152cae4" containerName="revoke-keys"
Jul 22 14:18:30.262723 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.262591    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3b4b831-13c2-4c01-a5a6-e239f152cae4" containerName="revoke-keys"
Jul 22 14:18:30.262723 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.262640    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3b4b831-13c2-4c01-a5a6-e239f152cae4" containerName="revoke-keys"
Jul 22 14:18:30.262723 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.262648    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2198c1dc-8245-48d1-8373-f331f7a5d363" containerName="maas-api"
Jul 22 14:18:30.265476 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.265460    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:30.267885 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.267847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-52896681-serving-cert\""
Jul 22 14:18:30.268017 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.267908    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tpv8w\""
Jul 22 14:18:30.268653 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.268630    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 14:18:30.268925 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.268908    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 14:18:30.275329 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.275312    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"]
Jul 22 14:18:30.363472 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.363437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2s5f\" (UniqueName: \"kubernetes.io/projected/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-kube-api-access-g2s5f\") pod \"maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:30.363472 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.363476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-maas-api-tls\") pod \"maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:30.363658 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.363504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-openshift-service-ca\") pod \"maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:30.464900 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.464809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-maas-api-tls\") pod \"maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:30.464900 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:18:30.464902    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-52896681-serving-cert: secret "maas-api-e2e-mt-52896681-serving-cert" not found
Jul 22 14:18:30.465091 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.464941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-openshift-service-ca\") pod \"maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:30.465091 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:18:30.464978    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-maas-api-tls podName:46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3 nodeName:}" failed. No retries permitted until 2026-07-22 14:18:30.964955492 +0000 UTC m=+1935.207050438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-maas-api-tls") pod "maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm" (UID: "46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3") : secret "maas-api-e2e-mt-52896681-serving-cert" not found
Jul 22 14:18:30.465221 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.465113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2s5f\" (UniqueName: \"kubernetes.io/projected/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-kube-api-access-g2s5f\") pod \"maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:30.465552 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.465533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-openshift-service-ca\") pod \"maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:30.475303 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.475286    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2s5f\" (UniqueName: \"kubernetes.io/projected/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-kube-api-access-g2s5f\") pod \"maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:30.969042 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.969004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-maas-api-tls\") pod \"maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:30.971562 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:30.971537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-maas-api-tls\") pod \"maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:31.176751 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:31.176720    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:31.324336 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:31.324310    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"]
Jul 22 14:18:31.326519 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:18:31.326476    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fb0b9e_b9b3_4052_b84a_3fc8a2bed0c3.slice/crio-600cb994b39ba67c8108baf074e5ef55fd3f3113e024d0e4c1b7b72df67152cf WatchSource:0}: Error finding container 600cb994b39ba67c8108baf074e5ef55fd3f3113e024d0e4c1b7b72df67152cf: Status 404 returned error can't find the container with id 600cb994b39ba67c8108baf074e5ef55fd3f3113e024d0e4c1b7b72df67152cf
Jul 22 14:18:32.316636 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:32.316602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm" event={"ID":"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3","Type":"ContainerStarted","Data":"677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d"}
Jul 22 14:18:32.316819 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:32.316652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm" event={"ID":"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3","Type":"ContainerStarted","Data":"600cb994b39ba67c8108baf074e5ef55fd3f3113e024d0e4c1b7b72df67152cf"}
Jul 22 14:18:32.316819 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:32.316715    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:32.333875 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:32.333824    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm" podStartSLOduration=1.54103711 podStartE2EDuration="2.333806051s" totalImagesPullingTime="792.768941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:18:32.332724458 +0000 UTC m=+1936.574819459" watchObservedRunningTime="2026-07-22 14:18:32.333806051 +0000 UTC m=+1936.575901054"
Jul 22 14:18:38.326938 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:38.326911    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:42.236822 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:42.236786    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"]
Jul 22 14:18:42.240978 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:42.240961    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"
Jul 22 14:18:42.243307 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:42.243281    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:18:42.255466 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:42.255444    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"]
Jul 22 14:18:42.256537 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:42.256506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/201da7eb-674a-4609-9fcf-2dfe9fd63cec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-52896681-g2xnm\" (UID: \"201da7eb-674a-4609-9fcf-2dfe9fd63cec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"
Jul 22 14:18:42.357370 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:42.357347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/201da7eb-674a-4609-9fcf-2dfe9fd63cec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-52896681-g2xnm\" (UID: \"201da7eb-674a-4609-9fcf-2dfe9fd63cec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"
Jul 22 14:18:42.357893 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:42.357875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/201da7eb-674a-4609-9fcf-2dfe9fd63cec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-52896681-g2xnm\" (UID: \"201da7eb-674a-4609-9fcf-2dfe9fd63cec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"
Jul 22 14:18:42.553833 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:42.553810    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"
Jul 22 14:18:42.690153 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:42.690106    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"]
Jul 22 14:18:42.691879 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:18:42.691833    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201da7eb_674a_4609_9fcf_2dfe9fd63cec.slice/crio-2a8773837de2a77ca6031b73af35955d71fbdafb10ec17ec7e08d2cf327054b9 WatchSource:0}: Error finding container 2a8773837de2a77ca6031b73af35955d71fbdafb10ec17ec7e08d2cf327054b9: Status 404 returned error can't find the container with id 2a8773837de2a77ca6031b73af35955d71fbdafb10ec17ec7e08d2cf327054b9
Jul 22 14:18:43.368885 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:43.368845    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm" event={"ID":"201da7eb-674a-4609-9fcf-2dfe9fd63cec","Type":"ContainerStarted","Data":"f239d65df167bdb62d81768de71d5ceebe58650e19404f329f296b2cb3a89848"}
Jul 22 14:18:43.369393 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:43.368922    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm" event={"ID":"201da7eb-674a-4609-9fcf-2dfe9fd63cec","Type":"ContainerStarted","Data":"2a8773837de2a77ca6031b73af35955d71fbdafb10ec17ec7e08d2cf327054b9"}
Jul 22 14:18:43.390943 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:43.390892    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm" podStartSLOduration=1.390876817 podStartE2EDuration="1.390876817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:18:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:18:43.390122832 +0000 UTC m=+1947.632217788" watchObservedRunningTime="2026-07-22 14:18:43.390876817 +0000 UTC m=+1947.632971781"
Jul 22 14:18:44.376997 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:44.376967    2578 generic.go:356] "Generic (PLEG): container finished" podID="201da7eb-674a-4609-9fcf-2dfe9fd63cec" containerID="f239d65df167bdb62d81768de71d5ceebe58650e19404f329f296b2cb3a89848" exitCode=0
Jul 22 14:18:44.377503 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:44.377013    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm" event={"ID":"201da7eb-674a-4609-9fcf-2dfe9fd63cec","Type":"ContainerDied","Data":"f239d65df167bdb62d81768de71d5ceebe58650e19404f329f296b2cb3a89848"}
Jul 22 14:18:45.520233 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:45.520211    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"
Jul 22 14:18:45.582944 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:45.582917    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/201da7eb-674a-4609-9fcf-2dfe9fd63cec-maas-api-service-ca\") pod \"201da7eb-674a-4609-9fcf-2dfe9fd63cec\" (UID: \"201da7eb-674a-4609-9fcf-2dfe9fd63cec\") "
Jul 22 14:18:45.583292 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:45.583273    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/201da7eb-674a-4609-9fcf-2dfe9fd63cec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "201da7eb-674a-4609-9fcf-2dfe9fd63cec" (UID: "201da7eb-674a-4609-9fcf-2dfe9fd63cec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:18:45.684175 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:45.684108    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/201da7eb-674a-4609-9fcf-2dfe9fd63cec-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:18:46.388156 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:46.388106    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"
Jul 22 14:18:46.388290 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:46.388160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm" event={"ID":"201da7eb-674a-4609-9fcf-2dfe9fd63cec","Type":"ContainerDied","Data":"2a8773837de2a77ca6031b73af35955d71fbdafb10ec17ec7e08d2cf327054b9"}
Jul 22 14:18:46.388290 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:46.388204    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a8773837de2a77ca6031b73af35955d71fbdafb10ec17ec7e08d2cf327054b9"
Jul 22 14:18:52.664950 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:52.664916    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"]
Jul 22 14:18:52.665380 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:52.665116    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm" podUID="46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3" containerName="maas-api" containerID="cri-o://677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d" gracePeriod=30
Jul 22 14:18:52.929775 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:52.929747    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:53.039212 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.039181    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-maas-api-tls\") pod \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") "
Jul 22 14:18:53.039381 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.039223    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2s5f\" (UniqueName: \"kubernetes.io/projected/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-kube-api-access-g2s5f\") pod \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") "
Jul 22 14:18:53.039381 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.039300    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-openshift-service-ca\") pod \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\" (UID: \"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3\") "
Jul 22 14:18:53.039686 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.039662    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3" (UID: "46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:18:53.041428 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.041408    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-kube-api-access-g2s5f" (OuterVolumeSpecName: "kube-api-access-g2s5f") pod "46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3" (UID: "46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3"). InnerVolumeSpecName "kube-api-access-g2s5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:18:53.041524 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.041497    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3" (UID: "46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:18:53.140366 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.140328    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-maas-api-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:18:53.140366 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.140359    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2s5f\" (UniqueName: \"kubernetes.io/projected/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-kube-api-access-g2s5f\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:18:53.140366 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.140372    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3-openshift-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:18:53.423741 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.423703    2578 generic.go:356] "Generic (PLEG): container finished" podID="46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3" containerID="677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d" exitCode=0
Jul 22 14:18:53.423926 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.423755    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"
Jul 22 14:18:53.423926 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.423790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm" event={"ID":"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3","Type":"ContainerDied","Data":"677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d"}
Jul 22 14:18:53.423926 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.423847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm" event={"ID":"46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3","Type":"ContainerDied","Data":"600cb994b39ba67c8108baf074e5ef55fd3f3113e024d0e4c1b7b72df67152cf"}
Jul 22 14:18:53.423926 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.423880    2578 scope.go:117] "RemoveContainer" containerID="677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d"
Jul 22 14:18:53.432954 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.432938    2578 scope.go:117] "RemoveContainer" containerID="677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d"
Jul 22 14:18:53.433268 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:18:53.433248    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d\": container with ID starting with 677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d not found: ID does not exist" containerID="677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d"
Jul 22 14:18:53.433331 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.433278    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d"} err="failed to get container status \"677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d\": rpc error: code = NotFound desc = could not find container \"677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d\": container with ID starting with 677b4667f251721043bef58cbb721a9b306a2d347795db75c651631aba6c9d7d not found: ID does not exist"
Jul 22 14:18:53.444679 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.444653    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"]
Jul 22 14:18:53.448995 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:53.448972    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52896681-74f9cd87d4-6nkmm"]
Jul 22 14:18:54.253092 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:54.253059    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3" path="/var/lib/kubelet/pods/46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3/volumes"
Jul 22 14:18:57.325673 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:57.325639    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"]
Jul 22 14:18:57.328527 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:57.328504    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-52896681-g2xnm"]
Jul 22 14:18:58.253507 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:18:58.253476    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="201da7eb-674a-4609-9fcf-2dfe9fd63cec" path="/var/lib/kubelet/pods/201da7eb-674a-4609-9fcf-2dfe9fd63cec/volumes"
Jul 22 14:19:26.673394 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.673361    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"]
Jul 22 14:19:26.673959 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.673783    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3" containerName="maas-api"
Jul 22 14:19:26.673959 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.673801    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3" containerName="maas-api"
Jul 22 14:19:26.673959 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.673827    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="201da7eb-674a-4609-9fcf-2dfe9fd63cec" containerName="revoke-keys"
Jul 22 14:19:26.673959 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.673833    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="201da7eb-674a-4609-9fcf-2dfe9fd63cec" containerName="revoke-keys"
Jul 22 14:19:26.673959 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.673927    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="46fb0b9e-b9b3-4052-b84a-3fc8a2bed0c3" containerName="maas-api"
Jul 22 14:19:26.673959 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.673945    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="201da7eb-674a-4609-9fcf-2dfe9fd63cec" containerName="revoke-keys"
Jul 22 14:19:26.677077 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.677054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:26.679762 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.679735    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-54c01305-serving-cert\""
Jul 22 14:19:26.679895 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.679779    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 14:19:26.679983 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.679743    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 14:19:26.680547 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.680526    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tpv8w\""
Jul 22 14:19:26.688091 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.688072    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"]
Jul 22 14:19:26.807186 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.807147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4mh8\" (UniqueName: \"kubernetes.io/projected/328e5da3-da6f-4685-ac18-a259acee3e6c-kube-api-access-t4mh8\") pod \"maas-api-e2e-mt-54c01305-76654557c4-nzx8z\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:26.807348 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.807233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/328e5da3-da6f-4685-ac18-a259acee3e6c-maas-api-tls\") pod \"maas-api-e2e-mt-54c01305-76654557c4-nzx8z\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:26.807348 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.807314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/328e5da3-da6f-4685-ac18-a259acee3e6c-openshift-service-ca\") pod \"maas-api-e2e-mt-54c01305-76654557c4-nzx8z\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:26.908205 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.908169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4mh8\" (UniqueName: \"kubernetes.io/projected/328e5da3-da6f-4685-ac18-a259acee3e6c-kube-api-access-t4mh8\") pod \"maas-api-e2e-mt-54c01305-76654557c4-nzx8z\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:26.908372 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.908230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/328e5da3-da6f-4685-ac18-a259acee3e6c-maas-api-tls\") pod \"maas-api-e2e-mt-54c01305-76654557c4-nzx8z\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:26.908372 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.908299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/328e5da3-da6f-4685-ac18-a259acee3e6c-openshift-service-ca\") pod \"maas-api-e2e-mt-54c01305-76654557c4-nzx8z\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:26.909475 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.909448    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/328e5da3-da6f-4685-ac18-a259acee3e6c-openshift-service-ca\") pod \"maas-api-e2e-mt-54c01305-76654557c4-nzx8z\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:26.915685 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.915662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/328e5da3-da6f-4685-ac18-a259acee3e6c-maas-api-tls\") pod \"maas-api-e2e-mt-54c01305-76654557c4-nzx8z\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:26.917510 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.917490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4mh8\" (UniqueName: \"kubernetes.io/projected/328e5da3-da6f-4685-ac18-a259acee3e6c-kube-api-access-t4mh8\") pod \"maas-api-e2e-mt-54c01305-76654557c4-nzx8z\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:26.991332 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:26.991267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:27.127908 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:27.127842    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"]
Jul 22 14:19:27.130320 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:19:27.130272    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328e5da3_da6f_4685_ac18_a259acee3e6c.slice/crio-dc6d270fe1b93f9cdccb3e605d43d1475b2f7431740f7bf2c95fab6bd3f6f988 WatchSource:0}: Error finding container dc6d270fe1b93f9cdccb3e605d43d1475b2f7431740f7bf2c95fab6bd3f6f988: Status 404 returned error can't find the container with id dc6d270fe1b93f9cdccb3e605d43d1475b2f7431740f7bf2c95fab6bd3f6f988
Jul 22 14:19:27.580047 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:27.580012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z" event={"ID":"328e5da3-da6f-4685-ac18-a259acee3e6c","Type":"ContainerStarted","Data":"dc6d270fe1b93f9cdccb3e605d43d1475b2f7431740f7bf2c95fab6bd3f6f988"}
Jul 22 14:19:28.586556 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:28.586517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z" event={"ID":"328e5da3-da6f-4685-ac18-a259acee3e6c","Type":"ContainerStarted","Data":"64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876"}
Jul 22 14:19:28.586978 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:28.586703    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:28.607336 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:28.607285    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z" podStartSLOduration=1.83876187 podStartE2EDuration="2.607270244s" totalImagesPullingTime="768.508374ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:19:28.606201204 +0000 UTC m=+1992.848296171" watchObservedRunningTime="2026-07-22 14:19:28.607270244 +0000 UTC m=+1992.849365209"
Jul 22 14:19:34.596498 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:34.596463    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:19:59.325406 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:59.325373    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"]
Jul 22 14:19:59.328673 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:59.328654    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"
Jul 22 14:19:59.330942 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:59.330920    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:19:59.337182 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:59.337155    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"]
Jul 22 14:19:59.363527 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:59.363490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2182a515-9f7c-4d29-8786-d85c8a26f732-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-54c01305-5z2fg\" (UID: \"2182a515-9f7c-4d29-8786-d85c8a26f732\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"
Jul 22 14:19:59.464145 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:59.464108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2182a515-9f7c-4d29-8786-d85c8a26f732-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-54c01305-5z2fg\" (UID: \"2182a515-9f7c-4d29-8786-d85c8a26f732\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"
Jul 22 14:19:59.464766 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:59.464740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2182a515-9f7c-4d29-8786-d85c8a26f732-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-54c01305-5z2fg\" (UID: \"2182a515-9f7c-4d29-8786-d85c8a26f732\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"
Jul 22 14:19:59.640121 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:59.640025    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"
Jul 22 14:19:59.779412 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:19:59.779383    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"]
Jul 22 14:19:59.782047 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:19:59.782009    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2182a515_9f7c_4d29_8786_d85c8a26f732.slice/crio-e9e00afb80d9bad8b90bb01e828074bb1cfc4953e63387d048ab9fae7f32b389 WatchSource:0}: Error finding container e9e00afb80d9bad8b90bb01e828074bb1cfc4953e63387d048ab9fae7f32b389: Status 404 returned error can't find the container with id e9e00afb80d9bad8b90bb01e828074bb1cfc4953e63387d048ab9fae7f32b389
Jul 22 14:20:00.738205 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:00.738176    2578 generic.go:356] "Generic (PLEG): container finished" podID="2182a515-9f7c-4d29-8786-d85c8a26f732" containerID="a4c816136cb40c7835aa0d425cf4702ca4e3445f8ba69dda0377a565431281ad" exitCode=0
Jul 22 14:20:00.738585 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:00.738266    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg" event={"ID":"2182a515-9f7c-4d29-8786-d85c8a26f732","Type":"ContainerDied","Data":"a4c816136cb40c7835aa0d425cf4702ca4e3445f8ba69dda0377a565431281ad"}
Jul 22 14:20:00.738585 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:00.738314    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg" event={"ID":"2182a515-9f7c-4d29-8786-d85c8a26f732","Type":"ContainerStarted","Data":"e9e00afb80d9bad8b90bb01e828074bb1cfc4953e63387d048ab9fae7f32b389"}
Jul 22 14:20:01.873802 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:01.873772    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"
Jul 22 14:20:01.988694 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:01.988659    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2182a515-9f7c-4d29-8786-d85c8a26f732-maas-api-service-ca\") pod \"2182a515-9f7c-4d29-8786-d85c8a26f732\" (UID: \"2182a515-9f7c-4d29-8786-d85c8a26f732\") "
Jul 22 14:20:01.989030 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:01.989004    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2182a515-9f7c-4d29-8786-d85c8a26f732-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2182a515-9f7c-4d29-8786-d85c8a26f732" (UID: "2182a515-9f7c-4d29-8786-d85c8a26f732"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:20:02.089449 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:02.089415    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2182a515-9f7c-4d29-8786-d85c8a26f732-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:20:02.748970 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:02.748932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg" event={"ID":"2182a515-9f7c-4d29-8786-d85c8a26f732","Type":"ContainerDied","Data":"e9e00afb80d9bad8b90bb01e828074bb1cfc4953e63387d048ab9fae7f32b389"}
Jul 22 14:20:02.748970 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:02.748963    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"
Jul 22 14:20:02.749208 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:02.748984    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9e00afb80d9bad8b90bb01e828074bb1cfc4953e63387d048ab9fae7f32b389"
Jul 22 14:20:14.926288 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:14.926248    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"]
Jul 22 14:20:14.926921 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:14.926557    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z" podUID="328e5da3-da6f-4685-ac18-a259acee3e6c" containerName="maas-api" containerID="cri-o://64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876" gracePeriod=30
Jul 22 14:20:15.172595 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.172571    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:20:15.296041 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.296009    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/328e5da3-da6f-4685-ac18-a259acee3e6c-maas-api-tls\") pod \"328e5da3-da6f-4685-ac18-a259acee3e6c\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") "
Jul 22 14:20:15.296227 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.296115    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/328e5da3-da6f-4685-ac18-a259acee3e6c-openshift-service-ca\") pod \"328e5da3-da6f-4685-ac18-a259acee3e6c\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") "
Jul 22 14:20:15.296227 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.296191    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4mh8\" (UniqueName: \"kubernetes.io/projected/328e5da3-da6f-4685-ac18-a259acee3e6c-kube-api-access-t4mh8\") pod \"328e5da3-da6f-4685-ac18-a259acee3e6c\" (UID: \"328e5da3-da6f-4685-ac18-a259acee3e6c\") "
Jul 22 14:20:15.296479 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.296453    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/328e5da3-da6f-4685-ac18-a259acee3e6c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "328e5da3-da6f-4685-ac18-a259acee3e6c" (UID: "328e5da3-da6f-4685-ac18-a259acee3e6c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:20:15.298389 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.298358    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/328e5da3-da6f-4685-ac18-a259acee3e6c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "328e5da3-da6f-4685-ac18-a259acee3e6c" (UID: "328e5da3-da6f-4685-ac18-a259acee3e6c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:20:15.298507 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.298385    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/328e5da3-da6f-4685-ac18-a259acee3e6c-kube-api-access-t4mh8" (OuterVolumeSpecName: "kube-api-access-t4mh8") pod "328e5da3-da6f-4685-ac18-a259acee3e6c" (UID: "328e5da3-da6f-4685-ac18-a259acee3e6c"). InnerVolumeSpecName "kube-api-access-t4mh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:20:15.396814 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.396788    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4mh8\" (UniqueName: \"kubernetes.io/projected/328e5da3-da6f-4685-ac18-a259acee3e6c-kube-api-access-t4mh8\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:20:15.396814 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.396811    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/328e5da3-da6f-4685-ac18-a259acee3e6c-maas-api-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:20:15.396945 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.396822    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/328e5da3-da6f-4685-ac18-a259acee3e6c-openshift-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:20:15.808921 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.808888    2578 generic.go:356] "Generic (PLEG): container finished" podID="328e5da3-da6f-4685-ac18-a259acee3e6c" containerID="64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876" exitCode=0
Jul 22 14:20:15.809114 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.808934    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"
Jul 22 14:20:15.809114 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.808974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z" event={"ID":"328e5da3-da6f-4685-ac18-a259acee3e6c","Type":"ContainerDied","Data":"64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876"}
Jul 22 14:20:15.809114 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.809043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z" event={"ID":"328e5da3-da6f-4685-ac18-a259acee3e6c","Type":"ContainerDied","Data":"dc6d270fe1b93f9cdccb3e605d43d1475b2f7431740f7bf2c95fab6bd3f6f988"}
Jul 22 14:20:15.809114 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.809073    2578 scope.go:117] "RemoveContainer" containerID="64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876"
Jul 22 14:20:15.818273 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.818255    2578 scope.go:117] "RemoveContainer" containerID="64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876"
Jul 22 14:20:15.818574 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:20:15.818555    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876\": container with ID starting with 64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876 not found: ID does not exist" containerID="64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876"
Jul 22 14:20:15.818635 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.818583    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876"} err="failed to get container status \"64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876\": rpc error: code = NotFound desc = could not find container \"64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876\": container with ID starting with 64af2bd56e6891d556c0e557a8962461a3db1fb92b971ba250788aefebb20876 not found: ID does not exist"
Jul 22 14:20:15.829022 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.828999    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"]
Jul 22 14:20:15.835568 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:15.835548    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-54c01305-76654557c4-nzx8z"]
Jul 22 14:20:16.254102 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:16.254030    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="328e5da3-da6f-4685-ac18-a259acee3e6c" path="/var/lib/kubelet/pods/328e5da3-da6f-4685-ac18-a259acee3e6c/volumes"
Jul 22 14:20:19.427999 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:19.427966    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"]
Jul 22 14:20:19.429508 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:19.429485    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-54c01305-5z2fg"]
Jul 22 14:20:20.257785 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:20:20.257754    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2182a515-9f7c-4d29-8786-d85c8a26f732" path="/var/lib/kubelet/pods/2182a515-9f7c-4d29-8786-d85c8a26f732/volumes"
Jul 22 14:21:16.322541 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:21:16.322514    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:21:16.325877 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:21:16.325857    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:21:16.375267 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:21:16.375242    2578 scope.go:117] "RemoveContainer" containerID="30a2323ed7935e19d92c09c0b0887f67b1320e00ca70140b1f628309db6b295a"
Jul 22 14:21:16.383498 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:21:16.383480    2578 scope.go:117] "RemoveContainer" containerID="4cf58cee408a82d53cf9417ee3e645ba534d457740dac26585e7608422478676"
Jul 22 14:21:16.391188 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:21:16.391170    2578 scope.go:117] "RemoveContainer" containerID="d971da00ed4ef54331e0db58096b73ca74599e41b17f1160f16c57188d8afa9f"
Jul 22 14:22:15.587305 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.587232    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"]
Jul 22 14:22:15.587771 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.587591    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2182a515-9f7c-4d29-8786-d85c8a26f732" containerName="revoke-keys"
Jul 22 14:22:15.587771 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.587604    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2182a515-9f7c-4d29-8786-d85c8a26f732" containerName="revoke-keys"
Jul 22 14:22:15.587771 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.587614    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="328e5da3-da6f-4685-ac18-a259acee3e6c" containerName="maas-api"
Jul 22 14:22:15.587771 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.587621    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="328e5da3-da6f-4685-ac18-a259acee3e6c" containerName="maas-api"
Jul 22 14:22:15.587771 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.587690    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="328e5da3-da6f-4685-ac18-a259acee3e6c" containerName="maas-api"
Jul 22 14:22:15.587771 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.587699    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2182a515-9f7c-4d29-8786-d85c8a26f732" containerName="revoke-keys"
Jul 22 14:22:15.590709 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.590678    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:15.592767 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.592746    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-53a937-serving-cert\""
Jul 22 14:22:15.592869 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.592769    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tpv8w\""
Jul 22 14:22:15.592869 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.592786    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 14:22:15.593414 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.593395    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 14:22:15.600476 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.599775    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"]
Jul 22 14:22:15.641296 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.641263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c167131-ea6f-4de7-baff-9e84809a87d9-maas-api-tls\") pod \"maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:15.641458 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.641306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c167131-ea6f-4de7-baff-9e84809a87d9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:15.641458 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.641374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pgvw\" (UniqueName: \"kubernetes.io/projected/8c167131-ea6f-4de7-baff-9e84809a87d9-kube-api-access-5pgvw\") pod \"maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:15.742091 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.742062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c167131-ea6f-4de7-baff-9e84809a87d9-maas-api-tls\") pod \"maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:15.742254 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.742098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c167131-ea6f-4de7-baff-9e84809a87d9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:15.742254 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.742189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pgvw\" (UniqueName: \"kubernetes.io/projected/8c167131-ea6f-4de7-baff-9e84809a87d9-kube-api-access-5pgvw\") pod \"maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:15.742254 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:22:15.742239    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-serving-cert: secret "maas-api-e2e-inf-a-53a937-serving-cert" not found
Jul 22 14:22:15.742366 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:22:15.742298    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c167131-ea6f-4de7-baff-9e84809a87d9-maas-api-tls podName:8c167131-ea6f-4de7-baff-9e84809a87d9 nodeName:}" failed. No retries permitted until 2026-07-22 14:22:16.242279972 +0000 UTC m=+2160.484374926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8c167131-ea6f-4de7-baff-9e84809a87d9-maas-api-tls") pod "maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd" (UID: "8c167131-ea6f-4de7-baff-9e84809a87d9") : secret "maas-api-e2e-inf-a-53a937-serving-cert" not found
Jul 22 14:22:15.742724 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.742704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c167131-ea6f-4de7-baff-9e84809a87d9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:15.752955 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:15.752927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pgvw\" (UniqueName: \"kubernetes.io/projected/8c167131-ea6f-4de7-baff-9e84809a87d9-kube-api-access-5pgvw\") pod \"maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:16.246409 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:16.246378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c167131-ea6f-4de7-baff-9e84809a87d9-maas-api-tls\") pod \"maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:16.249023 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:16.248984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c167131-ea6f-4de7-baff-9e84809a87d9-maas-api-tls\") pod \"maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:16.418980 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:16.418949    2578 scope.go:117] "RemoveContainer" containerID="bd697220d0ef7d93aa07f48f080c48d5c0ba01c12593d2e2107b2e8a38f0b3a9"
Jul 22 14:22:16.506377 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:16.506311    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tpv8w\""
Jul 22 14:22:16.514200 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:16.514180    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:16.656346 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:16.656323    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"]
Jul 22 14:22:16.658253 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:22:16.658217    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c167131_ea6f_4de7_baff_9e84809a87d9.slice/crio-f31e5a34ee331bc1dfb2bb43c978593aa99d634fefb19ee68307edbd68dbff2a WatchSource:0}: Error finding container f31e5a34ee331bc1dfb2bb43c978593aa99d634fefb19ee68307edbd68dbff2a: Status 404 returned error can't find the container with id f31e5a34ee331bc1dfb2bb43c978593aa99d634fefb19ee68307edbd68dbff2a
Jul 22 14:22:16.659743 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:16.659725    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 14:22:17.354215 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:17.354173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd" event={"ID":"8c167131-ea6f-4de7-baff-9e84809a87d9","Type":"ContainerStarted","Data":"f31e5a34ee331bc1dfb2bb43c978593aa99d634fefb19ee68307edbd68dbff2a"}
Jul 22 14:22:18.359470 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:18.359432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd" event={"ID":"8c167131-ea6f-4de7-baff-9e84809a87d9","Type":"ContainerStarted","Data":"2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75"}
Jul 22 14:22:18.359833 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:18.359537    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:18.378714 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:18.378670    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd" podStartSLOduration=2.544017107 podStartE2EDuration="3.378655679s" totalImagesPullingTime="834.638572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:22:18.377928529 +0000 UTC m=+2162.620023495" watchObservedRunningTime="2026-07-22 14:22:18.378655679 +0000 UTC m=+2162.620750645"
Jul 22 14:22:23.669521 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.669485    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"]
Jul 22 14:22:23.673434 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.673415    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:23.676210 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.676185    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-13629f-serving-cert\""
Jul 22 14:22:23.684698 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.684677    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"]
Jul 22 14:22:23.808979 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.808944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swsks\" (UniqueName: \"kubernetes.io/projected/d836dbec-a78d-49dc-8cfe-4a45fbb73687-kube-api-access-swsks\") pod \"maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:23.809196 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.809009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d836dbec-a78d-49dc-8cfe-4a45fbb73687-openshift-service-ca\") pod \"maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:23.809196 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.809157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls\") pod \"maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:23.909793 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.909761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swsks\" (UniqueName: \"kubernetes.io/projected/d836dbec-a78d-49dc-8cfe-4a45fbb73687-kube-api-access-swsks\") pod \"maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:23.909997 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.909847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d836dbec-a78d-49dc-8cfe-4a45fbb73687-openshift-service-ca\") pod \"maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:23.909997 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.909914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls\") pod \"maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:23.910148 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:22:23.910044    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-serving-cert: secret "maas-api-e2e-inf-b-13629f-serving-cert" not found
Jul 22 14:22:23.910211 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:22:23.910157    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls podName:d836dbec-a78d-49dc-8cfe-4a45fbb73687 nodeName:}" failed. No retries permitted until 2026-07-22 14:22:24.410096956 +0000 UTC m=+2168.652191901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls") pod "maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv" (UID: "d836dbec-a78d-49dc-8cfe-4a45fbb73687") : secret "maas-api-e2e-inf-b-13629f-serving-cert" not found
Jul 22 14:22:23.910742 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.910718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d836dbec-a78d-49dc-8cfe-4a45fbb73687-openshift-service-ca\") pod \"maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:23.920835 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:23.920781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swsks\" (UniqueName: \"kubernetes.io/projected/d836dbec-a78d-49dc-8cfe-4a45fbb73687-kube-api-access-swsks\") pod \"maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:24.370783 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:24.370753    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:22:24.414186 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:24.414035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls\") pod \"maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:24.414366 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:22:24.414275    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-serving-cert: secret "maas-api-e2e-inf-b-13629f-serving-cert" not found
Jul 22 14:22:24.414366 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:22:24.414337    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls podName:d836dbec-a78d-49dc-8cfe-4a45fbb73687 nodeName:}" failed. No retries permitted until 2026-07-22 14:22:25.414318781 +0000 UTC m=+2169.656413729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls") pod "maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv" (UID: "d836dbec-a78d-49dc-8cfe-4a45fbb73687") : secret "maas-api-e2e-inf-b-13629f-serving-cert" not found
Jul 22 14:22:25.423824 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:25.423787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls\") pod \"maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:25.426525 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:25.426493    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls\") pod \"maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:25.485412 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:25.485388    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:25.623545 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:25.623512    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"]
Jul 22 14:22:25.625891 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:22:25.625863    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd836dbec_a78d_49dc_8cfe_4a45fbb73687.slice/crio-0e9f5f3164bceffc92b88fc381357a5e17e7bb27f9f09b8a00443a4e26799802 WatchSource:0}: Error finding container 0e9f5f3164bceffc92b88fc381357a5e17e7bb27f9f09b8a00443a4e26799802: Status 404 returned error can't find the container with id 0e9f5f3164bceffc92b88fc381357a5e17e7bb27f9f09b8a00443a4e26799802
Jul 22 14:22:26.396539 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:26.396498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv" event={"ID":"d836dbec-a78d-49dc-8cfe-4a45fbb73687","Type":"ContainerStarted","Data":"3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975"}
Jul 22 14:22:26.396735 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:26.396549    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv" event={"ID":"d836dbec-a78d-49dc-8cfe-4a45fbb73687","Type":"ContainerStarted","Data":"0e9f5f3164bceffc92b88fc381357a5e17e7bb27f9f09b8a00443a4e26799802"}
Jul 22 14:22:26.396735 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:26.396613    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:22:26.414554 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:26.414502    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv" podStartSLOduration=3.071675279 podStartE2EDuration="3.414482435s" totalImagesPullingTime="342.807156ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:22:26.413610785 +0000 UTC m=+2170.655705838" watchObservedRunningTime="2026-07-22 14:22:26.414482435 +0000 UTC m=+2170.656577399"
Jul 22 14:22:32.407078 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:22:32.407047    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:23:16.437992 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:23:16.437962    2578 scope.go:117] "RemoveContainer" containerID="e3d1832feabc79a0b9c443b3074fc8fc55ce7582e0b98f0edf3a6dc614bb2ab6"
Jul 22 14:24:24.854810 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:24.854776    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"]
Jul 22 14:24:24.858018 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:24.858000    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"
Jul 22 14:24:24.860200 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:24.860178    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:24:24.866036 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:24.865920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"]
Jul 22 14:24:24.974868 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:24.974822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c0bb1e1-7b13-41c8-99c2-1037e1b9715a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-53a937-5sk89\" (UID: \"9c0bb1e1-7b13-41c8-99c2-1037e1b9715a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"
Jul 22 14:24:25.076333 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:25.076295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c0bb1e1-7b13-41c8-99c2-1037e1b9715a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-53a937-5sk89\" (UID: \"9c0bb1e1-7b13-41c8-99c2-1037e1b9715a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"
Jul 22 14:24:25.077004 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:25.076977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c0bb1e1-7b13-41c8-99c2-1037e1b9715a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-53a937-5sk89\" (UID: \"9c0bb1e1-7b13-41c8-99c2-1037e1b9715a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"
Jul 22 14:24:25.170411 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:25.170298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"
Jul 22 14:24:25.312322 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:25.312297    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"]
Jul 22 14:24:25.314840 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:24:25.314812    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0bb1e1_7b13_41c8_99c2_1037e1b9715a.slice/crio-dd6daf17e56b5433f404305a2867ce4d696502467ed3f2ea4af521cc00636364 WatchSource:0}: Error finding container dd6daf17e56b5433f404305a2867ce4d696502467ed3f2ea4af521cc00636364: Status 404 returned error can't find the container with id dd6daf17e56b5433f404305a2867ce4d696502467ed3f2ea4af521cc00636364
Jul 22 14:24:25.936389 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:25.936287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89" event={"ID":"9c0bb1e1-7b13-41c8-99c2-1037e1b9715a","Type":"ContainerStarted","Data":"5a3f8451cf256c04200b9979a1558131c50019c4d50d30711ae46f3b780c5cbd"}
Jul 22 14:24:25.936761 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:25.936388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89" event={"ID":"9c0bb1e1-7b13-41c8-99c2-1037e1b9715a","Type":"ContainerStarted","Data":"dd6daf17e56b5433f404305a2867ce4d696502467ed3f2ea4af521cc00636364"}
Jul 22 14:24:25.956577 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:25.956527    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89" podStartSLOduration=1.956513267 podStartE2EDuration="1.956513267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:24:25.95553325 +0000 UTC m=+2290.197628225" watchObservedRunningTime="2026-07-22 14:24:25.956513267 +0000 UTC m=+2290.198608264"
Jul 22 14:24:26.942658 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:26.942620    2578 generic.go:356] "Generic (PLEG): container finished" podID="9c0bb1e1-7b13-41c8-99c2-1037e1b9715a" containerID="5a3f8451cf256c04200b9979a1558131c50019c4d50d30711ae46f3b780c5cbd" exitCode=0
Jul 22 14:24:26.942658 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:26.942662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89" event={"ID":"9c0bb1e1-7b13-41c8-99c2-1037e1b9715a","Type":"ContainerDied","Data":"5a3f8451cf256c04200b9979a1558131c50019c4d50d30711ae46f3b780c5cbd"}
Jul 22 14:24:28.085124 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:28.085100    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"
Jul 22 14:24:28.205266 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:28.205159    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c0bb1e1-7b13-41c8-99c2-1037e1b9715a-maas-api-service-ca\") pod \"9c0bb1e1-7b13-41c8-99c2-1037e1b9715a\" (UID: \"9c0bb1e1-7b13-41c8-99c2-1037e1b9715a\") "
Jul 22 14:24:28.205484 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:28.205461    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c0bb1e1-7b13-41c8-99c2-1037e1b9715a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9c0bb1e1-7b13-41c8-99c2-1037e1b9715a" (UID: "9c0bb1e1-7b13-41c8-99c2-1037e1b9715a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:24:28.306576 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:28.306541    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c0bb1e1-7b13-41c8-99c2-1037e1b9715a-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:24:28.953996 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:28.953958    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89" event={"ID":"9c0bb1e1-7b13-41c8-99c2-1037e1b9715a","Type":"ContainerDied","Data":"dd6daf17e56b5433f404305a2867ce4d696502467ed3f2ea4af521cc00636364"}
Jul 22 14:24:28.954191 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:28.954011    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd6daf17e56b5433f404305a2867ce4d696502467ed3f2ea4af521cc00636364"
Jul 22 14:24:28.954191 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:28.953972    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"
Jul 22 14:24:35.302931 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.302882    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"]
Jul 22 14:24:35.303467 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.303342    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd" podUID="8c167131-ea6f-4de7-baff-9e84809a87d9" containerName="maas-api" containerID="cri-o://2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75" gracePeriod=30
Jul 22 14:24:35.559114 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.559052    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:24:35.676188 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.676119    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c167131-ea6f-4de7-baff-9e84809a87d9-maas-api-tls\") pod \"8c167131-ea6f-4de7-baff-9e84809a87d9\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") "
Jul 22 14:24:35.676366 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.676247    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pgvw\" (UniqueName: \"kubernetes.io/projected/8c167131-ea6f-4de7-baff-9e84809a87d9-kube-api-access-5pgvw\") pod \"8c167131-ea6f-4de7-baff-9e84809a87d9\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") "
Jul 22 14:24:35.676366 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.676280    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c167131-ea6f-4de7-baff-9e84809a87d9-openshift-service-ca\") pod \"8c167131-ea6f-4de7-baff-9e84809a87d9\" (UID: \"8c167131-ea6f-4de7-baff-9e84809a87d9\") "
Jul 22 14:24:35.676666 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.676640    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c167131-ea6f-4de7-baff-9e84809a87d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8c167131-ea6f-4de7-baff-9e84809a87d9" (UID: "8c167131-ea6f-4de7-baff-9e84809a87d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:24:35.678407 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.678376    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c167131-ea6f-4de7-baff-9e84809a87d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8c167131-ea6f-4de7-baff-9e84809a87d9" (UID: "8c167131-ea6f-4de7-baff-9e84809a87d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:24:35.678518 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.678494    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c167131-ea6f-4de7-baff-9e84809a87d9-kube-api-access-5pgvw" (OuterVolumeSpecName: "kube-api-access-5pgvw") pod "8c167131-ea6f-4de7-baff-9e84809a87d9" (UID: "8c167131-ea6f-4de7-baff-9e84809a87d9"). InnerVolumeSpecName "kube-api-access-5pgvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:24:35.777642 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.777595    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pgvw\" (UniqueName: \"kubernetes.io/projected/8c167131-ea6f-4de7-baff-9e84809a87d9-kube-api-access-5pgvw\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:24:35.777642 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.777632    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c167131-ea6f-4de7-baff-9e84809a87d9-openshift-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:24:35.777642 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.777642    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c167131-ea6f-4de7-baff-9e84809a87d9-maas-api-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:24:35.987389 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.987302    2578 generic.go:356] "Generic (PLEG): container finished" podID="8c167131-ea6f-4de7-baff-9e84809a87d9" containerID="2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75" exitCode=0
Jul 22 14:24:35.987389 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.987352    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"
Jul 22 14:24:35.987622 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.987355    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd" event={"ID":"8c167131-ea6f-4de7-baff-9e84809a87d9","Type":"ContainerDied","Data":"2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75"}
Jul 22 14:24:35.987622 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.987468    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd" event={"ID":"8c167131-ea6f-4de7-baff-9e84809a87d9","Type":"ContainerDied","Data":"f31e5a34ee331bc1dfb2bb43c978593aa99d634fefb19ee68307edbd68dbff2a"}
Jul 22 14:24:35.987622 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.987511    2578 scope.go:117] "RemoveContainer" containerID="2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75"
Jul 22 14:24:35.996426 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.996406    2578 scope.go:117] "RemoveContainer" containerID="2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75"
Jul 22 14:24:35.996715 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:24:35.996696    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75\": container with ID starting with 2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75 not found: ID does not exist" containerID="2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75"
Jul 22 14:24:35.996757 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:35.996724    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75"} err="failed to get container status \"2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75\": rpc error: code = NotFound desc = could not find container \"2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75\": container with ID starting with 2a3609823901af4532916beb3f3b65efaa02ff4c9a492106616417dea922dd75 not found: ID does not exist"
Jul 22 14:24:36.009377 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:36.009343    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"]
Jul 22 14:24:36.011740 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:36.011713    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53a937-56784c8b5c-2fdcd"]
Jul 22 14:24:36.254690 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:36.254614    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c167131-ea6f-4de7-baff-9e84809a87d9" path="/var/lib/kubelet/pods/8c167131-ea6f-4de7-baff-9e84809a87d9/volumes"
Jul 22 14:24:39.962402 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:39.962360    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"]
Jul 22 14:24:39.965863 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:39.965836    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-53a937-5sk89"]
Jul 22 14:24:40.254845 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:40.254764    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c0bb1e1-7b13-41c8-99c2-1037e1b9715a" path="/var/lib/kubelet/pods/9c0bb1e1-7b13-41c8-99c2-1037e1b9715a/volumes"
Jul 22 14:24:47.049174 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.049145    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"]
Jul 22 14:24:47.049540 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.049460    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0bb1e1-7b13-41c8-99c2-1037e1b9715a" containerName="revoke-keys"
Jul 22 14:24:47.049540 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.049471    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0bb1e1-7b13-41c8-99c2-1037e1b9715a" containerName="revoke-keys"
Jul 22 14:24:47.049540 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.049483    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c167131-ea6f-4de7-baff-9e84809a87d9" containerName="maas-api"
Jul 22 14:24:47.049540 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.049489    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c167131-ea6f-4de7-baff-9e84809a87d9" containerName="maas-api"
Jul 22 14:24:47.049540 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.049539    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c0bb1e1-7b13-41c8-99c2-1037e1b9715a" containerName="revoke-keys"
Jul 22 14:24:47.049704 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.049546    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c167131-ea6f-4de7-baff-9e84809a87d9" containerName="maas-api"
Jul 22 14:24:47.053904 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.053884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"
Jul 22 14:24:47.055948 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.055925    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:24:47.060786 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.060759    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"]
Jul 22 14:24:47.078625 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.078593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f09cbb8-2bd3-4572-8f8a-98a0994239a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-13629f-n2szt\" (UID: \"7f09cbb8-2bd3-4572-8f8a-98a0994239a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"
Jul 22 14:24:47.179744 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.179714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f09cbb8-2bd3-4572-8f8a-98a0994239a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-13629f-n2szt\" (UID: \"7f09cbb8-2bd3-4572-8f8a-98a0994239a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"
Jul 22 14:24:47.180355 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.180335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f09cbb8-2bd3-4572-8f8a-98a0994239a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-13629f-n2szt\" (UID: \"7f09cbb8-2bd3-4572-8f8a-98a0994239a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"
Jul 22 14:24:47.365942 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.365871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"
Jul 22 14:24:47.520948 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:47.520920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"]
Jul 22 14:24:47.522660 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:24:47.522633    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f09cbb8_2bd3_4572_8f8a_98a0994239a4.slice/crio-04247d457e52d534832b8eb8082409f0c3e0e6e0b0a6a1f8cb7dbb117ad6b7cb WatchSource:0}: Error finding container 04247d457e52d534832b8eb8082409f0c3e0e6e0b0a6a1f8cb7dbb117ad6b7cb: Status 404 returned error can't find the container with id 04247d457e52d534832b8eb8082409f0c3e0e6e0b0a6a1f8cb7dbb117ad6b7cb
Jul 22 14:24:48.050696 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:48.050662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt" event={"ID":"7f09cbb8-2bd3-4572-8f8a-98a0994239a4","Type":"ContainerStarted","Data":"8748f800e9201de44560a63433e9d4a1dbcc779a66b0167be4f5b4a45d04b503"}
Jul 22 14:24:48.051068 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:48.050712    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt" event={"ID":"7f09cbb8-2bd3-4572-8f8a-98a0994239a4","Type":"ContainerStarted","Data":"04247d457e52d534832b8eb8082409f0c3e0e6e0b0a6a1f8cb7dbb117ad6b7cb"}
Jul 22 14:24:48.065996 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:48.065944    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt" podStartSLOduration=1.065926384 podStartE2EDuration="1.065926384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:24:48.065906231 +0000 UTC m=+2312.308001197" watchObservedRunningTime="2026-07-22 14:24:48.065926384 +0000 UTC m=+2312.308021350"
Jul 22 14:24:49.056297 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:49.056260    2578 generic.go:356] "Generic (PLEG): container finished" podID="7f09cbb8-2bd3-4572-8f8a-98a0994239a4" containerID="8748f800e9201de44560a63433e9d4a1dbcc779a66b0167be4f5b4a45d04b503" exitCode=0
Jul 22 14:24:49.056660 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:49.056348    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt" event={"ID":"7f09cbb8-2bd3-4572-8f8a-98a0994239a4","Type":"ContainerDied","Data":"8748f800e9201de44560a63433e9d4a1dbcc779a66b0167be4f5b4a45d04b503"}
Jul 22 14:24:50.195855 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:50.195831    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"
Jul 22 14:24:50.308458 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:50.308432    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f09cbb8-2bd3-4572-8f8a-98a0994239a4-maas-api-service-ca\") pod \"7f09cbb8-2bd3-4572-8f8a-98a0994239a4\" (UID: \"7f09cbb8-2bd3-4572-8f8a-98a0994239a4\") "
Jul 22 14:24:50.308950 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:50.308804    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f09cbb8-2bd3-4572-8f8a-98a0994239a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7f09cbb8-2bd3-4572-8f8a-98a0994239a4" (UID: "7f09cbb8-2bd3-4572-8f8a-98a0994239a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:24:50.409900 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:50.409838    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f09cbb8-2bd3-4572-8f8a-98a0994239a4-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:24:51.066916 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:51.066883    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt" event={"ID":"7f09cbb8-2bd3-4572-8f8a-98a0994239a4","Type":"ContainerDied","Data":"04247d457e52d534832b8eb8082409f0c3e0e6e0b0a6a1f8cb7dbb117ad6b7cb"}
Jul 22 14:24:51.066916 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:51.066913    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"
Jul 22 14:24:51.067118 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:51.066935    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04247d457e52d534832b8eb8082409f0c3e0e6e0b0a6a1f8cb7dbb117ad6b7cb"
Jul 22 14:24:57.473781 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.473747    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"]
Jul 22 14:24:57.474607 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.473953    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv" podUID="d836dbec-a78d-49dc-8cfe-4a45fbb73687" containerName="maas-api" containerID="cri-o://3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975" gracePeriod=30
Jul 22 14:24:57.734577 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.734503    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:24:57.775879 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.775839    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d836dbec-a78d-49dc-8cfe-4a45fbb73687-openshift-service-ca\") pod \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") "
Jul 22 14:24:57.776063 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.775898    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swsks\" (UniqueName: \"kubernetes.io/projected/d836dbec-a78d-49dc-8cfe-4a45fbb73687-kube-api-access-swsks\") pod \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") "
Jul 22 14:24:57.776163 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.776067    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls\") pod \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\" (UID: \"d836dbec-a78d-49dc-8cfe-4a45fbb73687\") "
Jul 22 14:24:57.776266 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.776239    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d836dbec-a78d-49dc-8cfe-4a45fbb73687-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d836dbec-a78d-49dc-8cfe-4a45fbb73687" (UID: "d836dbec-a78d-49dc-8cfe-4a45fbb73687"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:24:57.776432 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.776407    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d836dbec-a78d-49dc-8cfe-4a45fbb73687-openshift-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:24:57.778233 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.778203    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d836dbec-a78d-49dc-8cfe-4a45fbb73687-kube-api-access-swsks" (OuterVolumeSpecName: "kube-api-access-swsks") pod "d836dbec-a78d-49dc-8cfe-4a45fbb73687" (UID: "d836dbec-a78d-49dc-8cfe-4a45fbb73687"). InnerVolumeSpecName "kube-api-access-swsks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:24:57.778323 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.778240    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d836dbec-a78d-49dc-8cfe-4a45fbb73687" (UID: "d836dbec-a78d-49dc-8cfe-4a45fbb73687"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:24:57.877080 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.877041    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swsks\" (UniqueName: \"kubernetes.io/projected/d836dbec-a78d-49dc-8cfe-4a45fbb73687-kube-api-access-swsks\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:24:57.877080 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:57.877073    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d836dbec-a78d-49dc-8cfe-4a45fbb73687-maas-api-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:24:58.100748 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:58.100712    2578 generic.go:356] "Generic (PLEG): container finished" podID="d836dbec-a78d-49dc-8cfe-4a45fbb73687" containerID="3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975" exitCode=0
Jul 22 14:24:58.100935 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:58.100810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv" event={"ID":"d836dbec-a78d-49dc-8cfe-4a45fbb73687","Type":"ContainerDied","Data":"3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975"}
Jul 22 14:24:58.100935 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:58.100860    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv" event={"ID":"d836dbec-a78d-49dc-8cfe-4a45fbb73687","Type":"ContainerDied","Data":"0e9f5f3164bceffc92b88fc381357a5e17e7bb27f9f09b8a00443a4e26799802"}
Jul 22 14:24:58.100935 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:58.100892    2578 scope.go:117] "RemoveContainer" containerID="3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975"
Jul 22 14:24:58.100935 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:58.100815    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"
Jul 22 14:24:58.109549 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:58.109527    2578 scope.go:117] "RemoveContainer" containerID="3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975"
Jul 22 14:24:58.109814 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:24:58.109796    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975\": container with ID starting with 3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975 not found: ID does not exist" containerID="3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975"
Jul 22 14:24:58.109886 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:58.109826    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975"} err="failed to get container status \"3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975\": rpc error: code = NotFound desc = could not find container \"3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975\": container with ID starting with 3b4b02a8b409f6c120d0679fcae77f6c9ba303de7977517a59384bc1e3ed9975 not found: ID does not exist"
Jul 22 14:24:58.124250 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:58.124220    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"]
Jul 22 14:24:58.130657 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:58.130629    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-13629f-86cf664c6f-wn5pv"]
Jul 22 14:24:58.253251 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:24:58.253221    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d836dbec-a78d-49dc-8cfe-4a45fbb73687" path="/var/lib/kubelet/pods/d836dbec-a78d-49dc-8cfe-4a45fbb73687/volumes"
Jul 22 14:25:02.130775 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:02.130738    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"]
Jul 22 14:25:02.132512 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:02.132488    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-13629f-n2szt"]
Jul 22 14:25:02.254287 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:02.254256    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f09cbb8-2bd3-4572-8f8a-98a0994239a4" path="/var/lib/kubelet/pods/7f09cbb8-2bd3-4572-8f8a-98a0994239a4/volumes"
Jul 22 14:25:12.754282 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.754189    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"]
Jul 22 14:25:12.754735 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.754605    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d836dbec-a78d-49dc-8cfe-4a45fbb73687" containerName="maas-api"
Jul 22 14:25:12.754735 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.754617    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d836dbec-a78d-49dc-8cfe-4a45fbb73687" containerName="maas-api"
Jul 22 14:25:12.754735 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.754628    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f09cbb8-2bd3-4572-8f8a-98a0994239a4" containerName="revoke-keys"
Jul 22 14:25:12.754735 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.754638    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f09cbb8-2bd3-4572-8f8a-98a0994239a4" containerName="revoke-keys"
Jul 22 14:25:12.754735 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.754710    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d836dbec-a78d-49dc-8cfe-4a45fbb73687" containerName="maas-api"
Jul 22 14:25:12.754735 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.754727    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f09cbb8-2bd3-4572-8f8a-98a0994239a4" containerName="revoke-keys"
Jul 22 14:25:12.759003 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.758983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:12.761626 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.761562    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c0776d-serving-cert\""
Jul 22 14:25:12.761626 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.761591    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tpv8w\""
Jul 22 14:25:12.761626 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.761576    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 14:25:12.761870 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.761571    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 14:25:12.768482 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.768450    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"]
Jul 22 14:25:12.912073 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.912038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l8f7\" (UniqueName: \"kubernetes.io/projected/cf440460-2891-422f-89a8-071e974097ef-kube-api-access-2l8f7\") pod \"maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:12.912073 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.912079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf440460-2891-422f-89a8-071e974097ef-maas-api-tls\") pod \"maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:12.912281 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:12.912128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf440460-2891-422f-89a8-071e974097ef-openshift-service-ca\") pod \"maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:13.013401 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:13.013328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l8f7\" (UniqueName: \"kubernetes.io/projected/cf440460-2891-422f-89a8-071e974097ef-kube-api-access-2l8f7\") pod \"maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:13.013401 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:13.013371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf440460-2891-422f-89a8-071e974097ef-maas-api-tls\") pod \"maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:13.013401 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:13.013406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf440460-2891-422f-89a8-071e974097ef-openshift-service-ca\") pod \"maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:13.013990 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:13.013967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf440460-2891-422f-89a8-071e974097ef-openshift-service-ca\") pod \"maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:13.015922 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:13.015896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf440460-2891-422f-89a8-071e974097ef-maas-api-tls\") pod \"maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:13.021792 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:13.021764    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l8f7\" (UniqueName: \"kubernetes.io/projected/cf440460-2891-422f-89a8-071e974097ef-kube-api-access-2l8f7\") pod \"maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:13.071591 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:13.071569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:13.204200 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:13.204170    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"]
Jul 22 14:25:13.208378 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:25:13.208339    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf440460_2891_422f_89a8_071e974097ef.slice/crio-3960b538cbec7c1bc958c3746f2a9cac812a2037f8268fd350f39dbe3bf98c6a WatchSource:0}: Error finding container 3960b538cbec7c1bc958c3746f2a9cac812a2037f8268fd350f39dbe3bf98c6a: Status 404 returned error can't find the container with id 3960b538cbec7c1bc958c3746f2a9cac812a2037f8268fd350f39dbe3bf98c6a
Jul 22 14:25:14.179917 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:14.179886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm" event={"ID":"cf440460-2891-422f-89a8-071e974097ef","Type":"ContainerStarted","Data":"c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c"}
Jul 22 14:25:14.180311 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:14.179938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm" event={"ID":"cf440460-2891-422f-89a8-071e974097ef","Type":"ContainerStarted","Data":"3960b538cbec7c1bc958c3746f2a9cac812a2037f8268fd350f39dbe3bf98c6a"}
Jul 22 14:25:14.180311 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:14.180053    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:14.201034 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:14.200982    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm" podStartSLOduration=1.752266844 podStartE2EDuration="2.200967695s" totalImagesPullingTime="448.700851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:25:14.199624515 +0000 UTC m=+2338.441719481" watchObservedRunningTime="2026-07-22 14:25:14.200967695 +0000 UTC m=+2338.443062660"
Jul 22 14:25:16.462338 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:16.462309    2578 scope.go:117] "RemoveContainer" containerID="f239d65df167bdb62d81768de71d5ceebe58650e19404f329f296b2cb3a89848"
Jul 22 14:25:20.190865 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.190832    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:20.626115 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.626079    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"]
Jul 22 14:25:20.633428 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.633405    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:20.635434 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.635406    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-dba614-serving-cert\""
Jul 22 14:25:20.642862 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.640875    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"]
Jul 22 14:25:20.779309 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.779276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-maas-api-tls\") pod \"maas-api-e2e-api-b-dba614-6b47765c95-gfmwg\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:20.779446 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.779317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8p2k\" (UniqueName: \"kubernetes.io/projected/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-kube-api-access-f8p2k\") pod \"maas-api-e2e-api-b-dba614-6b47765c95-gfmwg\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:20.779446 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.779347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-openshift-service-ca\") pod \"maas-api-e2e-api-b-dba614-6b47765c95-gfmwg\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:20.880252 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.880175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-openshift-service-ca\") pod \"maas-api-e2e-api-b-dba614-6b47765c95-gfmwg\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:20.880398 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.880301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-maas-api-tls\") pod \"maas-api-e2e-api-b-dba614-6b47765c95-gfmwg\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:20.880398 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.880343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8p2k\" (UniqueName: \"kubernetes.io/projected/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-kube-api-access-f8p2k\") pod \"maas-api-e2e-api-b-dba614-6b47765c95-gfmwg\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:20.880516 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:25:20.880440    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-serving-cert: secret "maas-api-e2e-api-b-dba614-serving-cert" not found
Jul 22 14:25:20.880516 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:25:20.880506    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-maas-api-tls podName:5d4eec3b-7af6-487d-92a6-69dbd1a0353c nodeName:}" failed. No retries permitted until 2026-07-22 14:25:21.38049127 +0000 UTC m=+2345.622586213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-maas-api-tls") pod "maas-api-e2e-api-b-dba614-6b47765c95-gfmwg" (UID: "5d4eec3b-7af6-487d-92a6-69dbd1a0353c") : secret "maas-api-e2e-api-b-dba614-serving-cert" not found
Jul 22 14:25:20.880862 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.880839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-openshift-service-ca\") pod \"maas-api-e2e-api-b-dba614-6b47765c95-gfmwg\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:20.891041 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:20.891016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8p2k\" (UniqueName: \"kubernetes.io/projected/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-kube-api-access-f8p2k\") pod \"maas-api-e2e-api-b-dba614-6b47765c95-gfmwg\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:21.385542 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:21.385499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-maas-api-tls\") pod \"maas-api-e2e-api-b-dba614-6b47765c95-gfmwg\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:21.387951 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:21.387931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-maas-api-tls\") pod \"maas-api-e2e-api-b-dba614-6b47765c95-gfmwg\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:21.547326 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:21.547281    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:21.698924 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:21.698885    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"]
Jul 22 14:25:21.702270 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:25:21.702244    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4eec3b_7af6_487d_92a6_69dbd1a0353c.slice/crio-9646992ed83188900f4e3f13801b2844bc2d9955ab25c78bcee5c8028f0a358d WatchSource:0}: Error finding container 9646992ed83188900f4e3f13801b2844bc2d9955ab25c78bcee5c8028f0a358d: Status 404 returned error can't find the container with id 9646992ed83188900f4e3f13801b2844bc2d9955ab25c78bcee5c8028f0a358d
Jul 22 14:25:22.228612 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:22.228568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg" event={"ID":"5d4eec3b-7af6-487d-92a6-69dbd1a0353c","Type":"ContainerStarted","Data":"9646992ed83188900f4e3f13801b2844bc2d9955ab25c78bcee5c8028f0a358d"}
Jul 22 14:25:23.235393 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:23.235356    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg" event={"ID":"5d4eec3b-7af6-487d-92a6-69dbd1a0353c","Type":"ContainerStarted","Data":"1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3"}
Jul 22 14:25:23.235747 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:23.235487    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:23.256034 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:23.255980    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg" podStartSLOduration=2.768043722 podStartE2EDuration="3.255968463s" totalImagesPullingTime="487.924741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:25:23.253685124 +0000 UTC m=+2347.495780103" watchObservedRunningTime="2026-07-22 14:25:23.255968463 +0000 UTC m=+2347.498063428"
Jul 22 14:25:29.245998 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:29.245966    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:25:33.159000 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:33.158968    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"]
Jul 22 14:25:33.162536 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:33.162520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"
Jul 22 14:25:33.164828 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:33.164807    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:25:33.169898 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:33.169293    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"]
Jul 22 14:25:33.277295 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:33.277272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b9bb616-ace8-4924-8ade-c33a5f597e82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5\" (UID: \"2b9bb616-ace8-4924-8ade-c33a5f597e82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"
Jul 22 14:25:33.378302 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:33.378275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b9bb616-ace8-4924-8ade-c33a5f597e82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5\" (UID: \"2b9bb616-ace8-4924-8ade-c33a5f597e82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"
Jul 22 14:25:33.378814 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:33.378798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b9bb616-ace8-4924-8ade-c33a5f597e82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5\" (UID: \"2b9bb616-ace8-4924-8ade-c33a5f597e82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"
Jul 22 14:25:33.475462 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:33.475409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"
Jul 22 14:25:33.607441 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:33.607341    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"]
Jul 22 14:25:33.610149 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:25:33.610102    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9bb616_ace8_4924_8ade_c33a5f597e82.slice/crio-b1a5aa6757548f07f90b1df7c744535a48b9d51ae124a72528cb29b73430f2c4 WatchSource:0}: Error finding container b1a5aa6757548f07f90b1df7c744535a48b9d51ae124a72528cb29b73430f2c4: Status 404 returned error can't find the container with id b1a5aa6757548f07f90b1df7c744535a48b9d51ae124a72528cb29b73430f2c4
Jul 22 14:25:34.286308 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:34.286276    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5" event={"ID":"2b9bb616-ace8-4924-8ade-c33a5f597e82","Type":"ContainerStarted","Data":"4ed2abd637e2514b0951a7d16b17291f5c1a9645de9c260c8d2d9603d9aaf2f4"}
Jul 22 14:25:34.286673 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:34.286333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5" event={"ID":"2b9bb616-ace8-4924-8ade-c33a5f597e82","Type":"ContainerStarted","Data":"b1a5aa6757548f07f90b1df7c744535a48b9d51ae124a72528cb29b73430f2c4"}
Jul 22 14:25:34.305349 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:34.305286    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5" podStartSLOduration=1.305267689 podStartE2EDuration="1.305267689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:25:34.304334134 +0000 UTC m=+2358.546429100" watchObservedRunningTime="2026-07-22 14:25:34.305267689 +0000 UTC m=+2358.547362655"
Jul 22 14:25:35.292558 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:35.292525    2578 generic.go:356] "Generic (PLEG): container finished" podID="2b9bb616-ace8-4924-8ade-c33a5f597e82" containerID="4ed2abd637e2514b0951a7d16b17291f5c1a9645de9c260c8d2d9603d9aaf2f4" exitCode=0
Jul 22 14:25:35.292965 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:35.292584    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5" event={"ID":"2b9bb616-ace8-4924-8ade-c33a5f597e82","Type":"ContainerDied","Data":"4ed2abd637e2514b0951a7d16b17291f5c1a9645de9c260c8d2d9603d9aaf2f4"}
Jul 22 14:25:36.428883 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:36.428860    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"
Jul 22 14:25:36.505828 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:36.505802    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b9bb616-ace8-4924-8ade-c33a5f597e82-maas-api-service-ca\") pod \"2b9bb616-ace8-4924-8ade-c33a5f597e82\" (UID: \"2b9bb616-ace8-4924-8ade-c33a5f597e82\") "
Jul 22 14:25:36.506154 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:36.506120    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b9bb616-ace8-4924-8ade-c33a5f597e82-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b9bb616-ace8-4924-8ade-c33a5f597e82" (UID: "2b9bb616-ace8-4924-8ade-c33a5f597e82"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:25:36.606631 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:36.606549    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b9bb616-ace8-4924-8ade-c33a5f597e82-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:25:37.302529 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:37.302491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5" event={"ID":"2b9bb616-ace8-4924-8ade-c33a5f597e82","Type":"ContainerDied","Data":"b1a5aa6757548f07f90b1df7c744535a48b9d51ae124a72528cb29b73430f2c4"}
Jul 22 14:25:37.302687 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:37.302557    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1a5aa6757548f07f90b1df7c744535a48b9d51ae124a72528cb29b73430f2c4"
Jul 22 14:25:37.302687 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:37.302505    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"
Jul 22 14:25:48.978401 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:48.978367    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"]
Jul 22 14:25:48.978887 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:48.978616    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm" podUID="cf440460-2891-422f-89a8-071e974097ef" containerName="maas-api" containerID="cri-o://c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c" gracePeriod=30
Jul 22 14:25:49.228686 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.228635    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:49.308581 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.308546    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf440460-2891-422f-89a8-071e974097ef-openshift-service-ca\") pod \"cf440460-2891-422f-89a8-071e974097ef\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") "
Jul 22 14:25:49.308739 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.308595    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2l8f7\" (UniqueName: \"kubernetes.io/projected/cf440460-2891-422f-89a8-071e974097ef-kube-api-access-2l8f7\") pod \"cf440460-2891-422f-89a8-071e974097ef\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") "
Jul 22 14:25:49.308739 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.308631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf440460-2891-422f-89a8-071e974097ef-maas-api-tls\") pod \"cf440460-2891-422f-89a8-071e974097ef\" (UID: \"cf440460-2891-422f-89a8-071e974097ef\") "
Jul 22 14:25:49.308840 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.308819    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf440460-2891-422f-89a8-071e974097ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf440460-2891-422f-89a8-071e974097ef" (UID: "cf440460-2891-422f-89a8-071e974097ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:25:49.308932 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.308918    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf440460-2891-422f-89a8-071e974097ef-openshift-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:25:49.310807 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.310778    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf440460-2891-422f-89a8-071e974097ef-kube-api-access-2l8f7" (OuterVolumeSpecName: "kube-api-access-2l8f7") pod "cf440460-2891-422f-89a8-071e974097ef" (UID: "cf440460-2891-422f-89a8-071e974097ef"). InnerVolumeSpecName "kube-api-access-2l8f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:25:49.310933 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.310918    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf440460-2891-422f-89a8-071e974097ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf440460-2891-422f-89a8-071e974097ef" (UID: "cf440460-2891-422f-89a8-071e974097ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:25:49.358647 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.358614    2578 generic.go:356] "Generic (PLEG): container finished" podID="cf440460-2891-422f-89a8-071e974097ef" containerID="c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c" exitCode=0
Jul 22 14:25:49.358770 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.358668    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"
Jul 22 14:25:49.358770 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.358704    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm" event={"ID":"cf440460-2891-422f-89a8-071e974097ef","Type":"ContainerDied","Data":"c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c"}
Jul 22 14:25:49.358770 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.358754    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm" event={"ID":"cf440460-2891-422f-89a8-071e974097ef","Type":"ContainerDied","Data":"3960b538cbec7c1bc958c3746f2a9cac812a2037f8268fd350f39dbe3bf98c6a"}
Jul 22 14:25:49.358922 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.358777    2578 scope.go:117] "RemoveContainer" containerID="c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c"
Jul 22 14:25:49.367645 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.367631    2578 scope.go:117] "RemoveContainer" containerID="c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c"
Jul 22 14:25:49.367873 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:25:49.367859    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c\": container with ID starting with c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c not found: ID does not exist" containerID="c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c"
Jul 22 14:25:49.367931 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.367886    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c"} err="failed to get container status \"c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c\": rpc error: code = NotFound desc = could not find container \"c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c\": container with ID starting with c1f470b3d968c30c17e8c2894ccd5c732db32504f119f0b64f14d80f56a0fb4c not found: ID does not exist"
Jul 22 14:25:49.379382 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.379361    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"]
Jul 22 14:25:49.383224 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.383203    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c0776d-7b84b4cf67-lwdvm"]
Jul 22 14:25:49.409290 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.409271    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2l8f7\" (UniqueName: \"kubernetes.io/projected/cf440460-2891-422f-89a8-071e974097ef-kube-api-access-2l8f7\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:25:49.409290 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:49.409290    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf440460-2891-422f-89a8-071e974097ef-maas-api-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:25:50.253770 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:50.253734    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf440460-2891-422f-89a8-071e974097ef" path="/var/lib/kubelet/pods/cf440460-2891-422f-89a8-071e974097ef/volumes"
Jul 22 14:25:53.242578 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:53.242546    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"]
Jul 22 14:25:53.245083 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:53.245058    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c0776d-v4ld5"]
Jul 22 14:25:54.253678 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:25:54.253642    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b9bb616-ace8-4924-8ade-c33a5f597e82" path="/var/lib/kubelet/pods/2b9bb616-ace8-4924-8ade-c33a5f597e82/volumes"
Jul 22 14:26:00.289946 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.289911    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"]
Jul 22 14:26:00.290463 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.290264    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf440460-2891-422f-89a8-071e974097ef" containerName="maas-api"
Jul 22 14:26:00.290463 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.290275    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf440460-2891-422f-89a8-071e974097ef" containerName="maas-api"
Jul 22 14:26:00.290463 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.290286    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9bb616-ace8-4924-8ade-c33a5f597e82" containerName="revoke-keys"
Jul 22 14:26:00.290463 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.290292    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9bb616-ace8-4924-8ade-c33a5f597e82" containerName="revoke-keys"
Jul 22 14:26:00.290463 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.290351    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf440460-2891-422f-89a8-071e974097ef" containerName="maas-api"
Jul 22 14:26:00.290463 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.290358    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b9bb616-ace8-4924-8ade-c33a5f597e82" containerName="revoke-keys"
Jul 22 14:26:00.293339 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.293322    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"
Jul 22 14:26:00.295434 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.295415    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:26:00.301154 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.301108    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"]
Jul 22 14:26:00.399943 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.399905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0927bd66-b48f-4e64-8a85-e6e66d3682fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-dba614-j2z5l\" (UID: \"0927bd66-b48f-4e64-8a85-e6e66d3682fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"
Jul 22 14:26:00.500740 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.500711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0927bd66-b48f-4e64-8a85-e6e66d3682fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-dba614-j2z5l\" (UID: \"0927bd66-b48f-4e64-8a85-e6e66d3682fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"
Jul 22 14:26:00.501560 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.501533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0927bd66-b48f-4e64-8a85-e6e66d3682fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-dba614-j2z5l\" (UID: \"0927bd66-b48f-4e64-8a85-e6e66d3682fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"
Jul 22 14:26:00.605549 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.605475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"
Jul 22 14:26:00.738615 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:00.738587    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"]
Jul 22 14:26:00.740739 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:26:00.740715    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0927bd66_b48f_4e64_8a85_e6e66d3682fa.slice/crio-8ea4e03520d23e4dba5e75d91ffe36b6d711e0334d36ce5af6d8e3dbd99d029e WatchSource:0}: Error finding container 8ea4e03520d23e4dba5e75d91ffe36b6d711e0334d36ce5af6d8e3dbd99d029e: Status 404 returned error can't find the container with id 8ea4e03520d23e4dba5e75d91ffe36b6d711e0334d36ce5af6d8e3dbd99d029e
Jul 22 14:26:01.416388 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:01.416351    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l" event={"ID":"0927bd66-b48f-4e64-8a85-e6e66d3682fa","Type":"ContainerStarted","Data":"cba6e43d94c82f78e84c0ea0ce96dd66946debb3ca43a3b71067351e49cdb1d9"}
Jul 22 14:26:01.416833 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:01.416413    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l" event={"ID":"0927bd66-b48f-4e64-8a85-e6e66d3682fa","Type":"ContainerStarted","Data":"8ea4e03520d23e4dba5e75d91ffe36b6d711e0334d36ce5af6d8e3dbd99d029e"}
Jul 22 14:26:01.433336 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:01.433290    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l" podStartSLOduration=1.433275482 podStartE2EDuration="1.433275482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:26:01.431818787 +0000 UTC m=+2385.673913752" watchObservedRunningTime="2026-07-22 14:26:01.433275482 +0000 UTC m=+2385.675370464"
Jul 22 14:26:02.421750 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:02.421714    2578 generic.go:356] "Generic (PLEG): container finished" podID="0927bd66-b48f-4e64-8a85-e6e66d3682fa" containerID="cba6e43d94c82f78e84c0ea0ce96dd66946debb3ca43a3b71067351e49cdb1d9" exitCode=0
Jul 22 14:26:02.422176 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:02.421776    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l" event={"ID":"0927bd66-b48f-4e64-8a85-e6e66d3682fa","Type":"ContainerDied","Data":"cba6e43d94c82f78e84c0ea0ce96dd66946debb3ca43a3b71067351e49cdb1d9"}
Jul 22 14:26:03.558378 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:03.558356    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"
Jul 22 14:26:03.726182 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:03.726110    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0927bd66-b48f-4e64-8a85-e6e66d3682fa-maas-api-service-ca\") pod \"0927bd66-b48f-4e64-8a85-e6e66d3682fa\" (UID: \"0927bd66-b48f-4e64-8a85-e6e66d3682fa\") "
Jul 22 14:26:03.726436 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:03.726414    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0927bd66-b48f-4e64-8a85-e6e66d3682fa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0927bd66-b48f-4e64-8a85-e6e66d3682fa" (UID: "0927bd66-b48f-4e64-8a85-e6e66d3682fa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:26:03.826634 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:03.826608    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0927bd66-b48f-4e64-8a85-e6e66d3682fa-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:26:04.432736 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:04.432713    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"
Jul 22 14:26:04.432736 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:04.432724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l" event={"ID":"0927bd66-b48f-4e64-8a85-e6e66d3682fa","Type":"ContainerDied","Data":"8ea4e03520d23e4dba5e75d91ffe36b6d711e0334d36ce5af6d8e3dbd99d029e"}
Jul 22 14:26:04.432904 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:04.432769    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ea4e03520d23e4dba5e75d91ffe36b6d711e0334d36ce5af6d8e3dbd99d029e"
Jul 22 14:26:15.739340 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:15.739306    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"]
Jul 22 14:26:15.739750 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:15.739487    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg" podUID="5d4eec3b-7af6-487d-92a6-69dbd1a0353c" containerName="maas-api" containerID="cri-o://1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3" gracePeriod=30
Jul 22 14:26:15.983789 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:15.983768    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:26:16.116512 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.116489    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8p2k\" (UniqueName: \"kubernetes.io/projected/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-kube-api-access-f8p2k\") pod \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") "
Jul 22 14:26:16.116767 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.116551    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-maas-api-tls\") pod \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") "
Jul 22 14:26:16.116767 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.116575    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-openshift-service-ca\") pod \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\" (UID: \"5d4eec3b-7af6-487d-92a6-69dbd1a0353c\") "
Jul 22 14:26:16.117019 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.116985    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d4eec3b-7af6-487d-92a6-69dbd1a0353c" (UID: "5d4eec3b-7af6-487d-92a6-69dbd1a0353c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:26:16.118606 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.118579    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-kube-api-access-f8p2k" (OuterVolumeSpecName: "kube-api-access-f8p2k") pod "5d4eec3b-7af6-487d-92a6-69dbd1a0353c" (UID: "5d4eec3b-7af6-487d-92a6-69dbd1a0353c"). InnerVolumeSpecName "kube-api-access-f8p2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:26:16.118733 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.118710    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d4eec3b-7af6-487d-92a6-69dbd1a0353c" (UID: "5d4eec3b-7af6-487d-92a6-69dbd1a0353c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:26:16.217802 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.217779    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-maas-api-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:26:16.217802 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.217802    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-openshift-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:26:16.217956 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.217812    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8p2k\" (UniqueName: \"kubernetes.io/projected/5d4eec3b-7af6-487d-92a6-69dbd1a0353c-kube-api-access-f8p2k\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:26:16.349573 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.349327    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:26:16.358559 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.358542    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:26:16.486543 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.486480    2578 scope.go:117] "RemoveContainer" containerID="a4c816136cb40c7835aa0d425cf4702ca4e3445f8ba69dda0377a565431281ad"
Jul 22 14:26:16.490791 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.490767    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d4eec3b-7af6-487d-92a6-69dbd1a0353c" containerID="1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3" exitCode=0
Jul 22 14:26:16.490921 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.490825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg" event={"ID":"5d4eec3b-7af6-487d-92a6-69dbd1a0353c","Type":"ContainerDied","Data":"1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3"}
Jul 22 14:26:16.490921 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.490841    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"
Jul 22 14:26:16.490921 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.490891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg" event={"ID":"5d4eec3b-7af6-487d-92a6-69dbd1a0353c","Type":"ContainerDied","Data":"9646992ed83188900f4e3f13801b2844bc2d9955ab25c78bcee5c8028f0a358d"}
Jul 22 14:26:16.490921 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.490922    2578 scope.go:117] "RemoveContainer" containerID="1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3"
Jul 22 14:26:16.500164 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.499996    2578 scope.go:117] "RemoveContainer" containerID="1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3"
Jul 22 14:26:16.500360 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:26:16.500296    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3\": container with ID starting with 1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3 not found: ID does not exist" containerID="1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3"
Jul 22 14:26:16.500360 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.500324    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3"} err="failed to get container status \"1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3\": rpc error: code = NotFound desc = could not find container \"1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3\": container with ID starting with 1621ff07d4419b783158d8f303121cd1b4b1a8eca1d548248c0d71a95c0b59d3 not found: ID does not exist"
Jul 22 14:26:16.510711 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.510689    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"]
Jul 22 14:26:16.515339 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:16.515318    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dba614-6b47765c95-gfmwg"]
Jul 22 14:26:18.253388 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:18.253353    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d4eec3b-7af6-487d-92a6-69dbd1a0353c" path="/var/lib/kubelet/pods/5d4eec3b-7af6-487d-92a6-69dbd1a0353c/volumes"
Jul 22 14:26:20.378407 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:20.378370    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"]
Jul 22 14:26:20.381649 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:20.381625    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dba614-j2z5l"]
Jul 22 14:26:22.253034 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:22.252999    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0927bd66-b48f-4e64-8a85-e6e66d3682fa" path="/var/lib/kubelet/pods/0927bd66-b48f-4e64-8a85-e6e66d3682fa/volumes"
Jul 22 14:26:32.156146 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.156092    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"]
Jul 22 14:26:32.157087 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.157063    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0927bd66-b48f-4e64-8a85-e6e66d3682fa" containerName="revoke-keys"
Jul 22 14:26:32.157087 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.157085    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0927bd66-b48f-4e64-8a85-e6e66d3682fa" containerName="revoke-keys"
Jul 22 14:26:32.157308 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.157109    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4eec3b-7af6-487d-92a6-69dbd1a0353c" containerName="maas-api"
Jul 22 14:26:32.157308 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.157115    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4eec3b-7af6-487d-92a6-69dbd1a0353c" containerName="maas-api"
Jul 22 14:26:32.157308 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.157198    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0927bd66-b48f-4e64-8a85-e6e66d3682fa" containerName="revoke-keys"
Jul 22 14:26:32.157308 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.157209    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d4eec3b-7af6-487d-92a6-69dbd1a0353c" containerName="maas-api"
Jul 22 14:26:32.160334 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.160311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:32.162342 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.162317    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-7d1f11-serving-cert\""
Jul 22 14:26:32.162518 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.162496    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 14:26:32.162608 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.162557    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tpv8w\""
Jul 22 14:26:32.163090 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.163073    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 14:26:32.170816 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.170705    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"]
Jul 22 14:26:32.231103 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.231078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9cdb3a0-9abb-4441-8270-7b49ca56696e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:32.231391 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.231366    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf6gv\" (UniqueName: \"kubernetes.io/projected/a9cdb3a0-9abb-4441-8270-7b49ca56696e-kube-api-access-lf6gv\") pod \"maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:32.231505 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.231408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9cdb3a0-9abb-4441-8270-7b49ca56696e-maas-api-tls\") pod \"maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:32.331902 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.331878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6gv\" (UniqueName: \"kubernetes.io/projected/a9cdb3a0-9abb-4441-8270-7b49ca56696e-kube-api-access-lf6gv\") pod \"maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:32.332017 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.331909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9cdb3a0-9abb-4441-8270-7b49ca56696e-maas-api-tls\") pod \"maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:32.332017 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.331954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9cdb3a0-9abb-4441-8270-7b49ca56696e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:32.332173 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:26:32.332095    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-serving-cert: secret "maas-api-e2e-shared-a-7d1f11-serving-cert" not found
Jul 22 14:26:32.332239 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:26:32.332196    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9cdb3a0-9abb-4441-8270-7b49ca56696e-maas-api-tls podName:a9cdb3a0-9abb-4441-8270-7b49ca56696e nodeName:}" failed. No retries permitted until 2026-07-22 14:26:32.832175784 +0000 UTC m=+2417.074270727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a9cdb3a0-9abb-4441-8270-7b49ca56696e-maas-api-tls") pod "maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68" (UID: "a9cdb3a0-9abb-4441-8270-7b49ca56696e") : secret "maas-api-e2e-shared-a-7d1f11-serving-cert" not found
Jul 22 14:26:32.332626 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.332609    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9cdb3a0-9abb-4441-8270-7b49ca56696e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:32.343257 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.343239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf6gv\" (UniqueName: \"kubernetes.io/projected/a9cdb3a0-9abb-4441-8270-7b49ca56696e-kube-api-access-lf6gv\") pod \"maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:32.836859 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.836824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9cdb3a0-9abb-4441-8270-7b49ca56696e-maas-api-tls\") pod \"maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:32.839296 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:32.839274    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9cdb3a0-9abb-4441-8270-7b49ca56696e-maas-api-tls\") pod \"maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:33.071890 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:33.071859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:33.205763 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:33.205512    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"]
Jul 22 14:26:33.212602 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:26:33.212571    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cdb3a0_9abb_4441_8270_7b49ca56696e.slice/crio-ac42ec227325164c3621b0a6edf57f2b32ce09260f9bea66efbe2b20665d1732 WatchSource:0}: Error finding container ac42ec227325164c3621b0a6edf57f2b32ce09260f9bea66efbe2b20665d1732: Status 404 returned error can't find the container with id ac42ec227325164c3621b0a6edf57f2b32ce09260f9bea66efbe2b20665d1732
Jul 22 14:26:33.572166 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:33.572127    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68" event={"ID":"a9cdb3a0-9abb-4441-8270-7b49ca56696e","Type":"ContainerStarted","Data":"ac42ec227325164c3621b0a6edf57f2b32ce09260f9bea66efbe2b20665d1732"}
Jul 22 14:26:34.578145 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:34.578107    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68" event={"ID":"a9cdb3a0-9abb-4441-8270-7b49ca56696e","Type":"ContainerStarted","Data":"e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b"}
Jul 22 14:26:34.578516 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:34.578243    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:34.596264 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:34.596212    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68" podStartSLOduration=2.257451789 podStartE2EDuration="2.59619498s" totalImagesPullingTime="338.743191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:26:34.594947521 +0000 UTC m=+2418.837042485" watchObservedRunningTime="2026-07-22 14:26:34.59619498 +0000 UTC m=+2418.838289944"
Jul 22 14:26:40.174078 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.174040    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"]
Jul 22 14:26:40.178464 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.178436    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:40.185370 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.185322    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f0b3df-serving-cert\""
Jul 22 14:26:40.191250 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.191227    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"]
Jul 22 14:26:40.194879 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.194856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/629ecf3b-7094-461d-8580-162ca906a9e6-maas-api-tls\") pod \"maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:40.195020 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.194889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcfhq\" (UniqueName: \"kubernetes.io/projected/629ecf3b-7094-461d-8580-162ca906a9e6-kube-api-access-lcfhq\") pod \"maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:40.195020 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.194915    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/629ecf3b-7094-461d-8580-162ca906a9e6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:40.295892 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.295858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/629ecf3b-7094-461d-8580-162ca906a9e6-maas-api-tls\") pod \"maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:40.296049 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.295903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcfhq\" (UniqueName: \"kubernetes.io/projected/629ecf3b-7094-461d-8580-162ca906a9e6-kube-api-access-lcfhq\") pod \"maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:40.296049 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.295934    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/629ecf3b-7094-461d-8580-162ca906a9e6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:40.296624 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.296600    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/629ecf3b-7094-461d-8580-162ca906a9e6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:40.298428 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.298407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/629ecf3b-7094-461d-8580-162ca906a9e6-maas-api-tls\") pod \"maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:40.308108 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.308084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcfhq\" (UniqueName: \"kubernetes.io/projected/629ecf3b-7094-461d-8580-162ca906a9e6-kube-api-access-lcfhq\") pod \"maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:40.489078 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.489009    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:40.589621 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.589594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:26:40.641048 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:40.641023    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"]
Jul 22 14:26:40.644077 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:26:40.644036    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629ecf3b_7094_461d_8580_162ca906a9e6.slice/crio-3116c940c7eeefdda712e9b89af1528722aa2abeccd719507bfcdd78cc117132 WatchSource:0}: Error finding container 3116c940c7eeefdda712e9b89af1528722aa2abeccd719507bfcdd78cc117132: Status 404 returned error can't find the container with id 3116c940c7eeefdda712e9b89af1528722aa2abeccd719507bfcdd78cc117132
Jul 22 14:26:41.614148 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:41.614100    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx" event={"ID":"629ecf3b-7094-461d-8580-162ca906a9e6","Type":"ContainerStarted","Data":"53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643"}
Jul 22 14:26:41.614513 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:41.614180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx" event={"ID":"629ecf3b-7094-461d-8580-162ca906a9e6","Type":"ContainerStarted","Data":"3116c940c7eeefdda712e9b89af1528722aa2abeccd719507bfcdd78cc117132"}
Jul 22 14:26:41.614513 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:41.614285    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:26:41.634310 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:41.634266    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx" podStartSLOduration=1.33113133 podStartE2EDuration="1.634254782s" totalImagesPullingTime="303.123452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:26:41.632122939 +0000 UTC m=+2425.874217903" watchObservedRunningTime="2026-07-22 14:26:41.634254782 +0000 UTC m=+2425.876349745"
Jul 22 14:26:47.624462 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:26:47.624434    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:30:00.130981 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.130944    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb"]
Jul 22 14:30:00.134338 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.134316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb"
Jul 22 14:30:00.135220 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.135199    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n"]
Jul 22 14:30:00.136488 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.136467    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:30:00.138572 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.138551    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs"]
Jul 22 14:30:00.138734 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.138707    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n"
Jul 22 14:30:00.142148 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.142109    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb"]
Jul 22 14:30:00.142246 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.142214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs"
Jul 22 14:30:00.144952 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.144757    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs"]
Jul 22 14:30:00.148636 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.148614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n"]
Jul 22 14:30:00.150689 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.150670    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb"
Jul 22 14:30:00.158089 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.158069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n"
Jul 22 14:30:00.189111 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.189087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs"
Jul 22 14:30:00.313282 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.313239    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb"]
Jul 22 14:30:00.322390 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:30:00.322348    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3160e6a2_9101_4106_8bf7_5c7ff6be7347.slice/crio-7128dd9c54143dc4ad734c1096fb1c600708d04e1357bc44fb6b617ffd3d741b WatchSource:0}: Error finding container 7128dd9c54143dc4ad734c1096fb1c600708d04e1357bc44fb6b617ffd3d741b: Status 404 returned error can't find the container with id 7128dd9c54143dc4ad734c1096fb1c600708d04e1357bc44fb6b617ffd3d741b
Jul 22 14:30:00.346679 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.346500    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n"]
Jul 22 14:30:00.359298 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:30:00.359270    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b2bbfc_eeda_46da_b4a4_a38ec957f1e4.slice/crio-765756a9d05f296c9fe087e9a32e38244a6a242deb4d0d596543e1f922f2799b WatchSource:0}: Error finding container 765756a9d05f296c9fe087e9a32e38244a6a242deb4d0d596543e1f922f2799b: Status 404 returned error can't find the container with id 765756a9d05f296c9fe087e9a32e38244a6a242deb4d0d596543e1f922f2799b
Jul 22 14:30:00.371108 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.371028    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs"]
Jul 22 14:30:00.373088 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:30:00.373066    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431939ca_160a_4dfa_9778_93f5401648a8.slice/crio-e69a66a2442cd6013fd0a2afc9fd03f3c3dc82c87dfec28ada6257ff32ba87b8 WatchSource:0}: Error finding container e69a66a2442cd6013fd0a2afc9fd03f3c3dc82c87dfec28ada6257ff32ba87b8: Status 404 returned error can't find the container with id e69a66a2442cd6013fd0a2afc9fd03f3c3dc82c87dfec28ada6257ff32ba87b8
Jul 22 14:30:00.536542 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.536503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb" event={"ID":"3160e6a2-9101-4106-8bf7-5c7ff6be7347","Type":"ContainerStarted","Data":"7128dd9c54143dc4ad734c1096fb1c600708d04e1357bc44fb6b617ffd3d741b"}
Jul 22 14:30:00.537607 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.537585    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs" event={"ID":"431939ca-160a-4dfa-9778-93f5401648a8","Type":"ContainerStarted","Data":"e69a66a2442cd6013fd0a2afc9fd03f3c3dc82c87dfec28ada6257ff32ba87b8"}
Jul 22 14:30:00.538675 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:00.538651    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n" event={"ID":"15b2bbfc-eeda-46da-b4a4-a38ec957f1e4","Type":"ContainerStarted","Data":"765756a9d05f296c9fe087e9a32e38244a6a242deb4d0d596543e1f922f2799b"}
Jul 22 14:30:01.545077 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:01.545036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb" event={"ID":"3160e6a2-9101-4106-8bf7-5c7ff6be7347","Type":"ContainerStarted","Data":"28eeda009a5917686dfd9b14708258fa3d6ae8fce210c68f7fcfa1229c375e55"}
Jul 22 14:30:01.546677 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:01.546655    2578 generic.go:356] "Generic (PLEG): container finished" podID="431939ca-160a-4dfa-9778-93f5401648a8" containerID="6fffd3d6fac20d81fc8d7dca3fdbc69a38603dca2210c9cf38b599d4a503905a" exitCode=0
Jul 22 14:30:01.546808 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:01.546738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs" event={"ID":"431939ca-160a-4dfa-9778-93f5401648a8","Type":"ContainerDied","Data":"6fffd3d6fac20d81fc8d7dca3fdbc69a38603dca2210c9cf38b599d4a503905a"}
Jul 22 14:30:01.548148 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:01.548108    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n" event={"ID":"15b2bbfc-eeda-46da-b4a4-a38ec957f1e4","Type":"ContainerStarted","Data":"0ef9aed306ca12f9d8a1c4bef36eb378b5d4ad699a558ac7013a196c1a5b1c47"}
Jul 22 14:30:01.562944 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:01.562904    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb" podStartSLOduration=1.5628913519999998 podStartE2EDuration="1.562891352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:30:01.561673911 +0000 UTC m=+2625.803768875" watchObservedRunningTime="2026-07-22 14:30:01.562891352 +0000 UTC m=+2625.804986317"
Jul 22 14:30:01.590797 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:01.590758    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n" podStartSLOduration=1.590745744 podStartE2EDuration="1.590745744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:30:01.589090484 +0000 UTC m=+2625.831185440" watchObservedRunningTime="2026-07-22 14:30:01.590745744 +0000 UTC m=+2625.832840709"
Jul 22 14:30:02.553791 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:02.553754    2578 generic.go:356] "Generic (PLEG): container finished" podID="15b2bbfc-eeda-46da-b4a4-a38ec957f1e4" containerID="0ef9aed306ca12f9d8a1c4bef36eb378b5d4ad699a558ac7013a196c1a5b1c47" exitCode=0
Jul 22 14:30:02.554269 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:02.553797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n" event={"ID":"15b2bbfc-eeda-46da-b4a4-a38ec957f1e4","Type":"ContainerDied","Data":"0ef9aed306ca12f9d8a1c4bef36eb378b5d4ad699a558ac7013a196c1a5b1c47"}
Jul 22 14:30:02.555361 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:02.555342    2578 generic.go:356] "Generic (PLEG): container finished" podID="3160e6a2-9101-4106-8bf7-5c7ff6be7347" containerID="28eeda009a5917686dfd9b14708258fa3d6ae8fce210c68f7fcfa1229c375e55" exitCode=0
Jul 22 14:30:02.555443 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:02.555402    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb" event={"ID":"3160e6a2-9101-4106-8bf7-5c7ff6be7347","Type":"ContainerDied","Data":"28eeda009a5917686dfd9b14708258fa3d6ae8fce210c68f7fcfa1229c375e55"}
Jul 22 14:30:02.688179 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:02.688157    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs"
Jul 22 14:30:03.561389 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:03.561354    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs"
Jul 22 14:30:03.561838 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:03.561391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs" event={"ID":"431939ca-160a-4dfa-9778-93f5401648a8","Type":"ContainerDied","Data":"e69a66a2442cd6013fd0a2afc9fd03f3c3dc82c87dfec28ada6257ff32ba87b8"}
Jul 22 14:30:03.561838 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:03.561440    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e69a66a2442cd6013fd0a2afc9fd03f3c3dc82c87dfec28ada6257ff32ba87b8"
Jul 22 14:30:03.719781 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:03.719756    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n"
Jul 22 14:30:03.741916 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:03.741886    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb"
Jul 22 14:30:04.566723 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:04.566698    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n"
Jul 22 14:30:04.567177 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:04.566731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n" event={"ID":"15b2bbfc-eeda-46da-b4a4-a38ec957f1e4","Type":"ContainerDied","Data":"765756a9d05f296c9fe087e9a32e38244a6a242deb4d0d596543e1f922f2799b"}
Jul 22 14:30:04.567177 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:04.566783    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="765756a9d05f296c9fe087e9a32e38244a6a242deb4d0d596543e1f922f2799b"
Jul 22 14:30:04.568189 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:04.568168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb" event={"ID":"3160e6a2-9101-4106-8bf7-5c7ff6be7347","Type":"ContainerDied","Data":"7128dd9c54143dc4ad734c1096fb1c600708d04e1357bc44fb6b617ffd3d741b"}
Jul 22 14:30:04.568305 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:04.568191    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745510-zndpb"
Jul 22 14:30:04.568305 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:30:04.568206    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7128dd9c54143dc4ad734c1096fb1c600708d04e1357bc44fb6b617ffd3d741b"
Jul 22 14:31:16.383343 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:31:16.383232    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:31:16.388478 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:31:16.388459    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:31:16.543878 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:31:16.543851    2578 scope.go:117] "RemoveContainer" containerID="8748f800e9201de44560a63433e9d4a1dbcc779a66b0167be4f5b4a45d04b503"
Jul 22 14:31:16.551512 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:31:16.551497    2578 scope.go:117] "RemoveContainer" containerID="5a3f8451cf256c04200b9979a1558131c50019c4d50d30711ae46f3b780c5cbd"
Jul 22 14:32:16.570938 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:16.570909    2578 scope.go:117] "RemoveContainer" containerID="4ed2abd637e2514b0951a7d16b17291f5c1a9645de9c260c8d2d9603d9aaf2f4"
Jul 22 14:32:16.579191 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:16.579110    2578 scope.go:117] "RemoveContainer" containerID="cba6e43d94c82f78e84c0ea0ce96dd66946debb3ca43a3b71067351e49cdb1d9"
Jul 22 14:32:50.952723 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.952643    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"]
Jul 22 14:32:50.953199 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.952963    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3160e6a2-9101-4106-8bf7-5c7ff6be7347" containerName="cleanup"
Jul 22 14:32:50.953199 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.952973    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3160e6a2-9101-4106-8bf7-5c7ff6be7347" containerName="cleanup"
Jul 22 14:32:50.953199 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.952998    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b2bbfc-eeda-46da-b4a4-a38ec957f1e4" containerName="cleanup"
Jul 22 14:32:50.953199 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.953003    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b2bbfc-eeda-46da-b4a4-a38ec957f1e4" containerName="cleanup"
Jul 22 14:32:50.953199 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.953010    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="431939ca-160a-4dfa-9778-93f5401648a8" containerName="cleanup"
Jul 22 14:32:50.953199 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.953015    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="431939ca-160a-4dfa-9778-93f5401648a8" containerName="cleanup"
Jul 22 14:32:50.953199 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.953063    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b2bbfc-eeda-46da-b4a4-a38ec957f1e4" containerName="cleanup"
Jul 22 14:32:50.953199 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.953070    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3160e6a2-9101-4106-8bf7-5c7ff6be7347" containerName="cleanup"
Jul 22 14:32:50.953199 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.953079    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="431939ca-160a-4dfa-9778-93f5401648a8" containerName="cleanup"
Jul 22 14:32:50.956204 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.956186    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"
Jul 22 14:32:50.958154 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.958120    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:32:50.963269 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:50.963244    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"]
Jul 22 14:32:51.041767 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:51.041743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3ab26e6-e653-450a-8ba1-450194eb3765-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf\" (UID: \"c3ab26e6-e653-450a-8ba1-450194eb3765\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"
Jul 22 14:32:51.142423 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:51.142391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3ab26e6-e653-450a-8ba1-450194eb3765-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf\" (UID: \"c3ab26e6-e653-450a-8ba1-450194eb3765\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"
Jul 22 14:32:51.142923 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:51.142906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3ab26e6-e653-450a-8ba1-450194eb3765-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf\" (UID: \"c3ab26e6-e653-450a-8ba1-450194eb3765\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"
Jul 22 14:32:51.269236 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:51.269184    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"
Jul 22 14:32:51.408306 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:51.408282    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"]
Jul 22 14:32:51.410003 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:32:51.409970    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ab26e6_e653_450a_8ba1_450194eb3765.slice/crio-04358db1e4143b9543ea75b27f3f7e056764c1054d09811787f5c33637a84e96 WatchSource:0}: Error finding container 04358db1e4143b9543ea75b27f3f7e056764c1054d09811787f5c33637a84e96: Status 404 returned error can't find the container with id 04358db1e4143b9543ea75b27f3f7e056764c1054d09811787f5c33637a84e96
Jul 22 14:32:52.341685 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:52.341655    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3ab26e6-e653-450a-8ba1-450194eb3765" containerID="b9b59784309358b74378476c69e91e1188ac42e5354b1c13987e0c3463c092f2" exitCode=0
Jul 22 14:32:52.341998 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:52.341734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf" event={"ID":"c3ab26e6-e653-450a-8ba1-450194eb3765","Type":"ContainerDied","Data":"b9b59784309358b74378476c69e91e1188ac42e5354b1c13987e0c3463c092f2"}
Jul 22 14:32:52.341998 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:52.341775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf" event={"ID":"c3ab26e6-e653-450a-8ba1-450194eb3765","Type":"ContainerStarted","Data":"04358db1e4143b9543ea75b27f3f7e056764c1054d09811787f5c33637a84e96"}
Jul 22 14:32:53.476296 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:53.476272    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"
Jul 22 14:32:53.560944 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:53.560923    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3ab26e6-e653-450a-8ba1-450194eb3765-maas-api-service-ca\") pod \"c3ab26e6-e653-450a-8ba1-450194eb3765\" (UID: \"c3ab26e6-e653-450a-8ba1-450194eb3765\") "
Jul 22 14:32:53.561319 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:53.561298    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3ab26e6-e653-450a-8ba1-450194eb3765-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c3ab26e6-e653-450a-8ba1-450194eb3765" (UID: "c3ab26e6-e653-450a-8ba1-450194eb3765"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:32:53.661884 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:53.661831    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3ab26e6-e653-450a-8ba1-450194eb3765-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:32:54.350787 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:54.350761    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"
Jul 22 14:32:54.350787 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:54.350768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf" event={"ID":"c3ab26e6-e653-450a-8ba1-450194eb3765","Type":"ContainerDied","Data":"04358db1e4143b9543ea75b27f3f7e056764c1054d09811787f5c33637a84e96"}
Jul 22 14:32:54.351006 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:32:54.350827    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04358db1e4143b9543ea75b27f3f7e056764c1054d09811787f5c33637a84e96"
Jul 22 14:33:01.380845 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.380817    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"]
Jul 22 14:33:01.382183 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.382091    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68" podUID="a9cdb3a0-9abb-4441-8270-7b49ca56696e" containerName="maas-api" containerID="cri-o://e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b" gracePeriod=30
Jul 22 14:33:01.400904 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.400880    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n"]
Jul 22 14:33:01.408613 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.408588    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-7d1f11-29745510-4ph6n"]
Jul 22 14:33:01.633164 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.633091    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:33:01.718166 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.718117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9cdb3a0-9abb-4441-8270-7b49ca56696e-maas-api-tls\") pod \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") "
Jul 22 14:33:01.718290 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.718216    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf6gv\" (UniqueName: \"kubernetes.io/projected/a9cdb3a0-9abb-4441-8270-7b49ca56696e-kube-api-access-lf6gv\") pod \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") "
Jul 22 14:33:01.718290 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.718251    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9cdb3a0-9abb-4441-8270-7b49ca56696e-openshift-service-ca\") pod \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\" (UID: \"a9cdb3a0-9abb-4441-8270-7b49ca56696e\") "
Jul 22 14:33:01.718654 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.718625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9cdb3a0-9abb-4441-8270-7b49ca56696e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a9cdb3a0-9abb-4441-8270-7b49ca56696e" (UID: "a9cdb3a0-9abb-4441-8270-7b49ca56696e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:33:01.720242 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.720220    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9cdb3a0-9abb-4441-8270-7b49ca56696e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a9cdb3a0-9abb-4441-8270-7b49ca56696e" (UID: "a9cdb3a0-9abb-4441-8270-7b49ca56696e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:33:01.720353 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.720337    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9cdb3a0-9abb-4441-8270-7b49ca56696e-kube-api-access-lf6gv" (OuterVolumeSpecName: "kube-api-access-lf6gv") pod "a9cdb3a0-9abb-4441-8270-7b49ca56696e" (UID: "a9cdb3a0-9abb-4441-8270-7b49ca56696e"). InnerVolumeSpecName "kube-api-access-lf6gv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:33:01.818845 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.818822    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9cdb3a0-9abb-4441-8270-7b49ca56696e-maas-api-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:33:01.818941 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.818849    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf6gv\" (UniqueName: \"kubernetes.io/projected/a9cdb3a0-9abb-4441-8270-7b49ca56696e-kube-api-access-lf6gv\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:33:01.818941 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:01.818865    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9cdb3a0-9abb-4441-8270-7b49ca56696e-openshift-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:33:02.253298 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:02.253268    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15b2bbfc-eeda-46da-b4a4-a38ec957f1e4" path="/var/lib/kubelet/pods/15b2bbfc-eeda-46da-b4a4-a38ec957f1e4/volumes"
Jul 22 14:33:02.394347 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:02.394322    2578 generic.go:356] "Generic (PLEG): container finished" podID="a9cdb3a0-9abb-4441-8270-7b49ca56696e" containerID="e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b" exitCode=0
Jul 22 14:33:02.394670 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:02.394370    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"
Jul 22 14:33:02.394670 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:02.394410    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68" event={"ID":"a9cdb3a0-9abb-4441-8270-7b49ca56696e","Type":"ContainerDied","Data":"e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b"}
Jul 22 14:33:02.394670 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:02.394469    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68" event={"ID":"a9cdb3a0-9abb-4441-8270-7b49ca56696e","Type":"ContainerDied","Data":"ac42ec227325164c3621b0a6edf57f2b32ce09260f9bea66efbe2b20665d1732"}
Jul 22 14:33:02.394670 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:02.394492    2578 scope.go:117] "RemoveContainer" containerID="e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b"
Jul 22 14:33:02.403420 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:02.403398    2578 scope.go:117] "RemoveContainer" containerID="e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b"
Jul 22 14:33:02.403698 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:33:02.403673    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b\": container with ID starting with e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b not found: ID does not exist" containerID="e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b"
Jul 22 14:33:02.403752 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:02.403698    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b"} err="failed to get container status \"e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b\": rpc error: code = NotFound desc = could not find container \"e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b\": container with ID starting with e4d760075db5ce4c26dae9f4a73e2a660cdfff3e7cd4ed8de02c715b4188115b not found: ID does not exist"
Jul 22 14:33:02.411529 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:02.411504    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"]
Jul 22 14:33:02.414981 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:02.414960    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d1f11-6f4765c65f-z4k68"]
Jul 22 14:33:04.253897 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:04.253866    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9cdb3a0-9abb-4441-8270-7b49ca56696e" path="/var/lib/kubelet/pods/a9cdb3a0-9abb-4441-8270-7b49ca56696e/volumes"
Jul 22 14:33:06.046482 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:06.046449    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"]
Jul 22 14:33:06.049854 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:06.049828    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7d1f11-v2cnf"]
Jul 22 14:33:06.259518 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:06.259472    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ab26e6-e653-450a-8ba1-450194eb3765" path="/var/lib/kubelet/pods/c3ab26e6-e653-450a-8ba1-450194eb3765/volumes"
Jul 22 14:33:13.218307 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.218269    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"]
Jul 22 14:33:13.218782 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.218584    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9cdb3a0-9abb-4441-8270-7b49ca56696e" containerName="maas-api"
Jul 22 14:33:13.218782 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.218595    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9cdb3a0-9abb-4441-8270-7b49ca56696e" containerName="maas-api"
Jul 22 14:33:13.218782 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.218608    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ab26e6-e653-450a-8ba1-450194eb3765" containerName="revoke-keys"
Jul 22 14:33:13.218782 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.218613    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ab26e6-e653-450a-8ba1-450194eb3765" containerName="revoke-keys"
Jul 22 14:33:13.218782 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.218684    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9cdb3a0-9abb-4441-8270-7b49ca56696e" containerName="maas-api"
Jul 22 14:33:13.218782 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.218694    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3ab26e6-e653-450a-8ba1-450194eb3765" containerName="revoke-keys"
Jul 22 14:33:13.223086 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.223067    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"
Jul 22 14:33:13.225326 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.225305    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fx2r6\""
Jul 22 14:33:13.229295 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.229272    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"]
Jul 22 14:33:13.306904 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.306874    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a0132-66b7-4d5d-8f78-c970ca2f4b55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds\" (UID: \"cb2a0132-66b7-4d5d-8f78-c970ca2f4b55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"
Jul 22 14:33:13.408483 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.408459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a0132-66b7-4d5d-8f78-c970ca2f4b55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds\" (UID: \"cb2a0132-66b7-4d5d-8f78-c970ca2f4b55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"
Jul 22 14:33:13.409047 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.409030    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a0132-66b7-4d5d-8f78-c970ca2f4b55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds\" (UID: \"cb2a0132-66b7-4d5d-8f78-c970ca2f4b55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"
Jul 22 14:33:13.536192 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.536162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"
Jul 22 14:33:13.668196 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:13.668172    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"]
Jul 22 14:33:13.670127 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:33:13.670096    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2a0132_66b7_4d5d_8f78_c970ca2f4b55.slice/crio-6119f70238c8fcd71d2d0053e0321b40d11d1df64424c112053a6b4cca6e2187 WatchSource:0}: Error finding container 6119f70238c8fcd71d2d0053e0321b40d11d1df64424c112053a6b4cca6e2187: Status 404 returned error can't find the container with id 6119f70238c8fcd71d2d0053e0321b40d11d1df64424c112053a6b4cca6e2187
Jul 22 14:33:14.451608 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:14.451575    2578 generic.go:356] "Generic (PLEG): container finished" podID="cb2a0132-66b7-4d5d-8f78-c970ca2f4b55" containerID="f8eb80b2d597ac0fe5a711f157cf8a188881c8e3475756d531eff35b64076657" exitCode=0
Jul 22 14:33:14.451910 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:14.451628    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds" event={"ID":"cb2a0132-66b7-4d5d-8f78-c970ca2f4b55","Type":"ContainerDied","Data":"f8eb80b2d597ac0fe5a711f157cf8a188881c8e3475756d531eff35b64076657"}
Jul 22 14:33:14.451910 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:14.451680    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds" event={"ID":"cb2a0132-66b7-4d5d-8f78-c970ca2f4b55","Type":"ContainerStarted","Data":"6119f70238c8fcd71d2d0053e0321b40d11d1df64424c112053a6b4cca6e2187"}
Jul 22 14:33:15.592003 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:15.591982    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"
Jul 22 14:33:15.728497 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:15.728411    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a0132-66b7-4d5d-8f78-c970ca2f4b55-maas-api-service-ca\") pod \"cb2a0132-66b7-4d5d-8f78-c970ca2f4b55\" (UID: \"cb2a0132-66b7-4d5d-8f78-c970ca2f4b55\") "
Jul 22 14:33:15.728816 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:15.728790    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb2a0132-66b7-4d5d-8f78-c970ca2f4b55-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cb2a0132-66b7-4d5d-8f78-c970ca2f4b55" (UID: "cb2a0132-66b7-4d5d-8f78-c970ca2f4b55"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:33:15.828880 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:15.828851    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2a0132-66b7-4d5d-8f78-c970ca2f4b55-maas-api-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:33:16.460674 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:16.460651    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"
Jul 22 14:33:16.460822 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:16.460690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds" event={"ID":"cb2a0132-66b7-4d5d-8f78-c970ca2f4b55","Type":"ContainerDied","Data":"6119f70238c8fcd71d2d0053e0321b40d11d1df64424c112053a6b4cca6e2187"}
Jul 22 14:33:16.460822 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:16.460731    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6119f70238c8fcd71d2d0053e0321b40d11d1df64424c112053a6b4cca6e2187"
Jul 22 14:33:23.638915 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:23.638883    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"]
Jul 22 14:33:23.639518 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:23.639244    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx" podUID="629ecf3b-7094-461d-8580-162ca906a9e6" containerName="maas-api" containerID="cri-o://53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643" gracePeriod=30
Jul 22 14:33:23.662194 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:23.662167    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs"]
Jul 22 14:33:23.666307 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:23.666287    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f0b3df-29745510-b4qrs"]
Jul 22 14:33:23.883255 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:23.883236    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:33:23.991368 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:23.991304    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/629ecf3b-7094-461d-8580-162ca906a9e6-maas-api-tls\") pod \"629ecf3b-7094-461d-8580-162ca906a9e6\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") "
Jul 22 14:33:23.991368 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:23.991350    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/629ecf3b-7094-461d-8580-162ca906a9e6-openshift-service-ca\") pod \"629ecf3b-7094-461d-8580-162ca906a9e6\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") "
Jul 22 14:33:23.991510 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:23.991426    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcfhq\" (UniqueName: \"kubernetes.io/projected/629ecf3b-7094-461d-8580-162ca906a9e6-kube-api-access-lcfhq\") pod \"629ecf3b-7094-461d-8580-162ca906a9e6\" (UID: \"629ecf3b-7094-461d-8580-162ca906a9e6\") "
Jul 22 14:33:23.991721 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:23.991699    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/629ecf3b-7094-461d-8580-162ca906a9e6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "629ecf3b-7094-461d-8580-162ca906a9e6" (UID: "629ecf3b-7094-461d-8580-162ca906a9e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 14:33:23.993407 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:23.993383    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/629ecf3b-7094-461d-8580-162ca906a9e6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "629ecf3b-7094-461d-8580-162ca906a9e6" (UID: "629ecf3b-7094-461d-8580-162ca906a9e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 14:33:23.993575 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:23.993562    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/629ecf3b-7094-461d-8580-162ca906a9e6-kube-api-access-lcfhq" (OuterVolumeSpecName: "kube-api-access-lcfhq") pod "629ecf3b-7094-461d-8580-162ca906a9e6" (UID: "629ecf3b-7094-461d-8580-162ca906a9e6"). InnerVolumeSpecName "kube-api-access-lcfhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 14:33:24.092254 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.092231    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/629ecf3b-7094-461d-8580-162ca906a9e6-openshift-service-ca\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:33:24.092254 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.092251    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcfhq\" (UniqueName: \"kubernetes.io/projected/629ecf3b-7094-461d-8580-162ca906a9e6-kube-api-access-lcfhq\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:33:24.092378 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.092263    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/629ecf3b-7094-461d-8580-162ca906a9e6-maas-api-tls\") on node \"ip-10-0-131-79.ec2.internal\" DevicePath \"\""
Jul 22 14:33:24.253009 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.252949    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="431939ca-160a-4dfa-9778-93f5401648a8" path="/var/lib/kubelet/pods/431939ca-160a-4dfa-9778-93f5401648a8/volumes"
Jul 22 14:33:24.498704 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.498670    2578 generic.go:356] "Generic (PLEG): container finished" podID="629ecf3b-7094-461d-8580-162ca906a9e6" containerID="53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643" exitCode=0
Jul 22 14:33:24.498884 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.498738    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"
Jul 22 14:33:24.498884 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.498756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx" event={"ID":"629ecf3b-7094-461d-8580-162ca906a9e6","Type":"ContainerDied","Data":"53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643"}
Jul 22 14:33:24.498884 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.498822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx" event={"ID":"629ecf3b-7094-461d-8580-162ca906a9e6","Type":"ContainerDied","Data":"3116c940c7eeefdda712e9b89af1528722aa2abeccd719507bfcdd78cc117132"}
Jul 22 14:33:24.498884 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.498852    2578 scope.go:117] "RemoveContainer" containerID="53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643"
Jul 22 14:33:24.507735 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.507706    2578 scope.go:117] "RemoveContainer" containerID="53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643"
Jul 22 14:33:24.508022 ip-10-0-131-79 kubenswrapper[2578]: E0722 14:33:24.508003    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643\": container with ID starting with 53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643 not found: ID does not exist" containerID="53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643"
Jul 22 14:33:24.508090 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.508029    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643"} err="failed to get container status \"53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643\": rpc error: code = NotFound desc = could not find container \"53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643\": container with ID starting with 53dbf0d494b99d2f711ee989772fa9a8f7beaf0d396a348b867ca012bd0e9643 not found: ID does not exist"
Jul 22 14:33:24.516544 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.516519    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"]
Jul 22 14:33:24.520010 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:24.519987    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0b3df-5dfd8fbf65-2nlkx"]
Jul 22 14:33:26.254450 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:26.254413    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="629ecf3b-7094-461d-8580-162ca906a9e6" path="/var/lib/kubelet/pods/629ecf3b-7094-461d-8580-162ca906a9e6/volumes"
Jul 22 14:33:28.315069 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:28.315029    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"]
Jul 22 14:33:28.316601 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:28.316580    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f0b3df-k9sds"]
Jul 22 14:33:30.254258 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:30.254230    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb2a0132-66b7-4d5d-8f78-c970ca2f4b55" path="/var/lib/kubelet/pods/cb2a0132-66b7-4d5d-8f78-c970ca2f4b55/volumes"
Jul 22 14:33:41.496360 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:41.496332    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ps925_65300060-834d-49fd-8de5-dc49e640cd36/manager/0.log"
Jul 22 14:33:41.628295 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:41.628266    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j445x_ae658cde-f494-4fb8-87db-85c3339f572e/manager/0.log"
Jul 22 14:33:41.760505 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:41.760442    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fdc48c68d-stwrm_d8abf520-dd24-45ed-a317-6f3859e34a61/manager/0.log"
Jul 22 14:33:41.882637 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:41.882617    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bzv47_ea680b58-c815-4c08-abb7-a3111862c3b5/server/0.log"
Jul 22 14:33:42.014521 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:42.014476    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hbtbr_b58d1e15-745d-4b8e-b2ab-a146faa236db/manager/0.log"
Jul 22 14:33:42.140358 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:42.140339    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-24g6c_b13809ff-28f4-4758-9c08-9410140094a3/copy-manifests/0.log"
Jul 22 14:33:42.152906 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:42.152884    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-24g6c_b13809ff-28f4-4758-9c08-9410140094a3/manager/0.log"
Jul 22 14:33:42.902880 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:42.902847    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745480-ds66w_fa9a488d-3994-4e86-aa33-5984cdf75498/cleanup/0.log"
Jul 22 14:33:43.025717 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:43.025691    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745495-q5r64_750b7f5f-e33a-442a-960c-235a33968feb/cleanup/0.log"
Jul 22 14:33:43.145123 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:43.145097    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745510-zndpb_3160e6a2-9101-4106-8bf7-5c7ff6be7347/cleanup/0.log"
Jul 22 14:33:44.773279 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:44.773247    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-f9dfj_df8b4bf0-39a6-4a39-a184-bc08bd7d8d9a/manager/0.log"
Jul 22 14:33:45.248752 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:45.248681    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xf2tj_5eca4adb-7a50-45f4-9f36-4acea7978ed0/manager/0.log"
Jul 22 14:33:46.015264 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:46.015236    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q9vrm_3737d350-7f2b-461c-bc39-2b9320dd4f20/discovery/0.log"
Jul 22 14:33:46.253898 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:46.253877    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cd5b47b7c-nnkb2_fe65266c-2a0d-4684-9304-0b94d5363ed3/kube-auth-proxy/0.log"
Jul 22 14:33:47.226706 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:47.226685    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-pwpht_f3dd58c5-60b2-4e78-a41a-c01509c22e98/main/0.log"
Jul 22 14:33:47.347943 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:47.347918    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-l2tzm_b4b789f9-7ed1-493f-ad0e-668a6f0a7268/main/0.log"
Jul 22 14:33:56.314575 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:56.314548    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lhzsv_b6ab0dc0-2fd6-4dae-a463-72bcb343e1c6/global-pull-secret-syncer/0.log"
Jul 22 14:33:56.407333 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:56.407307    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k67cl_0ae56745-0d4a-4fa5-9dde-82570c20980b/konnectivity-agent/0.log"
Jul 22 14:33:56.495673 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:33:56.495653    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-79.ec2.internal_e8d0181de62365719ca8addca6e9fe43/haproxy/0.log"
Jul 22 14:34:02.423820 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:02.423796    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-f9dfj_df8b4bf0-39a6-4a39-a184-bc08bd7d8d9a/manager/0.log"
Jul 22 14:34:02.686527 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:02.686450    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xf2tj_5eca4adb-7a50-45f4-9f36-4acea7978ed0/manager/0.log"
Jul 22 14:34:04.692530 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:04.692499    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m69c_3ce9363a-82d2-46ca-a400-e74fbdbb6f32/node-exporter/0.log"
Jul 22 14:34:04.717098 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:04.717075    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m69c_3ce9363a-82d2-46ca-a400-e74fbdbb6f32/kube-rbac-proxy/0.log"
Jul 22 14:34:04.751031 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:04.751010    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4m69c_3ce9363a-82d2-46ca-a400-e74fbdbb6f32/init-textfile/0.log"
Jul 22 14:34:06.221075 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.221030    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"]
Jul 22 14:34:06.221595 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.221566    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629ecf3b-7094-461d-8580-162ca906a9e6" containerName="maas-api"
Jul 22 14:34:06.221595 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.221591    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="629ecf3b-7094-461d-8580-162ca906a9e6" containerName="maas-api"
Jul 22 14:34:06.221734 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.221609    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2a0132-66b7-4d5d-8f78-c970ca2f4b55" containerName="revoke-keys"
Jul 22 14:34:06.221734 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.221619    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2a0132-66b7-4d5d-8f78-c970ca2f4b55" containerName="revoke-keys"
Jul 22 14:34:06.221734 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.221722    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="629ecf3b-7094-461d-8580-162ca906a9e6" containerName="maas-api"
Jul 22 14:34:06.221878 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.221737    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2a0132-66b7-4d5d-8f78-c970ca2f4b55" containerName="revoke-keys"
Jul 22 14:34:06.224979 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.224951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.227336 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.227311    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nmppv\"/\"openshift-service-ca.crt\""
Jul 22 14:34:06.227836 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.227812    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nmppv\"/\"default-dockercfg-f2m7r\""
Jul 22 14:34:06.227836 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.227832    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nmppv\"/\"kube-root-ca.crt\""
Jul 22 14:34:06.235013 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.234993    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"]
Jul 22 14:34:06.288402 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.288379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-sys\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.288514 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.288409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-proc\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.288588 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.288564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhkjf\" (UniqueName: \"kubernetes.io/projected/18512d7f-e715-406d-836d-861415fc5a9b-kube-api-access-bhkjf\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.288643 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.288629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-lib-modules\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.288786 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.288767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-podres\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.389777 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.389754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-podres\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.389889 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.389789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-sys\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.389889 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.389805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-proc\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.389889 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.389847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhkjf\" (UniqueName: \"kubernetes.io/projected/18512d7f-e715-406d-836d-861415fc5a9b-kube-api-access-bhkjf\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.389889 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.389874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-sys\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.389889 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.389886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-lib-modules\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.390178 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.389918    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-podres\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.390178 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.389918    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-proc\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.390178 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.389974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18512d7f-e715-406d-836d-861415fc5a9b-lib-modules\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.398404 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.398379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhkjf\" (UniqueName: \"kubernetes.io/projected/18512d7f-e715-406d-836d-861415fc5a9b-kube-api-access-bhkjf\") pod \"perf-node-gather-daemonset-76nkb\" (UID: \"18512d7f-e715-406d-836d-861415fc5a9b\") " pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.536623 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.536599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:06.671418 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.671395    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"]
Jul 22 14:34:06.673542 ip-10-0-131-79 kubenswrapper[2578]: W0722 14:34:06.673512    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod18512d7f_e715_406d_836d_861415fc5a9b.slice/crio-da94541a1614abbef04a6a93b1052aad54c932d48a466ec0e80f0a95a4da872f WatchSource:0}: Error finding container da94541a1614abbef04a6a93b1052aad54c932d48a466ec0e80f0a95a4da872f: Status 404 returned error can't find the container with id da94541a1614abbef04a6a93b1052aad54c932d48a466ec0e80f0a95a4da872f
Jul 22 14:34:06.693873 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:06.693841    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb" event={"ID":"18512d7f-e715-406d-836d-861415fc5a9b","Type":"ContainerStarted","Data":"da94541a1614abbef04a6a93b1052aad54c932d48a466ec0e80f0a95a4da872f"}
Jul 22 14:34:07.706691 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:07.706649    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb" event={"ID":"18512d7f-e715-406d-836d-861415fc5a9b","Type":"ContainerStarted","Data":"eb383875a23e0832739fda91421d2457eca7ca675adab81004d8ac02230719f8"}
Jul 22 14:34:07.707196 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:07.706746    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:07.723204 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:07.723153    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb" podStartSLOduration=1.7231229209999999 podStartE2EDuration="1.723122921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 14:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 14:34:07.72169261 +0000 UTC m=+2871.963787575" watchObservedRunningTime="2026-07-22 14:34:07.723122921 +0000 UTC m=+2871.965217885"
Jul 22 14:34:09.413544 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:09.413508    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xfm7k_de6d3f3c-6c8c-400b-b511-7078e838b585/dns/0.log"
Jul 22 14:34:09.435810 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:09.435786    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xfm7k_de6d3f3c-6c8c-400b-b511-7078e838b585/kube-rbac-proxy/0.log"
Jul 22 14:34:09.482110 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:09.482088    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bl7wx_b12fed3b-5144-4cf4-8cd3-97c7d8ff79bc/dns-node-resolver/0.log"
Jul 22 14:34:10.044709 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:10.044679    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7cd6498b6-dmctp_bb1c2ab7-041c-4455-8212-d83a3fbde80c/registry/0.log"
Jul 22 14:34:10.120373 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:10.120346    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvdhd_dca31c51-02c6-473f-8e76-1aace19d0a56/node-ca/0.log"
Jul 22 14:34:11.226328 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:11.226269    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q9vrm_3737d350-7f2b-461c-bc39-2b9320dd4f20/discovery/0.log"
Jul 22 14:34:11.269267 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:11.269241    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cd5b47b7c-nnkb2_fe65266c-2a0d-4684-9304-0b94d5363ed3/kube-auth-proxy/0.log"
Jul 22 14:34:12.169415 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:12.169379    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gl2jr_be7e8412-9c60-47f7-8e1f-82ebf2dc3e1c/serve-healthcheck-canary/0.log"
Jul 22 14:34:12.759028 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:12.758999    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p4pzr_213fb125-317a-4998-a425-21b3cff4da1d/kube-rbac-proxy/0.log"
Jul 22 14:34:12.780079 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:12.780056    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p4pzr_213fb125-317a-4998-a425-21b3cff4da1d/exporter/0.log"
Jul 22 14:34:12.801111 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:12.801089    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p4pzr_213fb125-317a-4998-a425-21b3cff4da1d/extractor/0.log"
Jul 22 14:34:13.722236 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:13.722211    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nmppv/perf-node-gather-daemonset-76nkb"
Jul 22 14:34:14.907843 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:14.907805    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ps925_65300060-834d-49fd-8de5-dc49e640cd36/manager/0.log"
Jul 22 14:34:15.084715 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:15.084684    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j445x_ae658cde-f494-4fb8-87db-85c3339f572e/manager/0.log"
Jul 22 14:34:15.191897 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:15.191825    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fdc48c68d-stwrm_d8abf520-dd24-45ed-a317-6f3859e34a61/manager/0.log"
Jul 22 14:34:15.212120 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:15.212099    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bzv47_ea680b58-c815-4c08-abb7-a3111862c3b5/server/0.log"
Jul 22 14:34:15.280119 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:15.280098    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hbtbr_b58d1e15-745d-4b8e-b2ab-a146faa236db/manager/0.log"
Jul 22 14:34:15.363482 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:15.363456    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-24g6c_b13809ff-28f4-4758-9c08-9410140094a3/manager/0.log"
Jul 22 14:34:15.380978 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:15.380956    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65657c6f45-24g6c_b13809ff-28f4-4758-9c08-9410140094a3/copy-manifests/0.log"
Jul 22 14:34:16.727254 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:16.727228    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q9vrm_3737d350-7f2b-461c-bc39-2b9320dd4f20/discovery/0.log"
Jul 22 14:34:16.754909 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:16.754887    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cd5b47b7c-nnkb2_fe65266c-2a0d-4684-9304-0b94d5363ed3/kube-auth-proxy/0.log"
Jul 22 14:34:18.288798 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:18.288773    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-q9vrm_3737d350-7f2b-461c-bc39-2b9320dd4f20/discovery/0.log"
Jul 22 14:34:18.320358 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:18.320332    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cd5b47b7c-nnkb2_fe65266c-2a0d-4684-9304-0b94d5363ed3/kube-auth-proxy/0.log"
Jul 22 14:34:21.963523 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:21.963467    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-k7ds2_60506615-cbfb-449d-bc37-af38df219308/migrator/0.log"
Jul 22 14:34:21.983710 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:21.983686    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-k7ds2_60506615-cbfb-449d-bc37-af38df219308/graceful-termination/0.log"
Jul 22 14:34:23.536638 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:23.536606    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bdxf_57f9f457-158b-4e7e-907c-a431f3892e96/kube-multus-additional-cni-plugins/0.log"
Jul 22 14:34:23.556536 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:23.556513    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bdxf_57f9f457-158b-4e7e-907c-a431f3892e96/egress-router-binary-copy/0.log"
Jul 22 14:34:23.575215 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:23.575201    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bdxf_57f9f457-158b-4e7e-907c-a431f3892e96/cni-plugins/0.log"
Jul 22 14:34:23.598748 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:23.598732    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bdxf_57f9f457-158b-4e7e-907c-a431f3892e96/bond-cni-plugin/0.log"
Jul 22 14:34:23.618503 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:23.618483    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bdxf_57f9f457-158b-4e7e-907c-a431f3892e96/routeoverride-cni/0.log"
Jul 22 14:34:23.637699 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:23.637678    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bdxf_57f9f457-158b-4e7e-907c-a431f3892e96/whereabouts-cni-bincopy/0.log"
Jul 22 14:34:23.656417 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:23.656393    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bdxf_57f9f457-158b-4e7e-907c-a431f3892e96/whereabouts-cni/0.log"
Jul 22 14:34:23.880772 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:23.880716    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nppcl_1840c625-3bd6-47b6-8499-81e605f84dd1/kube-multus/0.log"
Jul 22 14:34:23.952578 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:23.952557    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q47d2_d252f413-c17e-4a0c-a75a-c4879f6402d4/network-metrics-daemon/0.log"
Jul 22 14:34:23.970175 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:23.970154    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q47d2_d252f413-c17e-4a0c-a75a-c4879f6402d4/kube-rbac-proxy/0.log"
Jul 22 14:34:24.818386 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:24.818355    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-controller/0.log"
Jul 22 14:34:24.835981 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:24.835954    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/1.log"
Jul 22 14:34:24.836124 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:24.836032    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/ovn-acl-logging/0.log"
Jul 22 14:34:24.853628 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:24.853608    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/kube-rbac-proxy-node/0.log"
Jul 22 14:34:24.875305 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:24.875284    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/kube-rbac-proxy-ovn-metrics/0.log"
Jul 22 14:34:24.894937 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:24.894917    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/northd/0.log"
Jul 22 14:34:24.914890 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:24.914684    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/nbdb/0.log"
Jul 22 14:34:24.934480 ip-10-0-131-79 kubenswrapper[2578]: I0722 14:34:24.934462    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76njp_582ca5fa-2185-4721-8cbf-e6adfdaffa61/sbdb/0.log"