Jul 15 16:59:01.730118 ip-10-0-135-100 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.083855    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.089247    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.089264    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.089268    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.089271    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.089275    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.089278    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.089281    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:59:02.173907 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.089285    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:59:02.157424 ip-10-0-135-100 systemd[1]: Started Kubernetes Kubelet.
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.089288    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.089295    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090004    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090021    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090026    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090032    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090036    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090039    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090043    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090046    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090050    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090053    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090056    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090060    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090067    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090070    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090073    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090076    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090080    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:59:02.175072 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090083    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090086    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090089    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090092    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090096    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090099    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090104    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090108    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090119    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090124    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090128    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090133    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090137    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090142    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090146    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090151    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090155    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090160    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090167    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090171    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:59:02.176066 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090182    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090187    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090191    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090196    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090200    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090204    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090210    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090214    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090218    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090222    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090226    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090231    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090235    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090244    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090248    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090253    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090257    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090262    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090267    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090283    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:59:02.177182 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090287    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090292    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090296    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090301    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090306    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090352    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090358    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090364    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090372    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090377    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090381    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090386    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090390    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090395    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090402    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090409    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090420    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090425    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090429    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:59:02.178050 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090434    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090439    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090443    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090448    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090452    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090456    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090461    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090465    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090470    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090475    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090484    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090489    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.090495    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091521    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091533    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091537    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091540    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091543    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091546    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:59:02.178832 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091549    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091551    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091554    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091557    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091559    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091562    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091565    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091567    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091570    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091573    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091576    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091580    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091585    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091589    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091592    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091594    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091597    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091600    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091602    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091605    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:59:02.179722 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091608    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091610    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091614    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091616    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091619    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091622    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091624    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091627    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091629    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091632    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091635    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091638    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091640    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091643    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091645    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091648    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091651    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091655    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091659    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:59:02.180720 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091662    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091665    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091668    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091670    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091673    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091676    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091679    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091682    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091684    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091687    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091690    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091694    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091698    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091701    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091704    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091706    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091709    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091712    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091714    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:59:02.182211 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091717    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091719    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091722    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091725    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091727    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091730    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091733    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091735    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091738    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091740    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091743    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091745    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091748    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091751    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091753    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091756    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091758    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091761    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091763    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091767    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:59:02.183272 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091787    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091790    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091794    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091797    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091800    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091802    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091805    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091808    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091811    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091813    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091816    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091818    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091821    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091824    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.091826    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092212    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092217    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092220    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092223    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092225    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:59:02.184703 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092228    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092231    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092234    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092240    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092243    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092245    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092248    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092250    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092253    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092256    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092258    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092262    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092265    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092267    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092270    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092273    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092276    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092278    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092281    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092283    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:59:02.185741 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092286    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092288    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092291    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092293    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092296    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092299    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092302    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092304    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092307    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092309    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092312    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092314    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092318    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092321    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092325    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092329    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092332    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092334    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092337    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:59:02.186996 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092340    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092342    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092345    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092347    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092350    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092353    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092356    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092358    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092361    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092364    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092366    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092369    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092371    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092375    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092377    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092380    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092383    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092385    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092388    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092391    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:59:02.187871 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092393    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092396    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092398    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092401    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092403    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092406    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092409    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092412    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092415    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092418    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092421    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092423    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092426    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092428    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092431    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092433    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092436    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092438    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092442    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092445    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:59:02.188482 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092447    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092452    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092455    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092458    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092461    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092464    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092467    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092469    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092472    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092475    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092478    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092481    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092483    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092487    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.092490    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092563    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092570    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092577    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092582    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092586    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092592    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 16:59:02.189408 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092596    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092600    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092603    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092607    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092610    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092613    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092617    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092620    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092622    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092625    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092629    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092632    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092636    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092639    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092642    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092646    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092649    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092653    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092656    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092659    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092663    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092666    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092669    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092672    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 16:59:02.190374 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092675    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092678    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092682    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092686    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092689    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092691    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092695    2556 flags.go:64] FLAG: --enable-server="true"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092699    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092705    2556 flags.go:64] FLAG: --event-burst="100"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092708    2556 flags.go:64] FLAG: --event-qps="50"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092710    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092713    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092716    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092720    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092723    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092726    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092729    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092732    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092735    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092741    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092744    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092747    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092751    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092753    2556 flags.go:64] FLAG: --feature-gates=""
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092758    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 16:59:02.191589 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092761    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092764    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092767    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092785    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092789    2556 flags.go:64] FLAG: --help="false"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092793    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-135-100.ec2.internal"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092796    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092799    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092802    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092805    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092809    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092812    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092815    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092818    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092822    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092825    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092828    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092831    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092834    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092837    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092840    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092843    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092845    2556 flags.go:64] FLAG: --lock-file=""
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092848    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 16:59:02.192871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092851    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092854    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092859    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092863    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092866    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092869    2556 flags.go:64] FLAG: --logging-format="text"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092872    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092875    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092878    2556 flags.go:64] FLAG: --manifest-url=""
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092881    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092885    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092888    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092892    2556 flags.go:64] FLAG: --max-pods="110"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092895    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092898    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092901    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092904    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092907    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092909    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092912    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092920    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092923    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092928    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 16:59:02.193882 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092931    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092934    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092939    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092941    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092944    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092947    2556 flags.go:64] FLAG: --port="10250"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092950    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092953    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00f0595ad1d715a99"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092956    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092959    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092962    2556 flags.go:64] FLAG: --register-node="true"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092967    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092970    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092975    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092978    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092980    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092984    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092995    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.092998    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093001    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093004    2556 flags.go:64] FLAG: --runonce="false"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093007    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093010    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093013    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093016    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 16:59:02.194477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093018    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093021    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093024    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093027    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093031    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093033    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093036    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093040    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093043    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093046    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093049    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093054    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093057    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093060    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093064    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093067    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093069    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093072    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093076    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093079    2556 flags.go:64] FLAG: --v="2"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093083    2556 flags.go:64] FLAG: --version="false"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093087    2556 flags.go:64] FLAG: --vmodule=""
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093091    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.093094    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093211    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:59:02.195157 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093215    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093219    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093222    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093225    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093228    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093232    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093235    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093238    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093241    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093244    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093246    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093249    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093251    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093254    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093258    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093260    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093263    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093266    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:59:02.196234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093268    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093271    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093273    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093276    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093279    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093282    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093284    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093288    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093291    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093294    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093297    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093300    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093303    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093306    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093308    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093311    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093313    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093316    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093319    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093321    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:59:02.196820 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093324    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093326    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093329    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093332    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093336    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093339    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093342    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093345    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093349    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093352    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093354    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093357    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093359    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093362    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093364    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093367    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093369    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093372    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093375    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093379    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:59:02.197718 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093382    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093384    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093387    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093389    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093393    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093395    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093398    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093400    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093403    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093405    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093408    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093410    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093413    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093416    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093418    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093421    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093423    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093426    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093428    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093431    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:59:02.199169 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093434    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093437    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093440    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093442    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093445    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093447    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093450    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093452    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093455    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093458    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093460    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093464    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093467    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093469    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093472    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093475    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093479    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093482    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093485    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:59:02.199786 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.093487    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.094090    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.100621    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.100638    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.100657    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.100663    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100719    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100725    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100730    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100734    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100737    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100740    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100743    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100745    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:59:02.200382 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100748    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100751    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100755    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100758    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100761    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100764    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100787    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100806    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100820    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100824    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100827    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100830    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100833    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100836    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100838    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100842    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100848    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100851    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100854    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:59:02.201210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100857    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100862    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100866    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100869    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100872    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100875    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100878    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100885    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100888    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100890    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100893    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100896    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100899    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100901    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100904    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100907    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100909    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100912    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100915    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100918    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:59:04.410529 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100921    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100926    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100928    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100931    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100933    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100936    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100939    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100941    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100945    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100947    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100951    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100954    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100957    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100960    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100962    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100965    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100968    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100970    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100973    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100978    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:59:04.435059 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100980    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.100983    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101028    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101032    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101035    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101037    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101040    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101056    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101058    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101061    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101064    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101259    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101262    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101266    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101269    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101464    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101468    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101470    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101473    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101476    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:59:04.435797 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101521    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101524    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101604    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101639    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101671    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101674    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101677    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101679    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101683    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101885    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101889    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.101936    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.102019    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103148    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103155    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:59:04.436501 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103159    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103162    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103165    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103167    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103170    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103173    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103175    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103178    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103181    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103183    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103186    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103190    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103193    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103195    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103198    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103201    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103203    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103206    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103209    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103211    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:59:04.437012 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103214    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103217    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103220    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103222    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103225    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103227    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103230    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103233    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103236    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103239    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103242    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103245    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103247    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103250    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103253    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103255    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103259    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103263    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103266    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:59:04.437647 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103269    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103272    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103275    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103277    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103281    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103284    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103287    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103290    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103292    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103295    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103297    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103300    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103303    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103305    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103308    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103311    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103314    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103317    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103320    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103322    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:59:04.438220 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103325    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103328    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103331    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103334    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103336    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103339    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103341    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103344    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103347    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103349    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103352    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103354    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103357    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103359    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103362    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103365    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103369    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103371    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103374    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103377    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:59:04.438915 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103379    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103382    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103384    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103387    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103389    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103392    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103395    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103397    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103400    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103403    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103407    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103410    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103414    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103423    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103426    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103429    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103431    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:59:04.439612 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:02.103434    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.103439    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.103559    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.105668    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.107048    2556 server.go:1019] "Starting client certificate rotation"
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.107146    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.107182    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.109264    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.110450    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.123817    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.127633    2556 log.go:25] "Validated CRI v1 image API"
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.129012    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 16:59:04.440423 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.131305    2556 fs.go:135] Filesystem UUIDs: map[48c58cc1-8839-4ad8-b72c-a43926248d85:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 930ccdd7-7df2-44e2-9dbf-6c51d2a9b600:/dev/nvme0n1p3]
Jul 15 16:59:04.440835 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.131320    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 16:59:04.441446 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.136551    2556 manager.go:216] Machine: {Timestamp:2026-07-15 16:59:02.136069894 +0000 UTC m=+0.295423901 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102518 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec238c5c0f1dd5a52ea7f0ce6a353a9a SystemUUID:ec238c5c-0f1d-d5a5-2ea7-f0ce6a353a9a BootID:9f237314-5c52-4e37-8324-0aa7b8fcf2ce Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9d:8a:bf:4b:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9d:8a:bf:4b:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:29:12:c9:f6:74 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 16:59:04.441446 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.136650    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 16:59:04.441446 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.136762    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 16:59:04.441446 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.139347    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 16:59:04.441446 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.139377    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 16:59:04.441446 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.140000    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 16:59:04.441446 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.140010    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 16:59:04.441446 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.140027    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.140786    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.142081    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.142518    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.146054    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.146171    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.146200    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.146216    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.146230    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.146239    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.146248    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.146620    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.146640    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.149093    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.150835    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.150876    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151056    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151069    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151076    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151082    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151092    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151100    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151489    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151498    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151507    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151515    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151525    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.151533    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.152898    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.152911    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.156147    2556 server.go:1268] "Started kubelet"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.156294    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.156368    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.156802    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.157416    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.159147    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.163065    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.163840    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.164119    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.164495    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.164517    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.164538    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.164711    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.164860    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.164869    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 16:59:04.442006 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.165128    2556 factory.go:55] Registering systemd factory
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.165152    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.166326    2556 factory.go:153] Registering CRI-O factory
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.166345    2556 factory.go:223] Registration of the crio container factory successfully
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.166399    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.166423    2556 factory.go:103] Registering Raw factory
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.166448    2556 manager.go:1196] Started watching for new ooms in manager
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.166847    2556 manager.go:349] Starting recovery of all containers
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.172717    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.172711    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.173229    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.173229    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.173931    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.172763    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-100.ec2.internal.18c2851861a603e0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-100.ec2.internal,UID:ip-10-0-135-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-100.ec2.internal,},FirstTimestamp:2026-07-15 16:59:02.15611696 +0000 UTC m=+0.315470966,LastTimestamp:2026-07-15 16:59:02.15611696 +0000 UTC m=+0.315470966,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-100.ec2.internal,}"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.177160    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.178860    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sqx58"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.187722    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sqx58"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.189200    2556 manager.go:354] Recovery completed
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.193510    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.195924    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.195961    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.195978    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.196528    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.196540    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.196557    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.196568    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.199757    2556 policy_none.go:49] "None policy: Start"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.199785    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 16:59:04.443951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.199797    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.201701    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.201723    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.201737    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.201848    2556 policy_none.go:47] "Start"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.201819    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-100.ec2.internal.18c285186405ae37  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-100.ec2.internal,UID:ip-10-0-135-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-100.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-100.ec2.internal,},FirstTimestamp:2026-07-15 16:59:02.195940919 +0000 UTC m=+0.355294928,LastTimestamp:2026-07-15 16:59:02.195940919 +0000 UTC m=+0.355294928,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-100.ec2.internal,}"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.247359    2556 manager.go:337] "Starting Device Plugin manager"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.247584    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.247598    2556 server.go:87] "Starting device plugin registration server"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.247920    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.247933    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.248106    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.248239    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.248254    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.248814    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.248861    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.349123    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.350700    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.350726    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.350736    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.350763    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.357133    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.357164    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.357189    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.357232    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.360861    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:02.360880    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-100.ec2.internal\": node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:02.361054    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:59:04.444770 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:04.416437    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.459465    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-100.ec2.internal"]
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.459552    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.461422    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.461450    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.461461    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.463950    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.464133    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.464167    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.464707    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.464752    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.464762    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.464707    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.464828    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.464841    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.466999    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.467022    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.467656    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24fdbde66c62e7d855b5c05ac038501c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-100.ec2.internal\" (UID: \"24fdbde66c62e7d855b5c05ac038501c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.467679    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8204099467c290a1439f461fa8319f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal\" (UID: \"e8204099467c290a1439f461fa8319f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.467706    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8204099467c290a1439f461fa8319f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal\" (UID: \"e8204099467c290a1439f461fa8319f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.467972    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.467999    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.468009    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:04.493814    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-100.ec2.internal\" not found" node="ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:04.498345    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-100.ec2.internal\" not found" node="ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611061 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:04.516969    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:04.611946 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.568084    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8204099467c290a1439f461fa8319f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal\" (UID: \"e8204099467c290a1439f461fa8319f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611946 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.568112    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8204099467c290a1439f461fa8319f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal\" (UID: \"e8204099467c290a1439f461fa8319f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611946 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.568174    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24fdbde66c62e7d855b5c05ac038501c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-100.ec2.internal\" (UID: \"24fdbde66c62e7d855b5c05ac038501c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611946 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.568180    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8204099467c290a1439f461fa8319f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal\" (UID: \"e8204099467c290a1439f461fa8319f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611946 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.568199    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24fdbde66c62e7d855b5c05ac038501c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-100.ec2.internal\" (UID: \"24fdbde66c62e7d855b5c05ac038501c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.611946 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.568231    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8204099467c290a1439f461fa8319f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal\" (UID: \"e8204099467c290a1439f461fa8319f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.785504 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:04.617878    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:04.785504 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:04.718470    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:04.881975 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.796249    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.881975 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:04.800884    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:04.881975 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:04.818974    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:04.944393 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:04.920845    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:05.075536 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:05.021462    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:05.075536 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.068971    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:59:05.108584 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.108560    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 16:59:05.108757 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.108737    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 16:59:05.108817 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.108764    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 16:59:05.121923 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:05.121895    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:05.193949 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.193912    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 16:54:04 +0000 UTC" deadline="2028-04-14 09:08:51.701388112 +0000 UTC"
Jul 15 16:59:05.193949 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.193939    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15328h9m46.507453471s"
Jul 15 16:59:05.223033 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:05.222999    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:05.323655 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:05.323617    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-100.ec2.internal\" not found"
Jul 15 16:59:05.328162 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.328108    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:59:05.367779 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.367727    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:05.379869 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.379844    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 16:59:05.381282 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.381269    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal"
Jul 15 16:59:05.399904 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.399884    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 16:59:05.507877 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.507850    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:59:05.552475 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:05.552448    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24fdbde66c62e7d855b5c05ac038501c.slice/crio-7d7904f8b06b5aee7030f7749fb7341b4dd45b54e196c74062cea2292b161018 WatchSource:0}: Error finding container 7d7904f8b06b5aee7030f7749fb7341b4dd45b54e196c74062cea2292b161018: Status 404 returned error can't find the container with id 7d7904f8b06b5aee7030f7749fb7341b4dd45b54e196c74062cea2292b161018
Jul 15 16:59:05.557244 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:05.557229    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:59:05.748920 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:05.748894    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8204099467c290a1439f461fa8319f1.slice/crio-d4c621a99391d53ec33aa382d56c273c6d6a201dd1e89845d1a562e4067428f7 WatchSource:0}: Error finding container d4c621a99391d53ec33aa382d56c273c6d6a201dd1e89845d1a562e4067428f7: Status 404 returned error can't find the container with id d4c621a99391d53ec33aa382d56c273c6d6a201dd1e89845d1a562e4067428f7
Jul 15 16:59:06.149357 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.149270    2556 apiserver.go:52] "Watching apiserver"
Jul 15 16:59:06.158446 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.158419    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 16:59:06.158861 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.158830    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs","openshift-dns/node-resolver-6rcnp","openshift-image-registry/node-ca-5h7m5","openshift-multus/multus-additional-cni-plugins-cqdbp","openshift-multus/network-metrics-daemon-w9xrc","openshift-network-diagnostics/network-check-target-4gg7t","openshift-network-operator/iptables-alerter-kplg4","openshift-ovn-kubernetes/ovnkube-node-ptpxl","kube-system/global-pull-secret-syncer-n8p6c","kube-system/konnectivity-agent-ktspg","kube-system/kube-apiserver-proxy-ip-10-0-135-100.ec2.internal","openshift-cluster-node-tuning-operator/tuned-n8plx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal","openshift-multus/multus-44vpb"]
Jul 15 16:59:06.161336 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.161302    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kplg4"
Jul 15 16:59:06.163596 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.163569    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.164416 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.164258    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 16:59:06.164416 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.164274    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:59:06.164416 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.164307    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-84ncz\""
Jul 15 16:59:06.164416 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.164337    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 16:59:06.165660 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.165637    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 16:59:06.165870 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.165852    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5h7m5"
Jul 15 16:59:06.166116 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.166094    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 16:59:06.166311 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.166289    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 16:59:06.166378 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.166334    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 16:59:06.166485 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.166467    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 16:59:06.166560 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.166498    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 16:59:06.166560 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.166551    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 16:59:06.166659 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.166641    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wtgrq\""
Jul 15 16:59:06.168081 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.168048    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 16:59:06.168168 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.168082    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 16:59:06.168380 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.168359    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.168909 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.168656    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 16:59:06.168909 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.168834    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kdwbd\""
Jul 15 16:59:06.170516 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.170351    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:06.170516 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.170437    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:06.170824 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.170804    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pjc4n\""
Jul 15 16:59:06.170914 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.170869    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 16:59:06.171022 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.171004    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 16:59:06.171080 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.171021    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 16:59:06.171135 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.171088    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 16:59:06.171135 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.171107    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 16:59:06.173135 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.173036    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:06.173135 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.173095    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:06.175451 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.175432    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:06.175525 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.175509    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:06.177137 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177112    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.177226 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-run-ovn-kubernetes\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.177226 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177178    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-ovnkube-script-lib\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.177338 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177240    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-log-socket\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.177338 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177278    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-system-cni-dir\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.177338 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177313    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-cnibin\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.177484 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177337    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kprnt\" (UniqueName: \"kubernetes.io/projected/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-kube-api-access-kprnt\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.177484 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177363    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-slash\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.177484 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-etc-openvswitch\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.177484 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177424    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-cni-netd\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.177669 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177515    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-env-overrides\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.177669 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177549    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5955d780-7eac-4662-9014-54b2386eda46-host\") pod \"node-ca-5h7m5\" (UID: \"5955d780-7eac-4662-9014-54b2386eda46\") " pod="openshift-image-registry/node-ca-5h7m5"
Jul 15 16:59:06.177669 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177573    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-os-release\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.177669 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177639    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.177876 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177672    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/61672c4a-6cab-4105-bc33-2c4065396cfd-iptables-alerter-script\") pod \"iptables-alerter-kplg4\" (UID: \"61672c4a-6cab-4105-bc33-2c4065396cfd\") " pod="openshift-network-operator/iptables-alerter-kplg4"
Jul 15 16:59:06.177876 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177696    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st9gs\" (UniqueName: \"kubernetes.io/projected/61672c4a-6cab-4105-bc33-2c4065396cfd-kube-api-access-st9gs\") pod \"iptables-alerter-kplg4\" (UID: \"61672c4a-6cab-4105-bc33-2c4065396cfd\") " pod="openshift-network-operator/iptables-alerter-kplg4"
Jul 15 16:59:06.177876 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177748    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-run-ovn\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.177876 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7gb4\" (UniqueName: \"kubernetes.io/projected/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-kube-api-access-q7gb4\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.177876 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177818    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-kubelet\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.177876 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177842    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-systemd-units\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.177876 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177863    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-run-openvswitch\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.178206 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177890    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-ovn-node-metrics-cert\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.178206 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177927    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-run-systemd\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.178206 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177954    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-node-log\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.178206 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.177992    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-cni-binary-copy\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.178206 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.178033    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.178206 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.178052    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-run-netns\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.178206 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.178077    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-cni-bin\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.178206 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.178100    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.178206 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.178138    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-ovnkube-config\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.178206 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.178168    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps2jt\" (UniqueName: \"kubernetes.io/projected/5955d780-7eac-4662-9014-54b2386eda46-kube-api-access-ps2jt\") pod \"node-ca-5h7m5\" (UID: \"5955d780-7eac-4662-9014-54b2386eda46\") " pod="openshift-image-registry/node-ca-5h7m5"
Jul 15 16:59:06.178206 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.178196    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61672c4a-6cab-4105-bc33-2c4065396cfd-host-slash\") pod \"iptables-alerter-kplg4\" (UID: \"61672c4a-6cab-4105-bc33-2c4065396cfd\") " pod="openshift-network-operator/iptables-alerter-kplg4"
Jul 15 16:59:06.178829 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.178226    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-var-lib-openvswitch\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.178829 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.178255    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.178829 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.178278    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5955d780-7eac-4662-9014-54b2386eda46-serviceca\") pod \"node-ca-5h7m5\" (UID: \"5955d780-7eac-4662-9014-54b2386eda46\") " pod="openshift-image-registry/node-ca-5h7m5"
Jul 15 16:59:06.180878 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.180411    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6rcnp"
Jul 15 16:59:06.180878 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.180551    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 16:59:06.182550 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.182100    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 16:59:06.183828 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.183047    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fcnm4\""
Jul 15 16:59:06.183828 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.183293    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 16:59:06.183828 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.183372    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 16:59:06.183828 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.183599    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 16:59:06.185139 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.184943    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 16:59:06.186500 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.186480    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-42kjl\""
Jul 15 16:59:06.187274 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.186641    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:06.189119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.189097    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 16:59:06.189205 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.189196    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t9hrp\""
Jul 15 16:59:06.189269 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.189099    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 16:59:06.191596 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.191574    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.194484 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.194463    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6njq9\""
Jul 15 16:59:06.194977 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.194863    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 16:59:06.195224 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.195205    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.197767 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.197747    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-92tpp\""
Jul 15 16:59:06.197969 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.197952    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 16:59:06.198122 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.198106    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:59:06.201283 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.201262    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bwbg6"
Jul 15 16:59:06.213120 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.212387    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bwbg6"
Jul 15 16:59:06.268650 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.268621    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 16:59:06.278706 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-cni-binary-copy\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.278878 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278733    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-run-netns\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.278878 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278767    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-socket-dir-parent\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.278878 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278793    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-sysctl-d\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.278878 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278819    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9555n\" (UniqueName: \"kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n\") pod \"network-check-target-4gg7t\" (UID: \"9d6f90aa-bf29-4788-b427-33cd74efbefe\") " pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:06.278878 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278842    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/814f06f1-1241-4b8f-982a-c65a7f5f3c1b-hosts-file\") pod \"node-resolver-6rcnp\" (UID: \"814f06f1-1241-4b8f-982a-c65a7f5f3c1b\") " pod="openshift-dns/node-resolver-6rcnp"
Jul 15 16:59:06.278878 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278871    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.279180 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-cnibin\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.279180 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278922    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxr68\" (UniqueName: \"kubernetes.io/projected/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-kube-api-access-fxr68\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.279180 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278952    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/814f06f1-1241-4b8f-982a-c65a7f5f3c1b-tmp-dir\") pod \"node-resolver-6rcnp\" (UID: \"814f06f1-1241-4b8f-982a-c65a7f5f3c1b\") " pod="openshift-dns/node-resolver-6rcnp"
Jul 15 16:59:06.279180 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278974    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06995ee8-bd63-4309-ad6c-e7365185af99-agent-certs\") pod \"konnectivity-agent-ktspg\" (UID: \"06995ee8-bd63-4309-ad6c-e7365185af99\") " pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:06.279180 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.278995    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-systemd\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.279180 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279021    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5955d780-7eac-4662-9014-54b2386eda46-serviceca\") pod \"node-ca-5h7m5\" (UID: \"5955d780-7eac-4662-9014-54b2386eda46\") " pod="openshift-image-registry/node-ca-5h7m5"
Jul 15 16:59:06.279180 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279046    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.279180 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh5q2\" (UniqueName: \"kubernetes.io/projected/d0593108-e3b3-4780-9f27-52ac2affd909-kube-api-access-dh5q2\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:06.279180 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279111    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-daemon-config\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.279180 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279135    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.279180 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279172    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-cnibin\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279224    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-slash\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279248    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-cni-netd\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279272    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-env-overrides\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279295    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-system-cni-dir\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279352    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-cni-binary-copy\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279388    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-cni-binary-copy\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279392    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-etc-kubernetes\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279412    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-run-netns\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279453    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-registration-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279521    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-slash\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279530    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279538    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-cni-netd\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279581    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-cnibin\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.279605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279602    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-os-release\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.279961    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-env-overrides\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280014    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/61672c4a-6cab-4105-bc33-2c4065396cfd-iptables-alerter-script\") pod \"iptables-alerter-kplg4\" (UID: \"61672c4a-6cab-4105-bc33-2c4065396cfd\") " pod="openshift-network-operator/iptables-alerter-kplg4"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280055    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st9gs\" (UniqueName: \"kubernetes.io/projected/61672c4a-6cab-4105-bc33-2c4065396cfd-kube-api-access-st9gs\") pod \"iptables-alerter-kplg4\" (UID: \"61672c4a-6cab-4105-bc33-2c4065396cfd\") " pod="openshift-network-operator/iptables-alerter-kplg4"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280072    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280084    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-run-netns\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280091    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5955d780-7eac-4662-9014-54b2386eda46-serviceca\") pod \"node-ca-5h7m5\" (UID: \"5955d780-7eac-4662-9014-54b2386eda46\") " pod="openshift-image-registry/node-ca-5h7m5"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280123    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-conf-dir\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-run-multus-certs\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280176    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-systemd-units\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280226    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-ovn-node-metrics-cert\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.280276 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280263    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/838ecadb-25ac-4b24-850d-2755447e4d46-dbus\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280289    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-socket-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280317    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-kubernetes\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280339    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-tuned\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280362    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/838ecadb-25ac-4b24-850d-2755447e4d46-kubelet-config\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-run-k8s-cni-cncf-io\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280464    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-hostroot\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280512    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280518    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-etc-selinux\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280557    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-modprobe-d\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280580    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-systemd-units\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280582    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6507742-eb0a-4edd-9bd0-390fedb51b34-tmp\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280685    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wszx\" (UniqueName: \"kubernetes.io/projected/d6507742-eb0a-4edd-9bd0-390fedb51b34-kube-api-access-9wszx\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280730    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-node-log\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.280871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280759    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-cni-bin\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280791    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06995ee8-bd63-4309-ad6c-e7365185af99-konnectivity-ca\") pod \"konnectivity-agent-ktspg\" (UID: \"06995ee8-bd63-4309-ad6c-e7365185af99\") " pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280813    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-os-release\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280867    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-node-log\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280863    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280820    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-host\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280877    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-cni-bin\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280907    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.280948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-ovnkube-config\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281017    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-os-release\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281045    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps2jt\" (UniqueName: \"kubernetes.io/projected/5955d780-7eac-4662-9014-54b2386eda46-kube-api-access-ps2jt\") pod \"node-ca-5h7m5\" (UID: \"5955d780-7eac-4662-9014-54b2386eda46\") " pod="openshift-image-registry/node-ca-5h7m5"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281079    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61672c4a-6cab-4105-bc33-2c4065396cfd-host-slash\") pod \"iptables-alerter-kplg4\" (UID: \"61672c4a-6cab-4105-bc33-2c4065396cfd\") " pod="openshift-network-operator/iptables-alerter-kplg4"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281106    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-var-lib-openvswitch\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281116    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281129    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-var-lib-kubelet\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.281507 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281183    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/61672c4a-6cab-4105-bc33-2c4065396cfd-iptables-alerter-script\") pod \"iptables-alerter-kplg4\" (UID: \"61672c4a-6cab-4105-bc33-2c4065396cfd\") " pod="openshift-network-operator/iptables-alerter-kplg4"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281247    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-device-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281296    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-run-ovn-kubernetes\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281323    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-ovnkube-script-lib\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281367    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-var-lib-cni-multus\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281392    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hfsn\" (UniqueName: \"kubernetes.io/projected/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-kube-api-access-4hfsn\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281417    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-sysctl-conf\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281567    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-var-lib-kubelet\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281570    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-ovnkube-config\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281595    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-log-socket\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281623    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-var-lib-openvswitch\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281624    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-system-cni-dir\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281669    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-system-cni-dir\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kprnt\" (UniqueName: \"kubernetes.io/projected/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-kube-api-access-kprnt\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.282332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281732    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-run-ovn-kubernetes\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281733    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-etc-openvswitch\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281773    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7gb4\" (UniqueName: \"kubernetes.io/projected/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-kube-api-access-q7gb4\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281832    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61672c4a-6cab-4105-bc33-2c4065396cfd-host-slash\") pod \"iptables-alerter-kplg4\" (UID: \"61672c4a-6cab-4105-bc33-2c4065396cfd\") " pod="openshift-network-operator/iptables-alerter-kplg4"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281893    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-cni-dir\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281930    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-sys-fs\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.281980    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-log-socket\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282021    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-sysconfig\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282047    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5955d780-7eac-4662-9014-54b2386eda46-host\") pod \"node-ca-5h7m5\" (UID: \"5955d780-7eac-4662-9014-54b2386eda46\") " pod="openshift-image-registry/node-ca-5h7m5"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282042    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-etc-openvswitch\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282091    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-run-ovn\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282151    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-var-lib-cni-bin\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282208    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-run-ovn\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282233    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5955d780-7eac-4662-9014-54b2386eda46-host\") pod \"node-ca-5h7m5\" (UID: \"5955d780-7eac-4662-9014-54b2386eda46\") " pod="openshift-image-registry/node-ca-5h7m5"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282253    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-sys\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.283119 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282313    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-kubelet\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282351    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-run-openvswitch\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282367    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-host-kubelet\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282382    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:06.283831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47cr9\" (UniqueName: \"kubernetes.io/projected/814f06f1-1241-4b8f-982a-c65a7f5f3c1b-kube-api-access-47cr9\") pod \"node-resolver-6rcnp\" (UID: \"814f06f1-1241-4b8f-982a-c65a7f5f3c1b\") " pod="openshift-dns/node-resolver-6rcnp"
Jul 15 16:59:06.283831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282453    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-run-openvswitch\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282466    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-run\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.283831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282461    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-ovnkube-script-lib\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282517    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-run-systemd\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.283831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282559    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:06.283831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282605    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-lib-modules\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.283831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.282695    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-run-systemd\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.285112 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.285073    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-ovn-node-metrics-cert\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.292792 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.291957    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st9gs\" (UniqueName: \"kubernetes.io/projected/61672c4a-6cab-4105-bc33-2c4065396cfd-kube-api-access-st9gs\") pod \"iptables-alerter-kplg4\" (UID: \"61672c4a-6cab-4105-bc33-2c4065396cfd\") " pod="openshift-network-operator/iptables-alerter-kplg4"
Jul 15 16:59:06.292792 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.292669    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps2jt\" (UniqueName: \"kubernetes.io/projected/5955d780-7eac-4662-9014-54b2386eda46-kube-api-access-ps2jt\") pod \"node-ca-5h7m5\" (UID: \"5955d780-7eac-4662-9014-54b2386eda46\") " pod="openshift-image-registry/node-ca-5h7m5"
Jul 15 16:59:06.296947 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.296097    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kprnt\" (UniqueName: \"kubernetes.io/projected/8e8933d2-0b56-4b1f-bd19-11f72e66ee1e-kube-api-access-kprnt\") pod \"multus-additional-cni-plugins-cqdbp\" (UID: \"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e\") " pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.297534 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.297511    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7gb4\" (UniqueName: \"kubernetes.io/projected/e9cd766e-023b-4016-a8a8-018d2e7e5ab4-kube-api-access-q7gb4\") pod \"ovnkube-node-ptpxl\" (UID: \"e9cd766e-023b-4016-a8a8-018d2e7e5ab4\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.365842 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.365751    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal" event={"ID":"e8204099467c290a1439f461fa8319f1","Type":"ContainerStarted","Data":"d4c621a99391d53ec33aa382d56c273c6d6a201dd1e89845d1a562e4067428f7"}
Jul 15 16:59:06.368622 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.368591    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-100.ec2.internal" event={"ID":"24fdbde66c62e7d855b5c05ac038501c","Type":"ContainerStarted","Data":"7d7904f8b06b5aee7030f7749fb7341b4dd45b54e196c74062cea2292b161018"}
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383055    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-system-cni-dir\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383103    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-cni-binary-copy\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383127    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-etc-kubernetes\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383175    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-registration-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383181    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-system-cni-dir\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383210    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-run-netns\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383234    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-conf-dir\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383242    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-etc-kubernetes\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383256    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-run-multus-certs\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383281    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/838ecadb-25ac-4b24-850d-2755447e4d46-dbus\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383303    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-socket-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-kubernetes\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383353    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-tuned\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383374    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/838ecadb-25ac-4b24-850d-2755447e4d46-kubelet-config\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:06.384375 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383397    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-run-k8s-cni-cncf-io\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383418    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-hostroot\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383441    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-etc-selinux\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383464    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-modprobe-d\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383501    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6507742-eb0a-4edd-9bd0-390fedb51b34-tmp\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383524    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wszx\" (UniqueName: \"kubernetes.io/projected/d6507742-eb0a-4edd-9bd0-390fedb51b34-kube-api-access-9wszx\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383552    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06995ee8-bd63-4309-ad6c-e7365185af99-konnectivity-ca\") pod \"konnectivity-agent-ktspg\" (UID: \"06995ee8-bd63-4309-ad6c-e7365185af99\") " pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383573    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-host\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383597    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-os-release\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383623    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-var-lib-kubelet\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383652    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-device-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-var-lib-cni-multus\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383706    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hfsn\" (UniqueName: \"kubernetes.io/projected/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-kube-api-access-4hfsn\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383762    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-sysctl-conf\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383787    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-var-lib-kubelet\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.385195 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383818    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-cni-dir\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383823    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-cni-binary-copy\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383841    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-sys-fs\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383867    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-sysconfig\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383891    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-var-lib-cni-bin\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383956    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-sys\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.383990    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384013    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47cr9\" (UniqueName: \"kubernetes.io/projected/814f06f1-1241-4b8f-982a-c65a7f5f3c1b-kube-api-access-47cr9\") pod \"node-resolver-6rcnp\" (UID: \"814f06f1-1241-4b8f-982a-c65a7f5f3c1b\") " pod="openshift-dns/node-resolver-6rcnp"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384037    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-run\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384061    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384082    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-lib-modules\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384152    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-registration-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384182    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-socket-dir-parent\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384207    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-sysctl-d\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.385894 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384228    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-lib-modules\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384233    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9555n\" (UniqueName: \"kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n\") pod \"network-check-target-4gg7t\" (UID: \"9d6f90aa-bf29-4788-b427-33cd74efbefe\") " pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384259    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/814f06f1-1241-4b8f-982a-c65a7f5f3c1b-hosts-file\") pod \"node-resolver-6rcnp\" (UID: \"814f06f1-1241-4b8f-982a-c65a7f5f3c1b\") " pod="openshift-dns/node-resolver-6rcnp"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384282    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-sys-fs\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-cnibin\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384312    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxr68\" (UniqueName: \"kubernetes.io/projected/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-kube-api-access-fxr68\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384331    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-sysconfig\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384337    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/814f06f1-1241-4b8f-982a-c65a7f5f3c1b-tmp-dir\") pod \"node-resolver-6rcnp\" (UID: \"814f06f1-1241-4b8f-982a-c65a7f5f3c1b\") " pod="openshift-dns/node-resolver-6rcnp"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384376    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-var-lib-cni-bin\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384389    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-cni-dir\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384404    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06995ee8-bd63-4309-ad6c-e7365185af99-agent-certs\") pod \"konnectivity-agent-ktspg\" (UID: \"06995ee8-bd63-4309-ad6c-e7365185af99\") " pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384443    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-systemd\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384480    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh5q2\" (UniqueName: \"kubernetes.io/projected/d0593108-e3b3-4780-9f27-52ac2affd909-kube-api-access-dh5q2\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384508    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-daemon-config\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384532    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.386530 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384625    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384656    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06995ee8-bd63-4309-ad6c-e7365185af99-konnectivity-ca\") pod \"konnectivity-agent-ktspg\" (UID: \"06995ee8-bd63-4309-ad6c-e7365185af99\") " pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384675    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-host\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384658    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/814f06f1-1241-4b8f-982a-c65a7f5f3c1b-tmp-dir\") pod \"node-resolver-6rcnp\" (UID: \"814f06f1-1241-4b8f-982a-c65a7f5f3c1b\") " pod="openshift-dns/node-resolver-6rcnp"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384694    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-run-netns\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384746    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-run-multus-certs\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384787    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-os-release\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384813    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/838ecadb-25ac-4b24-850d-2755447e4d46-dbus\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384865    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-socket-dir-parent\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384909    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-socket-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384954    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-kubernetes\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.384960    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-sysctl-d\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385000    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-run-k8s-cni-cncf-io\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385035    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-hostroot\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385033    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-sys\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385049    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-etc-selinux\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.387223 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.385111    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385125    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-modprobe-d\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.385178    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs podName:d0593108-e3b3-4780-9f27-52ac2affd909 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:06.885155034 +0000 UTC m=+3.042569829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs") pod "network-metrics-daemon-w9xrc" (UID: "d0593108-e3b3-4780-9f27-52ac2affd909") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385272    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/814f06f1-1241-4b8f-982a-c65a7f5f3c1b-hosts-file\") pod \"node-resolver-6rcnp\" (UID: \"814f06f1-1241-4b8f-982a-c65a7f5f3c1b\") " pod="openshift-dns/node-resolver-6rcnp"
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385328    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-cnibin\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385393    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-run\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385483    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-var-lib-kubelet\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385566    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-conf-dir\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.385589    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385615    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-device-dir\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.385641    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret podName:838ecadb-25ac-4b24-850d-2755447e4d46 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:06.88562467 +0000 UTC m=+3.043039487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret") pod "global-pull-secret-syncer-n8p6c" (UID: "838ecadb-25ac-4b24-850d-2755447e4d46") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385670    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-host-var-lib-cni-multus\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385695    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/838ecadb-25ac-4b24-850d-2755447e4d46-kubelet-config\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.385733    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-systemd\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.387942 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.386024    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-var-lib-kubelet\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.388637 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.386034    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-sysctl-conf\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.388637 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.386289    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-multus-daemon-config\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.388637 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.388198    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6507742-eb0a-4edd-9bd0-390fedb51b34-tmp\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.388798 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.388660    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6507742-eb0a-4edd-9bd0-390fedb51b34-etc-tuned\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.388929 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.388908    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06995ee8-bd63-4309-ad6c-e7365185af99-agent-certs\") pod \"konnectivity-agent-ktspg\" (UID: \"06995ee8-bd63-4309-ad6c-e7365185af99\") " pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:06.396291 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.396241    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:59:06.396291 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.396270    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:59:06.396291 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.396285    2556 projected.go:196] Error preparing data for projected volume kube-api-access-9555n for pod openshift-network-diagnostics/network-check-target-4gg7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:06.396533 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.396352    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n podName:9d6f90aa-bf29-4788-b427-33cd74efbefe nodeName:}" failed. No retries permitted until 2026-07-15 16:59:06.896332456 +0000 UTC m=+3.053747267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9555n" (UniqueName: "kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n") pod "network-check-target-4gg7t" (UID: "9d6f90aa-bf29-4788-b427-33cd74efbefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:06.400416 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.400334    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hfsn\" (UniqueName: \"kubernetes.io/projected/7ca65c67-c657-4c56-ae9d-db5bb4bee2bc-kube-api-access-4hfsn\") pod \"multus-44vpb\" (UID: \"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc\") " pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.401732 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.401687    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh5q2\" (UniqueName: \"kubernetes.io/projected/d0593108-e3b3-4780-9f27-52ac2affd909-kube-api-access-dh5q2\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:06.406819 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.406797    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wszx\" (UniqueName: \"kubernetes.io/projected/d6507742-eb0a-4edd-9bd0-390fedb51b34-kube-api-access-9wszx\") pod \"tuned-n8plx\" (UID: \"d6507742-eb0a-4edd-9bd0-390fedb51b34\") " pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.408911 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.408888    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxr68\" (UniqueName: \"kubernetes.io/projected/e6932495-eb9d-47ec-9ea4-2c5dc1a2a646-kube-api-access-fxr68\") pod \"aws-ebs-csi-driver-node-vjkzs\" (UID: \"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.413631 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.413609    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47cr9\" (UniqueName: \"kubernetes.io/projected/814f06f1-1241-4b8f-982a-c65a7f5f3c1b-kube-api-access-47cr9\") pod \"node-resolver-6rcnp\" (UID: \"814f06f1-1241-4b8f-982a-c65a7f5f3c1b\") " pod="openshift-dns/node-resolver-6rcnp"
Jul 15 16:59:06.414686 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.414668    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:59:06.474346 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.474310    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kplg4"
Jul 15 16:59:06.483433 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.483404    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:06.491464 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:06.491435    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61672c4a_6cab_4105_bc33_2c4065396cfd.slice/crio-abdd09a5da6d3d18449129f80963e5643ed508ba7aeb4441d6eae1cb41006d0b WatchSource:0}: Error finding container abdd09a5da6d3d18449129f80963e5643ed508ba7aeb4441d6eae1cb41006d0b: Status 404 returned error can't find the container with id abdd09a5da6d3d18449129f80963e5643ed508ba7aeb4441d6eae1cb41006d0b
Jul 15 16:59:06.492264 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.492249    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5h7m5"
Jul 15 16:59:06.496234 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:06.496113    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9cd766e_023b_4016_a8a8_018d2e7e5ab4.slice/crio-42784084e584df346b35dc8db65625665b23448aa45790a0efdd2154ca330271 WatchSource:0}: Error finding container 42784084e584df346b35dc8db65625665b23448aa45790a0efdd2154ca330271: Status 404 returned error can't find the container with id 42784084e584df346b35dc8db65625665b23448aa45790a0efdd2154ca330271
Jul 15 16:59:06.500832 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.500806    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cqdbp"
Jul 15 16:59:06.502995 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:06.502943    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5955d780_7eac_4662_9014_54b2386eda46.slice/crio-a11a274f3e916f2f2b7e9a829195e9241e0a2e1ae6f5c36f5f6cedcbe4d1a2d5 WatchSource:0}: Error finding container a11a274f3e916f2f2b7e9a829195e9241e0a2e1ae6f5c36f5f6cedcbe4d1a2d5: Status 404 returned error can't find the container with id a11a274f3e916f2f2b7e9a829195e9241e0a2e1ae6f5c36f5f6cedcbe4d1a2d5
Jul 15 16:59:06.509245 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.509225    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs"
Jul 15 16:59:06.511255 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:06.511229    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e8933d2_0b56_4b1f_bd19_11f72e66ee1e.slice/crio-1fa90fe72dd18499a8f6e9f6a12a3dd4e0d42fc391bdae419008451e6d7a69f3 WatchSource:0}: Error finding container 1fa90fe72dd18499a8f6e9f6a12a3dd4e0d42fc391bdae419008451e6d7a69f3: Status 404 returned error can't find the container with id 1fa90fe72dd18499a8f6e9f6a12a3dd4e0d42fc391bdae419008451e6d7a69f3
Jul 15 16:59:06.517373 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.517350    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6rcnp"
Jul 15 16:59:06.518991 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:06.518964    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6932495_eb9d_47ec_9ea4_2c5dc1a2a646.slice/crio-209b65f1215cb8316b02e670ef84070207ddbb89d3847c43469aba6f36f503f8 WatchSource:0}: Error finding container 209b65f1215cb8316b02e670ef84070207ddbb89d3847c43469aba6f36f503f8: Status 404 returned error can't find the container with id 209b65f1215cb8316b02e670ef84070207ddbb89d3847c43469aba6f36f503f8
Jul 15 16:59:06.525561 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.525539    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:06.528028 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:06.527996    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814f06f1_1241_4b8f_982a_c65a7f5f3c1b.slice/crio-c6135e9f80e2d9b75af65d82623920d579020b101cbe6d204c918b6d13d7e408 WatchSource:0}: Error finding container c6135e9f80e2d9b75af65d82623920d579020b101cbe6d204c918b6d13d7e408: Status 404 returned error can't find the container with id c6135e9f80e2d9b75af65d82623920d579020b101cbe6d204c918b6d13d7e408
Jul 15 16:59:06.534362 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.534342    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-44vpb"
Jul 15 16:59:06.534910 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:06.534869    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06995ee8_bd63_4309_ad6c_e7365185af99.slice/crio-634d2587fa9ea3cb040fe5eba70b48b008b3109e207454e36e0817b05b6f321e WatchSource:0}: Error finding container 634d2587fa9ea3cb040fe5eba70b48b008b3109e207454e36e0817b05b6f321e: Status 404 returned error can't find the container with id 634d2587fa9ea3cb040fe5eba70b48b008b3109e207454e36e0817b05b6f321e
Jul 15 16:59:06.541890 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.541870    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n8plx"
Jul 15 16:59:06.546304 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:06.546274    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca65c67_c657_4c56_ae9d_db5bb4bee2bc.slice/crio-70439df77c2d66d737e96d6c4669351e6eb3e94ad8f5e27170ffde1f0a6e40e4 WatchSource:0}: Error finding container 70439df77c2d66d737e96d6c4669351e6eb3e94ad8f5e27170ffde1f0a6e40e4: Status 404 returned error can't find the container with id 70439df77c2d66d737e96d6c4669351e6eb3e94ad8f5e27170ffde1f0a6e40e4
Jul 15 16:59:06.554210 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:06.554183    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6507742_eb0a_4edd_9bd0_390fedb51b34.slice/crio-6773e322153aeb65b902206ab205fc6765695b415b464bfdb9a427bffa4090d5 WatchSource:0}: Error finding container 6773e322153aeb65b902206ab205fc6765695b415b464bfdb9a427bffa4090d5: Status 404 returned error can't find the container with id 6773e322153aeb65b902206ab205fc6765695b415b464bfdb9a427bffa4090d5
Jul 15 16:59:06.892325 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.892286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:06.892504 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.892334    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:06.892504 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.892483    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:06.892600 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.892557    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:06.892600 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.892570    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs podName:d0593108-e3b3-4780-9f27-52ac2affd909 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:07.892548366 +0000 UTC m=+4.049963158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs") pod "network-metrics-daemon-w9xrc" (UID: "d0593108-e3b3-4780-9f27-52ac2affd909") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:06.892701 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.892612    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret podName:838ecadb-25ac-4b24-850d-2755447e4d46 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:07.892595715 +0000 UTC m=+4.050010507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret") pod "global-pull-secret-syncer-n8p6c" (UID: "838ecadb-25ac-4b24-850d-2755447e4d46") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:06.993105 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:06.993071    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9555n\" (UniqueName: \"kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n\") pod \"network-check-target-4gg7t\" (UID: \"9d6f90aa-bf29-4788-b427-33cd74efbefe\") " pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:06.993256 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.993234    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:59:06.993256 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.993256    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:59:06.993327 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.993267    2556 projected.go:196] Error preparing data for projected volume kube-api-access-9555n for pod openshift-network-diagnostics/network-check-target-4gg7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:06.993366 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:06.993333    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n podName:9d6f90aa-bf29-4788-b427-33cd74efbefe nodeName:}" failed. No retries permitted until 2026-07-15 16:59:07.993306087 +0000 UTC m=+4.150720879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9555n" (UniqueName: "kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n") pod "network-check-target-4gg7t" (UID: "9d6f90aa-bf29-4788-b427-33cd74efbefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:07.215513 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.215398    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:54:06 +0000 UTC" deadline="2027-12-21 13:23:42.110553267 +0000 UTC"
Jul 15 16:59:07.215513 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.215463    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12572h24m34.895094914s"
Jul 15 16:59:07.279321 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.279276    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:59:07.360888 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.360191    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:07.360888 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:07.360308    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:07.360888 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.360735    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:07.360888 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:07.360841    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:07.373581 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.371658    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktspg" event={"ID":"06995ee8-bd63-4309-ad6c-e7365185af99","Type":"ContainerStarted","Data":"634d2587fa9ea3cb040fe5eba70b48b008b3109e207454e36e0817b05b6f321e"}
Jul 15 16:59:07.373581 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.373337    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6rcnp" event={"ID":"814f06f1-1241-4b8f-982a-c65a7f5f3c1b","Type":"ContainerStarted","Data":"c6135e9f80e2d9b75af65d82623920d579020b101cbe6d204c918b6d13d7e408"}
Jul 15 16:59:07.375777 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.375750    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-44vpb" event={"ID":"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc","Type":"ContainerStarted","Data":"70439df77c2d66d737e96d6c4669351e6eb3e94ad8f5e27170ffde1f0a6e40e4"}
Jul 15 16:59:07.379537 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.379509    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs" event={"ID":"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646","Type":"ContainerStarted","Data":"209b65f1215cb8316b02e670ef84070207ddbb89d3847c43469aba6f36f503f8"}
Jul 15 16:59:07.382477 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.382447    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cqdbp" event={"ID":"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e","Type":"ContainerStarted","Data":"1fa90fe72dd18499a8f6e9f6a12a3dd4e0d42fc391bdae419008451e6d7a69f3"}
Jul 15 16:59:07.385209 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.385184    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5h7m5" event={"ID":"5955d780-7eac-4662-9014-54b2386eda46","Type":"ContainerStarted","Data":"a11a274f3e916f2f2b7e9a829195e9241e0a2e1ae6f5c36f5f6cedcbe4d1a2d5"}
Jul 15 16:59:07.387919 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.387894    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl" event={"ID":"e9cd766e-023b-4016-a8a8-018d2e7e5ab4","Type":"ContainerStarted","Data":"42784084e584df346b35dc8db65625665b23448aa45790a0efdd2154ca330271"}
Jul 15 16:59:07.392615 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.392590    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kplg4" event={"ID":"61672c4a-6cab-4105-bc33-2c4065396cfd","Type":"ContainerStarted","Data":"abdd09a5da6d3d18449129f80963e5643ed508ba7aeb4441d6eae1cb41006d0b"}
Jul 15 16:59:07.394790 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.394765    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n8plx" event={"ID":"d6507742-eb0a-4edd-9bd0-390fedb51b34","Type":"ContainerStarted","Data":"6773e322153aeb65b902206ab205fc6765695b415b464bfdb9a427bffa4090d5"}
Jul 15 16:59:07.900831 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.900794    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:07.901028 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:07.900846    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:07.901028 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:07.901003    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:07.901152 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:07.901064    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret podName:838ecadb-25ac-4b24-850d-2755447e4d46 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:09.901046674 +0000 UTC m=+6.058461469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret") pod "global-pull-secret-syncer-n8p6c" (UID: "838ecadb-25ac-4b24-850d-2755447e4d46") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:07.901444 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:07.901424    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:07.901545 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:07.901474    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs podName:d0593108-e3b3-4780-9f27-52ac2affd909 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:09.901460782 +0000 UTC m=+6.058875577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs") pod "network-metrics-daemon-w9xrc" (UID: "d0593108-e3b3-4780-9f27-52ac2affd909") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:08.001616 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:08.001580    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9555n\" (UniqueName: \"kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n\") pod \"network-check-target-4gg7t\" (UID: \"9d6f90aa-bf29-4788-b427-33cd74efbefe\") " pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:08.001869 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:08.001826    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:59:08.001869 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:08.001850    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:59:08.001869 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:08.001864    2556 projected.go:196] Error preparing data for projected volume kube-api-access-9555n for pod openshift-network-diagnostics/network-check-target-4gg7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:08.002033 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:08.001922    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n podName:9d6f90aa-bf29-4788-b427-33cd74efbefe nodeName:}" failed. No retries permitted until 2026-07-15 16:59:10.001905117 +0000 UTC m=+6.159319930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9555n" (UniqueName: "kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n") pod "network-check-target-4gg7t" (UID: "9d6f90aa-bf29-4788-b427-33cd74efbefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:08.216326 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:08.216190    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:54:06 +0000 UTC" deadline="2028-03-16 04:44:59.759160808 +0000 UTC"
Jul 15 16:59:08.216326 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:08.216232    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14627h45m51.542933073s"
Jul 15 16:59:08.362051 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:08.359840    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:08.362051 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:08.359972    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:09.360181 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:09.360141    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:09.360647 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:09.360286    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:09.360734 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:09.360676    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:09.360810 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:09.360788    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:09.921113 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:09.921057    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:09.921306 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:09.921138    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:09.921306 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:09.921258    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:09.921434 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:09.921322    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret podName:838ecadb-25ac-4b24-850d-2755447e4d46 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:13.921301607 +0000 UTC m=+10.078716398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret") pod "global-pull-secret-syncer-n8p6c" (UID: "838ecadb-25ac-4b24-850d-2755447e4d46") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:09.921882 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:09.921613    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:09.921882 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:09.921661    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs podName:d0593108-e3b3-4780-9f27-52ac2affd909 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:13.921647664 +0000 UTC m=+10.079062456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs") pod "network-metrics-daemon-w9xrc" (UID: "d0593108-e3b3-4780-9f27-52ac2affd909") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:10.022155 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:10.022123    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9555n\" (UniqueName: \"kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n\") pod \"network-check-target-4gg7t\" (UID: \"9d6f90aa-bf29-4788-b427-33cd74efbefe\") " pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:10.022327 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:10.022278    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:59:10.022327 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:10.022302    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:59:10.022327 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:10.022317    2556 projected.go:196] Error preparing data for projected volume kube-api-access-9555n for pod openshift-network-diagnostics/network-check-target-4gg7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:10.022523 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:10.022366    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n podName:9d6f90aa-bf29-4788-b427-33cd74efbefe nodeName:}" failed. No retries permitted until 2026-07-15 16:59:14.022351161 +0000 UTC m=+10.179765954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9555n" (UniqueName: "kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n") pod "network-check-target-4gg7t" (UID: "9d6f90aa-bf29-4788-b427-33cd74efbefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:10.360891 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:10.360852    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:10.361339 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:10.360974    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:11.359377 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:11.359341    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:11.359553 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:11.359476    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:11.360050 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:11.359879    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:11.360050 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:11.359981    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:12.360314 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:12.360034    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:12.360314 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:12.360212    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:13.359914 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:13.359568    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:13.359914 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:13.359703    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:13.359914 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:13.359760    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:13.359914 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:13.359872    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:13.956068 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:13.955812    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:13.956068 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:13.955865    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:13.956068 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:13.955992    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:13.956068 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:13.956013    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:13.956068 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:13.956069    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs podName:d0593108-e3b3-4780-9f27-52ac2affd909 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:21.956047281 +0000 UTC m=+18.113462076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs") pod "network-metrics-daemon-w9xrc" (UID: "d0593108-e3b3-4780-9f27-52ac2affd909") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:13.956743 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:13.956092    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret podName:838ecadb-25ac-4b24-850d-2755447e4d46 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:21.956081729 +0000 UTC m=+18.113496530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret") pod "global-pull-secret-syncer-n8p6c" (UID: "838ecadb-25ac-4b24-850d-2755447e4d46") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:14.056774 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:14.056734    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9555n\" (UniqueName: \"kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n\") pod \"network-check-target-4gg7t\" (UID: \"9d6f90aa-bf29-4788-b427-33cd74efbefe\") " pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:14.056930 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:14.056895    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:59:14.056930 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:14.056916    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:59:14.056930 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:14.056929    2556 projected.go:196] Error preparing data for projected volume kube-api-access-9555n for pod openshift-network-diagnostics/network-check-target-4gg7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:14.057078 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:14.056992    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n podName:9d6f90aa-bf29-4788-b427-33cd74efbefe nodeName:}" failed. No retries permitted until 2026-07-15 16:59:22.056974933 +0000 UTC m=+18.214389731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9555n" (UniqueName: "kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n") pod "network-check-target-4gg7t" (UID: "9d6f90aa-bf29-4788-b427-33cd74efbefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:14.361095 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:14.360537    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:14.361095 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:14.360654    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:15.360702 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:15.360053    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:15.360702 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:15.360179    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:15.360702 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:15.360259    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:15.360702 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:15.360348    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:16.360221 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:16.360182    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:16.360408 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:16.360336    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:17.359334 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:17.359296    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:17.359686 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:17.359411    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:17.359686 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:17.359446    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:17.359686 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:17.359512    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:18.359784 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:18.359696    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:18.360232 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:18.359852    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:19.359540 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:19.359501    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:19.359700 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:19.359655    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:19.359797 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:19.359732    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:19.359871 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:19.359851    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:20.360473 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:20.360430    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:20.360914 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:20.360560    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:21.359804 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:21.359761    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:21.360063 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:21.359808    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:21.360063 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:21.359889    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:21.360063 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:21.360033    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:22.016221 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:22.016182    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:22.016221 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:22.016228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:22.016708 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:22.016363    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:22.016708 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:22.016381    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:22.016708 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:22.016439    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret podName:838ecadb-25ac-4b24-850d-2755447e4d46 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:38.016421179 +0000 UTC m=+34.173835970 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret") pod "global-pull-secret-syncer-n8p6c" (UID: "838ecadb-25ac-4b24-850d-2755447e4d46") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:22.016708 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:22.016459    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs podName:d0593108-e3b3-4780-9f27-52ac2affd909 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:38.016447578 +0000 UTC m=+34.173862376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs") pod "network-metrics-daemon-w9xrc" (UID: "d0593108-e3b3-4780-9f27-52ac2affd909") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:22.116963 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:22.116927    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9555n\" (UniqueName: \"kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n\") pod \"network-check-target-4gg7t\" (UID: \"9d6f90aa-bf29-4788-b427-33cd74efbefe\") " pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:22.117153 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:22.117112    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:59:22.117153 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:22.117136    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:59:22.117153 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:22.117148    2556 projected.go:196] Error preparing data for projected volume kube-api-access-9555n for pod openshift-network-diagnostics/network-check-target-4gg7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:22.117312 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:22.117215    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n podName:9d6f90aa-bf29-4788-b427-33cd74efbefe nodeName:}" failed. No retries permitted until 2026-07-15 16:59:38.11719031 +0000 UTC m=+34.274605118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9555n" (UniqueName: "kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n") pod "network-check-target-4gg7t" (UID: "9d6f90aa-bf29-4788-b427-33cd74efbefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:22.359457 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:22.359356    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:22.359599 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:22.359506    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:23.360002 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:23.359810    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:23.360002 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:23.359810    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:23.360538 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:23.360132    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:23.360538 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:23.360155    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:24.361045 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:24.361003    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:24.361539 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:24.361102    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:25.360118 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:25.360086    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:25.360245 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:25.360206    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:25.360324 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:25.360258    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:25.360373 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:25.360355    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:26.360201 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.359968    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:26.360885 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:26.360236    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:26.434356 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.434321    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-44vpb" event={"ID":"7ca65c67-c657-4c56-ae9d-db5bb4bee2bc","Type":"ContainerStarted","Data":"74a80e98aca19a47aa049066e2103ec87d2fe78818254110a48e8ebe85941f38"}
Jul 15 16:59:26.435908 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.435884    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs" event={"ID":"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646","Type":"ContainerStarted","Data":"ac299c237398c00a230b65e54cffcba46f220dba993e25c023794a6150fe5a07"}
Jul 15 16:59:26.437329 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.437301    2556 generic.go:356] "Generic (PLEG): container finished" podID="8e8933d2-0b56-4b1f-bd19-11f72e66ee1e" containerID="6c83c32b1013cb3a2d52a5b4fdea035d3664c1a3c730a4e8cc672f5a3c3b02c3" exitCode=0
Jul 15 16:59:26.437434 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.437328    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cqdbp" event={"ID":"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e","Type":"ContainerDied","Data":"6c83c32b1013cb3a2d52a5b4fdea035d3664c1a3c730a4e8cc672f5a3c3b02c3"}
Jul 15 16:59:26.439098 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.439075    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5h7m5" event={"ID":"5955d780-7eac-4662-9014-54b2386eda46","Type":"ContainerStarted","Data":"ee7750871439f9c113e07ea12d0a8d67159b3488fb0cf464d6e86f636a0dd5b8"}
Jul 15 16:59:26.442108 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.442092    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 16:59:26.442452 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.442431    2556 generic.go:356] "Generic (PLEG): container finished" podID="e9cd766e-023b-4016-a8a8-018d2e7e5ab4" containerID="14596df590a84aa50e6083587820b85f476feb057b07cb90d6e7694410b26c7b" exitCode=1
Jul 15 16:59:26.442529 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.442453    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl" event={"ID":"e9cd766e-023b-4016-a8a8-018d2e7e5ab4","Type":"ContainerStarted","Data":"108d3c73c19bc5727a151c81d46a900db68136253d1352a031d583f6f126082a"}
Jul 15 16:59:26.442529 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.442519    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl" event={"ID":"e9cd766e-023b-4016-a8a8-018d2e7e5ab4","Type":"ContainerStarted","Data":"d081ad5d465e773c1b7430e75d4a1de6555cd26215db0d84a8f1a66655c17832"}
Jul 15 16:59:26.442612 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.442560    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl" event={"ID":"e9cd766e-023b-4016-a8a8-018d2e7e5ab4","Type":"ContainerStarted","Data":"76643b76679c1bf53aaf0c210d8e02e9e6db12ee006bce965962bd716821fb97"}
Jul 15 16:59:26.442612 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.442595    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl" event={"ID":"e9cd766e-023b-4016-a8a8-018d2e7e5ab4","Type":"ContainerStarted","Data":"e8fc21a04a28fa49b5f7190153b85be5bb900bcead989a6034c45d792155eb15"}
Jul 15 16:59:26.442696 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.442655    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl" event={"ID":"e9cd766e-023b-4016-a8a8-018d2e7e5ab4","Type":"ContainerDied","Data":"14596df590a84aa50e6083587820b85f476feb057b07cb90d6e7694410b26c7b"}
Jul 15 16:59:26.442992 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.442698    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl" event={"ID":"e9cd766e-023b-4016-a8a8-018d2e7e5ab4","Type":"ContainerStarted","Data":"30187c5277f0eb4ad6de1a91315d5c55469939d5e382ecb405dc7c47592f7141"}
Jul 15 16:59:26.444083 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.444066    2556 generic.go:356] "Generic (PLEG): container finished" podID="e8204099467c290a1439f461fa8319f1" containerID="427234a20cb29f88733fd3698a4cc4160ffe66970efc8c65625046de3557c1a6" exitCode=0
Jul 15 16:59:26.444178 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.444130    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal" event={"ID":"e8204099467c290a1439f461fa8319f1","Type":"ContainerDied","Data":"427234a20cb29f88733fd3698a4cc4160ffe66970efc8c65625046de3557c1a6"}
Jul 15 16:59:26.445578 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.445551    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-100.ec2.internal" event={"ID":"24fdbde66c62e7d855b5c05ac038501c","Type":"ContainerStarted","Data":"233f1edc35ac75f9c022ce3150d8dd60db644499ad44528c9dd39c86a97554f1"}
Jul 15 16:59:26.447258 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.447231    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n8plx" event={"ID":"d6507742-eb0a-4edd-9bd0-390fedb51b34","Type":"ContainerStarted","Data":"3555cf5d70b56eed6e8da450e5a6b7b92950819a320547a3e25c1c07797b609d"}
Jul 15 16:59:26.448588 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.448562    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktspg" event={"ID":"06995ee8-bd63-4309-ad6c-e7365185af99","Type":"ContainerStarted","Data":"6cafc12ed77e6d15ac1be21d942efadf9b8f1e2eebe94bf1a6c77489476ec463"}
Jul 15 16:59:26.449892 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.449873    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6rcnp" event={"ID":"814f06f1-1241-4b8f-982a-c65a7f5f3c1b","Type":"ContainerStarted","Data":"e9e775ab6cf10a87ec81bb6a998bdb1bf8f4dbb98fc86234ec743bca7c7c7880"}
Jul 15 16:59:26.461949 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.461771    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-44vpb" podStartSLOduration=3.205471059 podStartE2EDuration="22.461760224s" totalImagesPullingTime="19.256289165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:26.461531429 +0000 UTC m=+22.618946244" watchObservedRunningTime="2026-07-15 16:59:26.461760224 +0000 UTC m=+22.619175037"
Jul 15 16:59:26.522084 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.522044    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5h7m5" podStartSLOduration=3.626271401 podStartE2EDuration="22.52202876s" totalImagesPullingTime="18.895757359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:26.5213967 +0000 UTC m=+22.678811514" watchObservedRunningTime="2026-07-15 16:59:26.52202876 +0000 UTC m=+22.679443568"
Jul 15 16:59:26.522487 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.522464    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-100.ec2.internal" podStartSLOduration=21.522455948 podStartE2EDuration="21.522455948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:26.500375104 +0000 UTC m=+22.657789918" watchObservedRunningTime="2026-07-15 16:59:26.522455948 +0000 UTC m=+22.679870770"
Jul 15 16:59:26.541620 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.541573    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6rcnp" podStartSLOduration=3.696454037 podStartE2EDuration="22.54155474s" totalImagesPullingTime="18.845100703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:26.541514303 +0000 UTC m=+22.698929116" watchObservedRunningTime="2026-07-15 16:59:26.54155474 +0000 UTC m=+22.698969554"
Jul 15 16:59:26.600253 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.600202    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ktspg" podStartSLOduration=3.768229287 podStartE2EDuration="22.600185424s" totalImagesPullingTime="18.831956137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:26.599311277 +0000 UTC m=+22.756726093" watchObservedRunningTime="2026-07-15 16:59:26.600185424 +0000 UTC m=+22.757600238"
Jul 15 16:59:26.875059 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.875022    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:26.959549 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:26.959523    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:27.359679 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.359650    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:27.359843 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.359686    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:27.359843 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:27.359805    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:27.359967 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:27.359935    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:27.432974 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.432945    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 16:59:27.454238 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.454206    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal" event={"ID":"e8204099467c290a1439f461fa8319f1","Type":"ContainerStarted","Data":"715cf7f169781a18d35548570e68c894730d4d26fe3084327fe238568ee4986b"}
Jul 15 16:59:27.456430 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.456403    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs" event={"ID":"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646","Type":"ContainerStarted","Data":"edaa18c29213b65891ba4f29c2c0875b9419a28da6213c98898078da5196f14f"}
Jul 15 16:59:27.458143 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.458097    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kplg4" event={"ID":"61672c4a-6cab-4105-bc33-2c4065396cfd","Type":"ContainerStarted","Data":"46f012272508d85e055c91371fd895ee2cf65ce09fa4b29e695c2c91fc5b4a4d"}
Jul 15 16:59:27.472269 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.472223    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n8plx" podStartSLOduration=4.62731962 podStartE2EDuration="23.472208387s" totalImagesPullingTime="18.844888767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:26.626345072 +0000 UTC m=+22.783759902" watchObservedRunningTime="2026-07-15 16:59:27.472208387 +0000 UTC m=+23.629623200"
Jul 15 16:59:27.472386 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.472357    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-100.ec2.internal" podStartSLOduration=22.47234647 podStartE2EDuration="22.47234647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:27.471738522 +0000 UTC m=+23.629153354" watchObservedRunningTime="2026-07-15 16:59:27.47234647 +0000 UTC m=+23.629761287"
Jul 15 16:59:27.488500 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.488457    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kplg4" podStartSLOduration=4.613162648 podStartE2EDuration="23.488442267s" totalImagesPullingTime="18.875279619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:27.488081659 +0000 UTC m=+23.645496472" watchObservedRunningTime="2026-07-15 16:59:27.488442267 +0000 UTC m=+23.645857080"
Jul 15 16:59:27.889563 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.889530    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:27.890084 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.890061    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:27.948230 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:27.948198    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:28.263047 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:28.262784    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T16:59:27.432966357Z","UUID":"897f54ce-dd5b-4721-a8fc-dee5088e8a84","Handler":null,"Name":"","Endpoint":""}
Jul 15 16:59:28.264769 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:28.264747    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 16:59:28.264769 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:28.264775    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 16:59:28.359696 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:28.359660    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:28.359869 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:28.359812    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:28.461057 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:28.460906    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:28.461448 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:28.461370    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ktspg"
Jul 15 16:59:29.359788 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:29.359752    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:29.359788 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:29.359781    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:29.360039 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:29.359881    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:29.360098 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:29.360030    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:29.465255 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:29.465172    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs" event={"ID":"e6932495-eb9d-47ec-9ea4-2c5dc1a2a646","Type":"ContainerStarted","Data":"0de4a716c9a30bd3d1b37b398d4ee0b09efc3786010ba3312ce55fc2d9a9f32c"}
Jul 15 16:59:29.469441 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:29.469416    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 16:59:29.469896 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:29.469866    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl" event={"ID":"e9cd766e-023b-4016-a8a8-018d2e7e5ab4","Type":"ContainerStarted","Data":"03fadfb11172136a73b32eec39d1c28514eaf35410c8b77c058757cd24772053"}
Jul 15 16:59:29.488210 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:29.488157    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjkzs" podStartSLOduration=3.953270021 podStartE2EDuration="25.488137797s" totalImagesPullingTime="21.534867776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:29.488102418 +0000 UTC m=+25.645517232" watchObservedRunningTime="2026-07-15 16:59:29.488137797 +0000 UTC m=+25.645552613"
Jul 15 16:59:30.360402 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:30.360364    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:30.360583 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:30.360495    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:31.141030 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.140847    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:31.246586 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.246557    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:31.359982 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.359952    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:31.360130 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.359952    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:31.360130 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:31.360064    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:31.360130 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:31.360116    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:31.404169 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.404119    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:31.476554 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.476526    2556 generic.go:356] "Generic (PLEG): container finished" podID="8e8933d2-0b56-4b1f-bd19-11f72e66ee1e" containerID="bfb0ef0bba359a5c9f8cbb130fafdba57d8b8802258f6be9f16b956375e66f1e" exitCode=0
Jul 15 16:59:31.476753 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.476603    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cqdbp" event={"ID":"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e","Type":"ContainerDied","Data":"bfb0ef0bba359a5c9f8cbb130fafdba57d8b8802258f6be9f16b956375e66f1e"}
Jul 15 16:59:31.480203 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.480179    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 16:59:31.480508 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.480484    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl" event={"ID":"e9cd766e-023b-4016-a8a8-018d2e7e5ab4","Type":"ContainerStarted","Data":"8deb22506ccd03aca9b5e8aaf2365a5b08d63507c4cb040578c34494e4a9b644"}
Jul 15 16:59:31.480738 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.480722    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:31.480810 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.480783    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:31.480871 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.480833    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:31.480907 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.480895    2556 scope.go:117] "RemoveContainer" containerID="14596df590a84aa50e6083587820b85f476feb057b07cb90d6e7694410b26c7b"
Jul 15 16:59:31.496651 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.496595    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:31.496922 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.496901    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 16:59:31.523694 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.523669    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:31.614790 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:31.614759    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:32.359818 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:32.359568    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:32.360286 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:32.359923    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:32.381407 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:32.381379    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:32.463665 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:32.463585    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:32.486089 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:32.486064    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 16:59:32.486422 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:32.486402    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl" event={"ID":"e9cd766e-023b-4016-a8a8-018d2e7e5ab4","Type":"ContainerStarted","Data":"5a5ebb6683eb31a96ebc91b7938987d5a780740fd40261df5ab7fba84ef60793"}
Jul 15 16:59:32.522458 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:32.522411    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl" podStartSLOduration=9.575179616 podStartE2EDuration="28.522397645s" totalImagesPullingTime="18.947218029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:32.522037187 +0000 UTC m=+28.679452001" watchObservedRunningTime="2026-07-15 16:59:32.522397645 +0000 UTC m=+28.679812459"
Jul 15 16:59:32.562651 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:32.562621    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:32.918504 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:32.918479    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:33.021951 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:33.021831    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:33.359410 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:33.359326    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:33.359410 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:33.359357    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:33.359593 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:33.359449    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:33.359593 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:33.359575    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:33.490070 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:33.490035    2556 generic.go:356] "Generic (PLEG): container finished" podID="8e8933d2-0b56-4b1f-bd19-11f72e66ee1e" containerID="72d1ec321fbebf86a2c877c317fcf0508abba0ab3d8a11a9ae8ab5f0905d685e" exitCode=0
Jul 15 16:59:33.490539 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:33.490121    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cqdbp" event={"ID":"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e","Type":"ContainerDied","Data":"72d1ec321fbebf86a2c877c317fcf0508abba0ab3d8a11a9ae8ab5f0905d685e"}
Jul 15 16:59:34.361086 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:34.361053    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:34.361265 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:34.361139    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:35.360263 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:35.360225    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:35.360263 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:35.360266    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:35.360681 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:35.360344    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:35.360681 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:35.360458    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:35.496161 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:35.496124    2556 generic.go:356] "Generic (PLEG): container finished" podID="8e8933d2-0b56-4b1f-bd19-11f72e66ee1e" containerID="a1eb3996f4c7e950ec48f7aa9b554148e52557b47882295498b7d70d116d0fc4" exitCode=0
Jul 15 16:59:35.496325 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:35.496192    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cqdbp" event={"ID":"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e","Type":"ContainerDied","Data":"a1eb3996f4c7e950ec48f7aa9b554148e52557b47882295498b7d70d116d0fc4"}
Jul 15 16:59:36.359873 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:36.359836    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:36.360041 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:36.359972    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:37.087038 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:37.087005    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:37.274581 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:37.274542    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:37.359683 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:37.359599    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:37.359683 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:37.359639    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:37.359930 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:37.359761    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:37.359981 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:37.359912    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:37.507418 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:37.507379    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:37.702911 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:37.702796    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:37.813891 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:37.813818    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:37.896494 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:37.896402    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:38.031269 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.031237    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:38.031445 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.031288    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:38.031445 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.031413    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:38.031445 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.031418    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:38.031582 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.031469    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret podName:838ecadb-25ac-4b24-850d-2755447e4d46 nodeName:}" failed. No retries permitted until 2026-07-15 17:00:10.031452193 +0000 UTC m=+66.188866987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret") pod "global-pull-secret-syncer-n8p6c" (UID: "838ecadb-25ac-4b24-850d-2755447e4d46") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:59:38.031582 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.031489    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs podName:d0593108-e3b3-4780-9f27-52ac2affd909 nodeName:}" failed. No retries permitted until 2026-07-15 17:00:10.03147853 +0000 UTC m=+66.188893325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs") pod "network-metrics-daemon-w9xrc" (UID: "d0593108-e3b3-4780-9f27-52ac2affd909") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:59:38.132605 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.132577    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9555n\" (UniqueName: \"kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n\") pod \"network-check-target-4gg7t\" (UID: \"9d6f90aa-bf29-4788-b427-33cd74efbefe\") " pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:38.133053 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.132827    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:59:38.133053 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.132853    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:59:38.133053 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.132865    2556 projected.go:196] Error preparing data for projected volume kube-api-access-9555n for pod openshift-network-diagnostics/network-check-target-4gg7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:38.133053 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.132925    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n podName:9d6f90aa-bf29-4788-b427-33cd74efbefe nodeName:}" failed. No retries permitted until 2026-07-15 17:00:10.132906254 +0000 UTC m=+66.290321065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9555n" (UniqueName: "kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n") pod "network-check-target-4gg7t" (UID: "9d6f90aa-bf29-4788-b427-33cd74efbefe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:59:38.269625 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.269590    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:38.363043 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.362960    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:38.363202 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.363070    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:38.403927 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.403889    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n8p6c"]
Jul 15 16:59:38.404100 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.404012    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:38.404150 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.404127    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:38.420444 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.418666    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4gg7t"]
Jul 15 16:59:38.422410 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.422386    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w9xrc"]
Jul 15 16:59:38.422561 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.422506    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:38.422644 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.422617    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:38.434307 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.434268    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:38.504097 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:38.504065    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:38.504273 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:38.504198    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:39.909122 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:39.909087    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:40.009077 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:40.009047    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:40.246261 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:40.246062    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:40.349825 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:40.349793    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:40.362799 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:40.362778    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:40.362949 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:40.362804    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:40.362949 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:40.362870    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:40.362949 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:40.362784    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:40.363051 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:40.362970    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:40.363051 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:40.363036    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:40.511020 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:40.510974    2556 generic.go:356] "Generic (PLEG): container finished" podID="8e8933d2-0b56-4b1f-bd19-11f72e66ee1e" containerID="bea980e2f5e39535169e2321737e2c4b16509fd8b40c28efa817c4898c221ac6" exitCode=0
Jul 15 16:59:40.511167 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:40.511037    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cqdbp" event={"ID":"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e","Type":"ContainerDied","Data":"bea980e2f5e39535169e2321737e2c4b16509fd8b40c28efa817c4898c221ac6"}
Jul 15 16:59:41.518821 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:41.518789    2556 generic.go:356] "Generic (PLEG): container finished" podID="8e8933d2-0b56-4b1f-bd19-11f72e66ee1e" containerID="9e86ad59cce06301f3a6cb6d7c7a26b879e1e0bd1a3b89d6cb3f5cea5045e9c8" exitCode=0
Jul 15 16:59:41.518821 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:41.518826    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cqdbp" event={"ID":"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e","Type":"ContainerDied","Data":"9e86ad59cce06301f3a6cb6d7c7a26b879e1e0bd1a3b89d6cb3f5cea5045e9c8"}
Jul 15 16:59:42.359858 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.359829    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:42.359858 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.359846    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:42.360045 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.359829    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:42.360045 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:42.359941    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9xrc" podUID="d0593108-e3b3-4780-9f27-52ac2affd909"
Jul 15 16:59:42.360045 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:42.360004    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n8p6c" podUID="838ecadb-25ac-4b24-850d-2755447e4d46"
Jul 15 16:59:42.360136 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:42.360092    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gg7t" podUID="9d6f90aa-bf29-4788-b427-33cd74efbefe"
Jul 15 16:59:42.524347 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.524266    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cqdbp" event={"ID":"8e8933d2-0b56-4b1f-bd19-11f72e66ee1e","Type":"ContainerStarted","Data":"d140d5c281df1ce9363e5ceb8a91f6e09fb42d779542aaf51883d719f9ae56b6"}
Jul 15 16:59:42.558009 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.557955    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cqdbp" podStartSLOduration=8.381424796 podStartE2EDuration="38.557935965s" totalImagesPullingTime="30.176511169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:42.555935222 +0000 UTC m=+38.713350035" watchObservedRunningTime="2026-07-15 16:59:42.557935965 +0000 UTC m=+38.715350784"
Jul 15 16:59:42.597332 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.597308    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-100.ec2.internal" event="NodeReady"
Jul 15 16:59:42.597471 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.597443    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 16:59:42.657686 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.657654    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"]
Jul 15 16:59:42.679885 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.679860    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.681873 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.681850    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4rfjp"]
Jul 15 16:59:42.688034 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.687833    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 16:59:42.688034 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.687871    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 16:59:42.688034 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.687949    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 16:59:42.688303 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.688288    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9d5w4\""
Jul 15 16:59:42.699856 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.699835    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 16:59:42.699969 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.699837    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"]
Jul 15 16:59:42.699969 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.699896    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4rfjp"
Jul 15 16:59:42.699969 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.699937    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cwk6g"]
Jul 15 16:59:42.707773 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.707184    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kt5f5\""
Jul 15 16:59:42.707955 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.707933    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 16:59:42.708321 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.707477    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 16:59:42.709897 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.709874    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 16:59:42.717863 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.717846    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4rfjp"]
Jul 15 16:59:42.717944 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.717872    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cwk6g"]
Jul 15 16:59:42.717980 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.717954    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.723153 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.723139    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 16:59:42.723396 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.723379    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 16:59:42.723500 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.723416    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 16:59:42.723500 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.723384    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2tcfp\""
Jul 15 16:59:42.723500 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.723430    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 16:59:42.725586 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.725571    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sc5dw"]
Jul 15 16:59:42.748098 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.748078    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.749750 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.749708    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sc5dw"]
Jul 15 16:59:42.755346 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.755329    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 16:59:42.755520 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.755503    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5hxs5\""
Jul 15 16:59:42.755803 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.755788    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 16:59:42.763212 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.763194    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-registry-certificates\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.763297 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.763220    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-installation-pull-secrets\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.763297 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.763257    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-trusted-ca\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.763384 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.763299    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-registry-tls\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.763384 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.763321    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxws8\" (UniqueName: \"kubernetes.io/projected/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-kube-api-access-wxws8\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.763384 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.763341    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-bound-sa-token\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.763384 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.763368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-image-registry-private-configuration\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.763514 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.763386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-ca-trust-extracted\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.802932 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.802858    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk"]
Jul 15 16:59:42.828056 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.828034    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk"]
Jul 15 16:59:42.828172 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.828114    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk"
Jul 15 16:59:42.830865 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.830846    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 16:59:42.831136 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.831123    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-h5hdm\""
Jul 15 16:59:42.864126 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864104    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-bound-sa-token\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.864231 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864139    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-image-registry-private-configuration\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.864231 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864159    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-ca-trust-extracted\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.864231 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864177    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a246308-2ef7-4138-9a07-ceace42eb3ff-config-volume\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.864231 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864203    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a246308-2ef7-4138-9a07-ceace42eb3ff-tmp-dir\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.864231 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864229    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b7c7d5ec-f372-475c-8271-c58d505fb309-crio-socket\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.864414 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864309    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84554a28-9f3b-4e49-bb06-8e877331ed77-cert\") pod \"ingress-canary-4rfjp\" (UID: \"84554a28-9f3b-4e49-bb06-8e877331ed77\") " pod="openshift-ingress-canary/ingress-canary-4rfjp"
Jul 15 16:59:42.864414 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864361    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-registry-certificates\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.864508 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864409    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7c7d5ec-f372-475c-8271-c58d505fb309-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.864508 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864438    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-installation-pull-secrets\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.864508 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864471    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcbnf\" (UniqueName: \"kubernetes.io/projected/4a246308-2ef7-4138-9a07-ceace42eb3ff-kube-api-access-qcbnf\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.864508 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864494    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrphc\" (UniqueName: \"kubernetes.io/projected/84554a28-9f3b-4e49-bb06-8e877331ed77-kube-api-access-qrphc\") pod \"ingress-canary-4rfjp\" (UID: \"84554a28-9f3b-4e49-bb06-8e877331ed77\") " pod="openshift-ingress-canary/ingress-canary-4rfjp"
Jul 15 16:59:42.864699 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7c7d5ec-f372-475c-8271-c58d505fb309-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.864699 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864556    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcmdl\" (UniqueName: \"kubernetes.io/projected/b7c7d5ec-f372-475c-8271-c58d505fb309-kube-api-access-vcmdl\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.864699 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864578    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-ca-trust-extracted\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.864699 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864596    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-trusted-ca\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.864699 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864618    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a246308-2ef7-4138-9a07-ceace42eb3ff-metrics-tls\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.864699 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864645    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-registry-tls\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.864699 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864666    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxws8\" (UniqueName: \"kubernetes.io/projected/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-kube-api-access-wxws8\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.864699 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.864690    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7c7d5ec-f372-475c-8271-c58d505fb309-data-volume\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.865243 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.865213    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-registry-certificates\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.865489 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.865468    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-trusted-ca\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.868331 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.868303    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-installation-pull-secrets\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.868407 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.868392    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-registry-tls\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.868448 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.868436    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-image-registry-private-configuration\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.888947 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.888924    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-bound-sa-token\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.895252 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.895234    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxws8\" (UniqueName: \"kubernetes.io/projected/9a3d39dc-edb9-4ee9-bae2-ad30294d152c-kube-api-access-wxws8\") pod \"image-registry-5d5dc4c6b5-b4pvz\" (UID: \"9a3d39dc-edb9-4ee9-bae2-ad30294d152c\") " pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.965240 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965210    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcbnf\" (UniqueName: \"kubernetes.io/projected/4a246308-2ef7-4138-9a07-ceace42eb3ff-kube-api-access-qcbnf\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.965240 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrphc\" (UniqueName: \"kubernetes.io/projected/84554a28-9f3b-4e49-bb06-8e877331ed77-kube-api-access-qrphc\") pod \"ingress-canary-4rfjp\" (UID: \"84554a28-9f3b-4e49-bb06-8e877331ed77\") " pod="openshift-ingress-canary/ingress-canary-4rfjp"
Jul 15 16:59:42.965415 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965263    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7c7d5ec-f372-475c-8271-c58d505fb309-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.965415 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965287    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmdl\" (UniqueName: \"kubernetes.io/projected/b7c7d5ec-f372-475c-8271-c58d505fb309-kube-api-access-vcmdl\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.965415 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965341    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a246308-2ef7-4138-9a07-ceace42eb3ff-metrics-tls\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.965415 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965395    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7c7d5ec-f372-475c-8271-c58d505fb309-data-volume\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.965563 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965429    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/233a36b3-b7e6-46f7-b24f-5e52e8bf39f7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-qfdbk\" (UID: \"233a36b3-b7e6-46f7-b24f-5e52e8bf39f7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk"
Jul 15 16:59:42.965563 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965471    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a246308-2ef7-4138-9a07-ceace42eb3ff-config-volume\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.965563 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965537    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a246308-2ef7-4138-9a07-ceace42eb3ff-tmp-dir\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.965686 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965569    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b7c7d5ec-f372-475c-8271-c58d505fb309-crio-socket\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.965686 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965619    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84554a28-9f3b-4e49-bb06-8e877331ed77-cert\") pod \"ingress-canary-4rfjp\" (UID: \"84554a28-9f3b-4e49-bb06-8e877331ed77\") " pod="openshift-ingress-canary/ingress-canary-4rfjp"
Jul 15 16:59:42.965686 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965654    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7c7d5ec-f372-475c-8271-c58d505fb309-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.965836 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965816    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7c7d5ec-f372-475c-8271-c58d505fb309-data-volume\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.966026 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965912    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b7c7d5ec-f372-475c-8271-c58d505fb309-crio-socket\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.966026 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.965912    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7c7d5ec-f372-475c-8271-c58d505fb309-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.966182 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.966146    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a246308-2ef7-4138-9a07-ceace42eb3ff-config-volume\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.966182 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.966166    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a246308-2ef7-4138-9a07-ceace42eb3ff-tmp-dir\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.967808 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.967779    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a246308-2ef7-4138-9a07-ceace42eb3ff-metrics-tls\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.967808 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.967802    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7c7d5ec-f372-475c-8271-c58d505fb309-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.968059 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.968042    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84554a28-9f3b-4e49-bb06-8e877331ed77-cert\") pod \"ingress-canary-4rfjp\" (UID: \"84554a28-9f3b-4e49-bb06-8e877331ed77\") " pod="openshift-ingress-canary/ingress-canary-4rfjp"
Jul 15 16:59:42.989368 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.989344    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:42.989802 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.989785    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcbnf\" (UniqueName: \"kubernetes.io/projected/4a246308-2ef7-4138-9a07-ceace42eb3ff-kube-api-access-qcbnf\") pod \"dns-default-sc5dw\" (UID: \"4a246308-2ef7-4138-9a07-ceace42eb3ff\") " pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:42.991577 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.991560    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmdl\" (UniqueName: \"kubernetes.io/projected/b7c7d5ec-f372-475c-8271-c58d505fb309-kube-api-access-vcmdl\") pod \"insights-runtime-extractor-cwk6g\" (UID: \"b7c7d5ec-f372-475c-8271-c58d505fb309\") " pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:42.991954 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:42.991938    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrphc\" (UniqueName: \"kubernetes.io/projected/84554a28-9f3b-4e49-bb06-8e877331ed77-kube-api-access-qrphc\") pod \"ingress-canary-4rfjp\" (UID: \"84554a28-9f3b-4e49-bb06-8e877331ed77\") " pod="openshift-ingress-canary/ingress-canary-4rfjp"
Jul 15 16:59:43.012806 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.012785    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4rfjp"
Jul 15 16:59:43.026915 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.026889    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cwk6g"
Jul 15 16:59:43.056744 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.056670    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:43.067001 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.066978    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/233a36b3-b7e6-46f7-b24f-5e52e8bf39f7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-qfdbk\" (UID: \"233a36b3-b7e6-46f7-b24f-5e52e8bf39f7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk"
Jul 15 16:59:43.067141 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:43.067122    2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 16:59:43.067198 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:43.067187    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/233a36b3-b7e6-46f7-b24f-5e52e8bf39f7-tls-certificates podName:233a36b3-b7e6-46f7-b24f-5e52e8bf39f7 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:43.567171136 +0000 UTC m=+39.724585927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/233a36b3-b7e6-46f7-b24f-5e52e8bf39f7-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-qfdbk" (UID: "233a36b3-b7e6-46f7-b24f-5e52e8bf39f7") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 16:59:43.214267 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.214022    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4rfjp"]
Jul 15 16:59:43.217846 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.217783    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"]
Jul 15 16:59:43.219136 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:43.219098    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84554a28_9f3b_4e49_bb06_8e877331ed77.slice/crio-fa5c8771d525b08acbd6ee18262cc0023a3af9bfcf1c13a665a472bc5571d3ca WatchSource:0}: Error finding container fa5c8771d525b08acbd6ee18262cc0023a3af9bfcf1c13a665a472bc5571d3ca: Status 404 returned error can't find the container with id fa5c8771d525b08acbd6ee18262cc0023a3af9bfcf1c13a665a472bc5571d3ca
Jul 15 16:59:43.222704 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:43.222672    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3d39dc_edb9_4ee9_bae2_ad30294d152c.slice/crio-eeb3a432da23086cca81af54ee6bbacca005c79e7d2b5beb9948aeb607ca33ca WatchSource:0}: Error finding container eeb3a432da23086cca81af54ee6bbacca005c79e7d2b5beb9948aeb607ca33ca: Status 404 returned error can't find the container with id eeb3a432da23086cca81af54ee6bbacca005c79e7d2b5beb9948aeb607ca33ca
Jul 15 16:59:43.236841 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.236818    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cwk6g"]
Jul 15 16:59:43.242388 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:43.242369    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c7d5ec_f372_475c_8271_c58d505fb309.slice/crio-25f77be1fd45b73074edfa2ae7ad4d4e65b9ef0d4c6f79a6b9068169b3543f74 WatchSource:0}: Error finding container 25f77be1fd45b73074edfa2ae7ad4d4e65b9ef0d4c6f79a6b9068169b3543f74: Status 404 returned error can't find the container with id 25f77be1fd45b73074edfa2ae7ad4d4e65b9ef0d4c6f79a6b9068169b3543f74
Jul 15 16:59:43.265053 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.265027    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sc5dw"]
Jul 15 16:59:43.267867 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:43.267836    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a246308_2ef7_4138_9a07_ceace42eb3ff.slice/crio-57b77aa979c602d0750906838e8cbc96271a13a152bc9d12eb99d357fe9e9a78 WatchSource:0}: Error finding container 57b77aa979c602d0750906838e8cbc96271a13a152bc9d12eb99d357fe9e9a78: Status 404 returned error can't find the container with id 57b77aa979c602d0750906838e8cbc96271a13a152bc9d12eb99d357fe9e9a78
Jul 15 16:59:43.528222 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.528186    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sc5dw" event={"ID":"4a246308-2ef7-4138-9a07-ceace42eb3ff","Type":"ContainerStarted","Data":"57b77aa979c602d0750906838e8cbc96271a13a152bc9d12eb99d357fe9e9a78"}
Jul 15 16:59:43.529377 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.529348    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4rfjp" event={"ID":"84554a28-9f3b-4e49-bb06-8e877331ed77","Type":"ContainerStarted","Data":"fa5c8771d525b08acbd6ee18262cc0023a3af9bfcf1c13a665a472bc5571d3ca"}
Jul 15 16:59:43.530743 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.530698    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz" event={"ID":"9a3d39dc-edb9-4ee9-bae2-ad30294d152c","Type":"ContainerStarted","Data":"55cbe19eb2823f5ab0b9d5afa45c01c9f2538bbd82f55389580aa36dcc256080"}
Jul 15 16:59:43.530850 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.530761    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz" event={"ID":"9a3d39dc-edb9-4ee9-bae2-ad30294d152c","Type":"ContainerStarted","Data":"eeb3a432da23086cca81af54ee6bbacca005c79e7d2b5beb9948aeb607ca33ca"}
Jul 15 16:59:43.530850 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.530839    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 16:59:43.531892 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.531867    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cwk6g" event={"ID":"b7c7d5ec-f372-475c-8271-c58d505fb309","Type":"ContainerStarted","Data":"25f77be1fd45b73074edfa2ae7ad4d4e65b9ef0d4c6f79a6b9068169b3543f74"}
Jul 15 16:59:43.571066 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.571033    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/233a36b3-b7e6-46f7-b24f-5e52e8bf39f7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-qfdbk\" (UID: \"233a36b3-b7e6-46f7-b24f-5e52e8bf39f7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk"
Jul 15 16:59:43.574282 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.574255    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/233a36b3-b7e6-46f7-b24f-5e52e8bf39f7-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-qfdbk\" (UID: \"233a36b3-b7e6-46f7-b24f-5e52e8bf39f7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk"
Jul 15 16:59:43.585664 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.585592    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz" podStartSLOduration=7.58557628 podStartE2EDuration="7.58557628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:59:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:43.584472231 +0000 UTC m=+39.741887044" watchObservedRunningTime="2026-07-15 16:59:43.58557628 +0000 UTC m=+39.742991094"
Jul 15 16:59:43.735975 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.735931    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk"
Jul 15 16:59:43.930094 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:43.929756    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk"]
Jul 15 16:59:43.941165 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:43.936120    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod233a36b3_b7e6_46f7_b24f_5e52e8bf39f7.slice/crio-095d2dbd84c99e9e9b3199b8829ad585e3502e6b49956f0dec68db151bcc6a14 WatchSource:0}: Error finding container 095d2dbd84c99e9e9b3199b8829ad585e3502e6b49956f0dec68db151bcc6a14: Status 404 returned error can't find the container with id 095d2dbd84c99e9e9b3199b8829ad585e3502e6b49956f0dec68db151bcc6a14
Jul 15 16:59:44.367311 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:44.367272    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 16:59:44.367490 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:44.367385    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 16:59:44.367885 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:44.367867    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 16:59:44.376620 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:44.376597    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 16:59:44.376993 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:44.376974    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 16:59:44.377215 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:44.377198    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 16:59:44.377618 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:44.377598    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 16:59:44.377824 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:44.377808    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7t54\""
Jul 15 16:59:44.378010 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:44.377993    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tns8n\""
Jul 15 16:59:44.537729 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:44.537679    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk" event={"ID":"233a36b3-b7e6-46f7-b24f-5e52e8bf39f7","Type":"ContainerStarted","Data":"095d2dbd84c99e9e9b3199b8829ad585e3502e6b49956f0dec68db151bcc6a14"}
Jul 15 16:59:51.558515 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.558475    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sc5dw" event={"ID":"4a246308-2ef7-4138-9a07-ceace42eb3ff","Type":"ContainerStarted","Data":"ecfa1abafdf46e94ddaf39e0bd68d3f185b227ce4262691570ff83e15524da1a"}
Jul 15 16:59:51.559026 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.558590    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sc5dw"
Jul 15 16:59:51.559026 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.558615    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sc5dw" event={"ID":"4a246308-2ef7-4138-9a07-ceace42eb3ff","Type":"ContainerStarted","Data":"d0487c577043f76d803b78cc9c46ec6edb27c746e4aed26f7197f1ce90a0d67a"}
Jul 15 16:59:51.560018 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.559995    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4rfjp" event={"ID":"84554a28-9f3b-4e49-bb06-8e877331ed77","Type":"ContainerStarted","Data":"a8887ea61d85aeb6c52e4c7d85b5868fb4f305962dabb8b9dd4a853e495b2a01"}
Jul 15 16:59:51.561458 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.561441    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cwk6g" event={"ID":"b7c7d5ec-f372-475c-8271-c58d505fb309","Type":"ContainerStarted","Data":"3c83d40a15740e66f3a0e684dd1f6833adbb9d1eb81fd773e5ddaed5673a3fed"}
Jul 15 16:59:51.562887 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.562868    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk" event={"ID":"233a36b3-b7e6-46f7-b24f-5e52e8bf39f7","Type":"ContainerStarted","Data":"99094c5c63f38b0be94a89ed4729acf24d60795dc4ec50c299be1f3a3640df29"}
Jul 15 16:59:51.563044 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.563024    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk"
Jul 15 16:59:51.567781 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.567762    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk"
Jul 15 16:59:51.591811 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.591773    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sc5dw" podStartSLOduration=2.166003227 podStartE2EDuration="9.591760837s" totalImagesPullingTime="7.42575761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:51.590598272 +0000 UTC m=+47.748013085" watchObservedRunningTime="2026-07-15 16:59:51.591760837 +0000 UTC m=+47.749175650"
Jul 15 16:59:51.611921 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.611880    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4rfjp" podStartSLOduration=2.547225455 podStartE2EDuration="9.611864797s" totalImagesPullingTime="7.064639342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:51.611519607 +0000 UTC m=+47.768934420" watchObservedRunningTime="2026-07-15 16:59:51.611864797 +0000 UTC m=+47.769279610"
Jul 15 16:59:51.650454 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.650406    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-qfdbk" podStartSLOduration=2.894868947 podStartE2EDuration="9.650392665s" totalImagesPullingTime="6.755523718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:51.650045785 +0000 UTC m=+47.807460609" watchObservedRunningTime="2026-07-15 16:59:51.650392665 +0000 UTC m=+47.807807479"
Jul 15 16:59:51.995657 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:51.995628    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-cgldp"]
Jul 15 16:59:52.008919 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.008894    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.012702 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.012682    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 16:59:52.012916 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.012903    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 16:59:52.013702 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.013674    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pm2lg\""
Jul 15 16:59:52.013997 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.013980    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 16:59:52.014797 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.014779    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 16:59:52.015188 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.015140    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 16:59:52.023023 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.023001    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-cgldp"]
Jul 15 16:59:52.141952 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.141917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.141952 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.141958    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.142152 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.141986    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ae189ad-cfe7-4a05-96a2-c02a564f3299-metrics-client-ca\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.142152 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.142067    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7b7x\" (UniqueName: \"kubernetes.io/projected/7ae189ad-cfe7-4a05-96a2-c02a564f3299-kube-api-access-f7b7x\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.242430 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.242387    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7b7x\" (UniqueName: \"kubernetes.io/projected/7ae189ad-cfe7-4a05-96a2-c02a564f3299-kube-api-access-f7b7x\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.242614 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.242490    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.242614 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.242532    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.242614 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.242570    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ae189ad-cfe7-4a05-96a2-c02a564f3299-metrics-client-ca\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.242614 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:52.242582    2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 15 16:59:52.242850 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:52.242649    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-tls podName:7ae189ad-cfe7-4a05-96a2-c02a564f3299 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:52.742629712 +0000 UTC m=+48.900044515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-tls") pod "prometheus-operator-64785b6675-cgldp" (UID: "7ae189ad-cfe7-4a05-96a2-c02a564f3299") : secret "prometheus-operator-tls" not found
Jul 15 16:59:52.243364 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.243335    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ae189ad-cfe7-4a05-96a2-c02a564f3299-metrics-client-ca\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.245214 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.245181    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.271012 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.270960    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7b7x\" (UniqueName: \"kubernetes.io/projected/7ae189ad-cfe7-4a05-96a2-c02a564f3299-kube-api-access-f7b7x\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.747071 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:52.747032    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:52.747558 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:52.747243    2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 15 16:59:52.747649 ip-10-0-135-100 kubenswrapper[2556]: E0715 16:59:52.747632    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-tls podName:7ae189ad-cfe7-4a05-96a2-c02a564f3299 nodeName:}" failed. No retries permitted until 2026-07-15 16:59:53.747294598 +0000 UTC m=+49.904709406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-tls") pod "prometheus-operator-64785b6675-cgldp" (UID: "7ae189ad-cfe7-4a05-96a2-c02a564f3299") : secret "prometheus-operator-tls" not found
Jul 15 16:59:53.756893 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:53.756848    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:53.759718 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:53.759688    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ae189ad-cfe7-4a05-96a2-c02a564f3299-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-cgldp\" (UID: \"7ae189ad-cfe7-4a05-96a2-c02a564f3299\") " pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:53.817517 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:53.817480    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp"
Jul 15 16:59:55.571886 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:55.571865    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-cgldp"]
Jul 15 16:59:55.663839 ip-10-0-135-100 kubenswrapper[2556]: W0715 16:59:55.663808    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae189ad_cfe7_4a05_96a2_c02a564f3299.slice/crio-f8daae5afcee3d825c8e472682478f5528b1f778e1beda9214cd4c06f9504bae WatchSource:0}: Error finding container f8daae5afcee3d825c8e472682478f5528b1f778e1beda9214cd4c06f9504bae: Status 404 returned error can't find the container with id f8daae5afcee3d825c8e472682478f5528b1f778e1beda9214cd4c06f9504bae
Jul 15 16:59:56.581462 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:56.581424    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cwk6g" event={"ID":"b7c7d5ec-f372-475c-8271-c58d505fb309","Type":"ContainerStarted","Data":"7d07e5ea55e8c5355410e398f66b15ec67c5416120409fab247fcd63b3e23464"}
Jul 15 16:59:56.582696 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:56.582660    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp" event={"ID":"7ae189ad-cfe7-4a05-96a2-c02a564f3299","Type":"ContainerStarted","Data":"f8daae5afcee3d825c8e472682478f5528b1f778e1beda9214cd4c06f9504bae"}
Jul 15 16:59:57.587279 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:57.587247    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp" event={"ID":"7ae189ad-cfe7-4a05-96a2-c02a564f3299","Type":"ContainerStarted","Data":"2ae4dbcabe87b53588fb63e9ef2bc8b3eb28e1151603c32ac971aa19b84db6d4"}
Jul 15 16:59:58.593781 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:58.593739    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp" event={"ID":"7ae189ad-cfe7-4a05-96a2-c02a564f3299","Type":"ContainerStarted","Data":"9b711ed63523c30d3fb12a8a13ddbc2a17ae07df8238c30d805cc6fdffa895dd"}
Jul 15 16:59:58.614663 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:58.614327    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-cgldp" podStartSLOduration=5.871450406 podStartE2EDuration="7.61430806s" totalImagesPullingTime="1.742857654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:58.614060908 +0000 UTC m=+54.771475735" watchObservedRunningTime="2026-07-15 16:59:58.61430806 +0000 UTC m=+54.771722873"
Jul 15 16:59:59.598634 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:59.598602    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cwk6g" event={"ID":"b7c7d5ec-f372-475c-8271-c58d505fb309","Type":"ContainerStarted","Data":"3e4572c20dd1514178e342a094c6f4c3866901251d0af9c59a2a6d33b322a03d"}
Jul 15 16:59:59.631537 ip-10-0-135-100 kubenswrapper[2556]: I0715 16:59:59.631475    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cwk6g" podStartSLOduration=1.691662907 podStartE2EDuration="17.631459345s" totalImagesPullingTime="15.939796438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:59:59.630916935 +0000 UTC m=+55.788331750" watchObservedRunningTime="2026-07-15 16:59:59.631459345 +0000 UTC m=+55.788874158"
Jul 15 17:00:00.809448 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.809415    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kcxc9"]
Jul 15 17:00:00.812521 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.812503    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:00.819890 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.819861    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 17:00:00.820282 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.820013    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 17:00:00.822084 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.820422    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rnszz\""
Jul 15 17:00:00.822084 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.821883    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 17:00:00.911574 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.911537    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf2a3932-666a-49fc-b8b6-484b0855e9c2-sys\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:00.911574 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.911575    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-tls\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:00.911821 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.911600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-textfile\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:00.911821 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.911622    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pllt\" (UniqueName: \"kubernetes.io/projected/bf2a3932-666a-49fc-b8b6-484b0855e9c2-kube-api-access-6pllt\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:00.911821 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.911763    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf2a3932-666a-49fc-b8b6-484b0855e9c2-root\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:00.911821 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.911795    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:00.911821 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.911820    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:00.911986 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.911857    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-wtmp\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:00.911986 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:00.911911    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf2a3932-666a-49fc-b8b6-484b0855e9c2-metrics-client-ca\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.012616 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012583    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-textfile\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.012616 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012624    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pllt\" (UniqueName: \"kubernetes.io/projected/bf2a3932-666a-49fc-b8b6-484b0855e9c2-kube-api-access-6pllt\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.012891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012665    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf2a3932-666a-49fc-b8b6-484b0855e9c2-root\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.012891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012693    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.012891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.012891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012770    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-wtmp\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.012891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012771    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf2a3932-666a-49fc-b8b6-484b0855e9c2-root\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.012891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012796    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf2a3932-666a-49fc-b8b6-484b0855e9c2-metrics-client-ca\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.012891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012855    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf2a3932-666a-49fc-b8b6-484b0855e9c2-sys\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.012891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012883    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-tls\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.013262 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012918    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-wtmp\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.013262 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.012954    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf2a3932-666a-49fc-b8b6-484b0855e9c2-sys\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.013262 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.013159    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-textfile\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.013418 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.013351    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.013418 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.013354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf2a3932-666a-49fc-b8b6-484b0855e9c2-metrics-client-ca\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.015211 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.015192    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.015305 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.015238    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf2a3932-666a-49fc-b8b6-484b0855e9c2-node-exporter-tls\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.023365 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.023347    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pllt\" (UniqueName: \"kubernetes.io/projected/bf2a3932-666a-49fc-b8b6-484b0855e9c2-kube-api-access-6pllt\") pod \"node-exporter-kcxc9\" (UID: \"bf2a3932-666a-49fc-b8b6-484b0855e9c2\") " pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.123888 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.123788    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcxc9"
Jul 15 17:00:01.134603 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:00:01.134579    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf2a3932_666a_49fc_b8b6_484b0855e9c2.slice/crio-ccec5d8e74f367162d726f0f929c7afc2dcd9360b73222ba3d1b41b8c707a573 WatchSource:0}: Error finding container ccec5d8e74f367162d726f0f929c7afc2dcd9360b73222ba3d1b41b8c707a573: Status 404 returned error can't find the container with id ccec5d8e74f367162d726f0f929c7afc2dcd9360b73222ba3d1b41b8c707a573
Jul 15 17:00:01.568555 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.568522    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sc5dw"
Jul 15 17:00:01.606477 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:01.606447    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxc9" event={"ID":"bf2a3932-666a-49fc-b8b6-484b0855e9c2","Type":"ContainerStarted","Data":"ccec5d8e74f367162d726f0f929c7afc2dcd9360b73222ba3d1b41b8c707a573"}
Jul 15 17:00:03.500638 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:03.500612    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptpxl"
Jul 15 17:00:03.614346 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:03.614310    2556 generic.go:356] "Generic (PLEG): container finished" podID="bf2a3932-666a-49fc-b8b6-484b0855e9c2" containerID="e8bbc942b23a693f0e6fc158061ab6b12fca96f5c2bb2ceaacf3f66f5ddc9956" exitCode=0
Jul 15 17:00:03.614497 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:03.614353    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxc9" event={"ID":"bf2a3932-666a-49fc-b8b6-484b0855e9c2","Type":"ContainerDied","Data":"e8bbc942b23a693f0e6fc158061ab6b12fca96f5c2bb2ceaacf3f66f5ddc9956"}
Jul 15 17:00:04.542375 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:04.542346    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d5dc4c6b5-b4pvz"
Jul 15 17:00:04.620135 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:04.620100    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxc9" event={"ID":"bf2a3932-666a-49fc-b8b6-484b0855e9c2","Type":"ContainerStarted","Data":"fa9459ef9bd862f69009630bb28b6a6843a70e5ec1962ec00e3b1b726ff275e1"}
Jul 15 17:00:04.620313 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:04.620153    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxc9" event={"ID":"bf2a3932-666a-49fc-b8b6-484b0855e9c2","Type":"ContainerStarted","Data":"635d7e4ba45d87fd6336465f834294f1d5c7e69265cd3c1da4511b07d54919c5"}
Jul 15 17:00:04.672760 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:04.672685    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kcxc9" podStartSLOduration=2.8941079050000003 podStartE2EDuration="4.672667766s" totalImagesPullingTime="1.716694339s" totalInitContainerRuntime="61.865522ms" isStatefulPod=true podCreationTimestamp="2026-07-15 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:00:04.668944351 +0000 UTC m=+60.826359165" watchObservedRunningTime="2026-07-15 17:00:04.672667766 +0000 UTC m=+60.830082579"
Jul 15 17:00:05.414480 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.414449    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cf7c9985c-r6vzk"]
Jul 15 17:00:05.440098 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.440073    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.451799 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.451772    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 17:00:05.451931 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.451915    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 17:00:05.452967 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.452953    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 17:00:05.481494 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.481469    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 17:00:05.482135 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.482108    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 17:00:05.482254 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.482136    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 17:00:05.482254 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.482176    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 17:00:05.482633 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.482620    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g6j9q\""
Jul 15 17:00:05.483199 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.483176    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf7c9985c-r6vzk"]
Jul 15 17:00:05.495653 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.495633    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 17:00:05.543577 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.543544    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-oauth-serving-cert\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.543934 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.543600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-console-config\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.543934 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.543648    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgq8l\" (UniqueName: \"kubernetes.io/projected/0fb6e570-94cd-4d52-ac03-d374d684164f-kube-api-access-dgq8l\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.543934 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.543693    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-serving-cert\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.543934 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.543772    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-oauth-config\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.543934 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.543798    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-service-ca\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.543934 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.543823    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-trusted-ca-bundle\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.602680 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.602649    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b65767697-f8qcz"]
Jul 15 17:00:05.605147 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.605131    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.615959 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.615939    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 17:00:05.617521 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.617502    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vxmj8\""
Jul 15 17:00:05.617623 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.617560    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3os4au6o6nupp\""
Jul 15 17:00:05.617685 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.617674    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 17:00:05.617821 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.617805    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 17:00:05.618744 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.618730    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 17:00:05.627808 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.627788    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b65767697-f8qcz"]
Jul 15 17:00:05.645145 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645125    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dqtz\" (UniqueName: \"kubernetes.io/projected/aa9e7099-7097-415e-b1f7-3f686383b6a7-kube-api-access-9dqtz\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.645270 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645159    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-oauth-config\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.645270 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645183    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa9e7099-7097-415e-b1f7-3f686383b6a7-client-ca-bundle\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.645270 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645213    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-service-ca\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.645541 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645358    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-trusted-ca-bundle\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.645541 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645403    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa9e7099-7097-415e-b1f7-3f686383b6a7-secret-metrics-server-client-certs\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.645541 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645503    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-oauth-serving-cert\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.645727 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645558    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa9e7099-7097-415e-b1f7-3f686383b6a7-metrics-server-audit-profiles\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.645727 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645591    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa9e7099-7097-415e-b1f7-3f686383b6a7-audit-log\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.645727 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645634    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-console-config\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.645727 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645661    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgq8l\" (UniqueName: \"kubernetes.io/projected/0fb6e570-94cd-4d52-ac03-d374d684164f-kube-api-access-dgq8l\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.645939 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645705    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-serving-cert\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.645939 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa9e7099-7097-415e-b1f7-3f686383b6a7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.645939 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.645830    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa9e7099-7097-415e-b1f7-3f686383b6a7-secret-metrics-server-tls\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.646084 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.646001    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-service-ca\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.646218 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.646185    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-trusted-ca-bundle\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.646464 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.646441    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-oauth-serving-cert\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.646678 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.646604    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-console-config\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.647755 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.647736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-oauth-config\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.648748 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.648729    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-serving-cert\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.689611 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.689545    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgq8l\" (UniqueName: \"kubernetes.io/projected/0fb6e570-94cd-4d52-ac03-d374d684164f-kube-api-access-dgq8l\") pod \"console-cf7c9985c-r6vzk\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") " pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.746874 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.746842    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa9e7099-7097-415e-b1f7-3f686383b6a7-metrics-server-audit-profiles\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.747043 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.746883    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa9e7099-7097-415e-b1f7-3f686383b6a7-audit-log\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.747043 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.746953    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa9e7099-7097-415e-b1f7-3f686383b6a7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.747043 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.746987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa9e7099-7097-415e-b1f7-3f686383b6a7-secret-metrics-server-tls\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.747194 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.747106    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dqtz\" (UniqueName: \"kubernetes.io/projected/aa9e7099-7097-415e-b1f7-3f686383b6a7-kube-api-access-9dqtz\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.747194 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.747147    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa9e7099-7097-415e-b1f7-3f686383b6a7-client-ca-bundle\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.747297 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.747200    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa9e7099-7097-415e-b1f7-3f686383b6a7-secret-metrics-server-client-certs\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.747363 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.747345    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa9e7099-7097-415e-b1f7-3f686383b6a7-audit-log\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.747643 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.747623    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa9e7099-7097-415e-b1f7-3f686383b6a7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.747957 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.747934    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa9e7099-7097-415e-b1f7-3f686383b6a7-metrics-server-audit-profiles\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.748685 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.748667    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:05.749465 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.749435    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa9e7099-7097-415e-b1f7-3f686383b6a7-client-ca-bundle\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.749541 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.749492    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa9e7099-7097-415e-b1f7-3f686383b6a7-secret-metrics-server-tls\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.749643 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.749623    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa9e7099-7097-415e-b1f7-3f686383b6a7-secret-metrics-server-client-certs\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.766478 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.766456    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dqtz\" (UniqueName: \"kubernetes.io/projected/aa9e7099-7097-415e-b1f7-3f686383b6a7-kube-api-access-9dqtz\") pod \"metrics-server-7b65767697-f8qcz\" (UID: \"aa9e7099-7097-415e-b1f7-3f686383b6a7\") " pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:05.895924 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.895889    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf7c9985c-r6vzk"]
Jul 15 17:00:05.898928 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:00:05.898904    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb6e570_94cd_4d52_ac03_d374d684164f.slice/crio-34952252fa37a62df7f5836a1fe236ae359209df2913d00b44aded185bbbee4b WatchSource:0}: Error finding container 34952252fa37a62df7f5836a1fe236ae359209df2913d00b44aded185bbbee4b: Status 404 returned error can't find the container with id 34952252fa37a62df7f5836a1fe236ae359209df2913d00b44aded185bbbee4b
Jul 15 17:00:05.913620 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:05.913572    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:06.062674 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:00:06.062637    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9e7099_7097_415e_b1f7_3f686383b6a7.slice/crio-d612c99c11a82b0dce46777f831843ef40ff6987534981f2d41cf7fc9e774b76 WatchSource:0}: Error finding container d612c99c11a82b0dce46777f831843ef40ff6987534981f2d41cf7fc9e774b76: Status 404 returned error can't find the container with id d612c99c11a82b0dce46777f831843ef40ff6987534981f2d41cf7fc9e774b76
Jul 15 17:00:06.064383 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:06.064352    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b65767697-f8qcz"]
Jul 15 17:00:06.627446 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:06.627401    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b65767697-f8qcz" event={"ID":"aa9e7099-7097-415e-b1f7-3f686383b6a7","Type":"ContainerStarted","Data":"d612c99c11a82b0dce46777f831843ef40ff6987534981f2d41cf7fc9e774b76"}
Jul 15 17:00:06.628499 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:06.628474    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7c9985c-r6vzk" event={"ID":"0fb6e570-94cd-4d52-ac03-d374d684164f","Type":"ContainerStarted","Data":"34952252fa37a62df7f5836a1fe236ae359209df2913d00b44aded185bbbee4b"}
Jul 15 17:00:07.053986 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.053955    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 17:00:07.058099 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.057795    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.064523 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.064496    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cfg8m\""
Jul 15 17:00:07.064685 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.064664    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 17:00:07.071127 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.069935    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 17:00:07.071127 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.070131    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 17:00:07.071127 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.070164    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 17:00:07.071127 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.070331    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 17:00:07.071127 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.070359    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 17:00:07.071127 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.070628    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 17:00:07.071127 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.070643    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 17:00:07.071127 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.070878    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 17:00:07.071695 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.071645    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 17:00:07.071695 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.071648    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 17:00:07.071872 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.071651    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 17:00:07.073840 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.072148    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c5gpk4m5t8137\""
Jul 15 17:00:07.073840 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.072828    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 17:00:07.080073 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.080052    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 17:00:07.095784 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.095674    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 17:00:07.158158 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.158123    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.158320 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.158180    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-web-config\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.158320 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.158212    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.158320 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.158242    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.158320 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.158271    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.158320 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.158295    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtdtf\" (UniqueName: \"kubernetes.io/projected/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-kube-api-access-mtdtf\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.158551 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.158324    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.158551 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.158355    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.158551 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.158390    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-config\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.158551 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.158411    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.158551 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.158486    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.163175 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.159079    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.163175 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.162349    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.163175 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.162385    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.163175 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.162417    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.163175 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.162455    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.163175 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.162479    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.163175 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.162511    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-config-out\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.163175 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.162541    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.163175 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.162610    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263172    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263223    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263251    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263274    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263306    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263329    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263352    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-config-out\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263373    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263423    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263449    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263486    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-web-config\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263514    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263536    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.263763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263561    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.264407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263584    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtdtf\" (UniqueName: \"kubernetes.io/projected/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-kube-api-access-mtdtf\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.264407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263610    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.264407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263638    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.264407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263669    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-config\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.264407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263690    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.264407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.263746    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.264407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.264212    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.266622 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.266590    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.268601 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.268217    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.270742 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.270263    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.270851 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.270756    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.270851 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.270825    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.271094 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.271039    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.271326 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.271306    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.271495 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.271467    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.271576 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.271524    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.275335 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.275314    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.276093 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.276070    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-config\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.276179 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.276097    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-config-out\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.276546 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.276504    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.277613 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.276914    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.277613 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.276969    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-web-config\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.277613 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.277141    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.277613 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.277398    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.280242 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.280197    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.280328 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.280270    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtdtf\" (UniqueName: \"kubernetes.io/projected/23b5588a-2f50-40dc-8e7f-fd0ece6aa207-kube-api-access-mtdtf\") pod \"prometheus-k8s-0\" (UID: \"23b5588a-2f50-40dc-8e7f-fd0ece6aa207\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.373796 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.373582    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:07.549252 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.549112    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 17:00:07.552115 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:00:07.552086    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b5588a_2f50_40dc_8e7f_fd0ece6aa207.slice/crio-14ed607d850167b504a8dc897f7c4de0c74389fffa84da3ccc4cbc80dece2b88 WatchSource:0}: Error finding container 14ed607d850167b504a8dc897f7c4de0c74389fffa84da3ccc4cbc80dece2b88: Status 404 returned error can't find the container with id 14ed607d850167b504a8dc897f7c4de0c74389fffa84da3ccc4cbc80dece2b88
Jul 15 17:00:07.634602 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:07.634515    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23b5588a-2f50-40dc-8e7f-fd0ece6aa207","Type":"ContainerStarted","Data":"14ed607d850167b504a8dc897f7c4de0c74389fffa84da3ccc4cbc80dece2b88"}
Jul 15 17:00:09.645745 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:09.645631    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b65767697-f8qcz" event={"ID":"aa9e7099-7097-415e-b1f7-3f686383b6a7","Type":"ContainerStarted","Data":"f48e9e17c05b5a4f53d04ffc87eae20bd95dd9d972007eb50137ee86e429f609"}
Jul 15 17:00:09.649675 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:09.649644    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7c9985c-r6vzk" event={"ID":"0fb6e570-94cd-4d52-ac03-d374d684164f","Type":"ContainerStarted","Data":"a25f737a865e34d28596519f27f414a18e8053f592ee9388ea1e06f25cbb60fa"}
Jul 15 17:00:09.701409 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:09.701356    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b65767697-f8qcz" podStartSLOduration=1.5183932580000001 podStartE2EDuration="4.701339723s" totalImagesPullingTime="3.182946465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:00:09.700403742 +0000 UTC m=+65.857818558" watchObservedRunningTime="2026-07-15 17:00:09.701339723 +0000 UTC m=+65.858754538"
Jul 15 17:00:10.090016 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.089985    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 17:00:10.090167 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.090041    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 17:00:10.100793 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.100766    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 17:00:10.100903 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.100863    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 17:00:10.112881 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.112853    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0593108-e3b3-4780-9f27-52ac2affd909-metrics-certs\") pod \"network-metrics-daemon-w9xrc\" (UID: \"d0593108-e3b3-4780-9f27-52ac2affd909\") " pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 17:00:10.112984 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.112888    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/838ecadb-25ac-4b24-850d-2755447e4d46-original-pull-secret\") pod \"global-pull-secret-syncer-n8p6c\" (UID: \"838ecadb-25ac-4b24-850d-2755447e4d46\") " pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 17:00:10.190639 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.190572    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9555n\" (UniqueName: \"kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n\") pod \"network-check-target-4gg7t\" (UID: \"9d6f90aa-bf29-4788-b427-33cd74efbefe\") " pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 17:00:10.194524 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.194503    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 17:00:10.198558 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.198541    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n8p6c"
Jul 15 17:00:10.204507 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.204493    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 17:00:10.217347 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.213734    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tns8n\""
Jul 15 17:00:10.217347 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.216602    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9xrc"
Jul 15 17:00:10.219205 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.218099    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9555n\" (UniqueName: \"kubernetes.io/projected/9d6f90aa-bf29-4788-b427-33cd74efbefe-kube-api-access-9555n\") pod \"network-check-target-4gg7t\" (UID: \"9d6f90aa-bf29-4788-b427-33cd74efbefe\") " pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 17:00:10.492446 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.492414    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7t54\""
Jul 15 17:00:10.496351 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.496333    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 17:00:10.557737 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.557414    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cf7c9985c-r6vzk" podStartSLOduration=2.203562841 podStartE2EDuration="5.557392362s" totalImagesPullingTime="3.353829521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:00:09.74768535 +0000 UTC m=+65.905100164" watchObservedRunningTime="2026-07-15 17:00:10.557392362 +0000 UTC m=+66.714807177"
Jul 15 17:00:10.558812 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.558785    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n8p6c"]
Jul 15 17:00:10.597325 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.597181    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w9xrc"]
Jul 15 17:00:10.601438 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:00:10.601409    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0593108_e3b3_4780_9f27_52ac2affd909.slice/crio-4e06da5a80fb3ddc0fb35f0c26711d9ad1c742cccc44b6ea8ea63e553651f4a9 WatchSource:0}: Error finding container 4e06da5a80fb3ddc0fb35f0c26711d9ad1c742cccc44b6ea8ea63e553651f4a9: Status 404 returned error can't find the container with id 4e06da5a80fb3ddc0fb35f0c26711d9ad1c742cccc44b6ea8ea63e553651f4a9
Jul 15 17:00:10.654385 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.654356    2556 generic.go:356] "Generic (PLEG): container finished" podID="23b5588a-2f50-40dc-8e7f-fd0ece6aa207" containerID="7f5bf7d900b5144475050ba51793696c3620797aeb9d62c2d9624e43c1592357" exitCode=0
Jul 15 17:00:10.654825 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.654427    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23b5588a-2f50-40dc-8e7f-fd0ece6aa207","Type":"ContainerDied","Data":"7f5bf7d900b5144475050ba51793696c3620797aeb9d62c2d9624e43c1592357"}
Jul 15 17:00:10.655664 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.655638    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n8p6c" event={"ID":"838ecadb-25ac-4b24-850d-2755447e4d46","Type":"ContainerStarted","Data":"ffa531c886fd46376d3068bf829ecf390bbd46b9c876eeac793c5040024f3d8a"}
Jul 15 17:00:10.656852 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.656829    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w9xrc" event={"ID":"d0593108-e3b3-4780-9f27-52ac2affd909","Type":"ContainerStarted","Data":"4e06da5a80fb3ddc0fb35f0c26711d9ad1c742cccc44b6ea8ea63e553651f4a9"}
Jul 15 17:00:10.707223 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:10.707198    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4gg7t"]
Jul 15 17:00:10.710212 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:00:10.710189    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d6f90aa_bf29_4788_b427_33cd74efbefe.slice/crio-3a53d5b1bf9ac1a0a2da29d5b0d1dfcff5c2d31d3efa46fa3fe029f883f71b39 WatchSource:0}: Error finding container 3a53d5b1bf9ac1a0a2da29d5b0d1dfcff5c2d31d3efa46fa3fe029f883f71b39: Status 404 returned error can't find the container with id 3a53d5b1bf9ac1a0a2da29d5b0d1dfcff5c2d31d3efa46fa3fe029f883f71b39
Jul 15 17:00:11.662849 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:11.662811    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4gg7t" event={"ID":"9d6f90aa-bf29-4788-b427-33cd74efbefe","Type":"ContainerStarted","Data":"3a53d5b1bf9ac1a0a2da29d5b0d1dfcff5c2d31d3efa46fa3fe029f883f71b39"}
Jul 15 17:00:12.676819 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:12.673197    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w9xrc" event={"ID":"d0593108-e3b3-4780-9f27-52ac2affd909","Type":"ContainerStarted","Data":"4650a360ecc360843681749ff2d81faa27a2c9f2ea1af805e2c32297d70b881d"}
Jul 15 17:00:12.676819 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:12.673305    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w9xrc" event={"ID":"d0593108-e3b3-4780-9f27-52ac2affd909","Type":"ContainerStarted","Data":"aba83cbb49be6e399acabe0c8ae318629954c344f1b72139ed61a21e0027afed"}
Jul 15 17:00:12.704400 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:12.704354    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w9xrc" podStartSLOduration=67.510164963 podStartE2EDuration="1m8.704337547s" totalImagesPullingTime="1.194172584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:00:12.703083676 +0000 UTC m=+68.860498514" watchObservedRunningTime="2026-07-15 17:00:12.704337547 +0000 UTC m=+68.861752343"
Jul 15 17:00:14.583475 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:14.583441    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf7c9985c-r6vzk"]
Jul 15 17:00:15.749387 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:15.749350    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:17.697334 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:17.697286    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23b5588a-2f50-40dc-8e7f-fd0ece6aa207","Type":"ContainerStarted","Data":"7178d21404e155a4bb808a7e821092e4aca3721ab3e12e58c52e6d9bcc32a898"}
Jul 15 17:00:17.697790 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:17.697407    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23b5588a-2f50-40dc-8e7f-fd0ece6aa207","Type":"ContainerStarted","Data":"7facd5651d12ba728ac7c535349d394535a856f5a4f21d3715f9ffdf26d3fbbd"}
Jul 15 17:00:17.698959 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:17.698937    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n8p6c" event={"ID":"838ecadb-25ac-4b24-850d-2755447e4d46","Type":"ContainerStarted","Data":"a2bc53545a3ea9c0cb2506335df8a51f339c843de58c652444043f9f5790031c"}
Jul 15 17:00:17.700655 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:17.700626    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4gg7t" event={"ID":"9d6f90aa-bf29-4788-b427-33cd74efbefe","Type":"ContainerStarted","Data":"57ffd247366a4d4f46c5495cf2190b6dd0812df8003b33f4ba57e3dba63c6b90"}
Jul 15 17:00:17.700779 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:17.700700    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 17:00:17.765321 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:17.765274    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4gg7t" podStartSLOduration=67.671385646 podStartE2EDuration="1m13.765255429s" totalImagesPullingTime="6.093869783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:00:17.764383917 +0000 UTC m=+73.921798731" watchObservedRunningTime="2026-07-15 17:00:17.765255429 +0000 UTC m=+73.922670249"
Jul 15 17:00:17.765661 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:17.765623    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n8p6c" podStartSLOduration=67.525955613 podStartE2EDuration="1m13.765613191s" totalImagesPullingTime="6.239657578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:00:17.737268302 +0000 UTC m=+73.894683117" watchObservedRunningTime="2026-07-15 17:00:17.765613191 +0000 UTC m=+73.923028006"
Jul 15 17:00:19.711331 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:19.711296    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23b5588a-2f50-40dc-8e7f-fd0ece6aa207","Type":"ContainerStarted","Data":"73979ce5378d8639d68a5bac32e60cd4c01cafed4c928a0f867420ab2e7e4df7"}
Jul 15 17:00:19.711725 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:19.711360    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23b5588a-2f50-40dc-8e7f-fd0ece6aa207","Type":"ContainerStarted","Data":"fde5074b59398630609b75ef9b36657286fa11f7182367118208e711aa17e579"}
Jul 15 17:00:19.711725 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:19.711388    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23b5588a-2f50-40dc-8e7f-fd0ece6aa207","Type":"ContainerStarted","Data":"3b95a4a56547e39cdefe5e83860b14dd3e4fc93390376d933ecd0bd90f952b40"}
Jul 15 17:00:19.711725 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:19.711411    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23b5588a-2f50-40dc-8e7f-fd0ece6aa207","Type":"ContainerStarted","Data":"73bb64a497394f265e1a2bdeab03b3463f7004ddabe5a23f1f2d5651f2b8ed72"}
Jul 15 17:00:19.787239 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:19.787189    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.446162771 podStartE2EDuration="12.787170541s" totalImagesPullingTime="10.318428562s" totalInitContainerRuntime="22.579208ms" isStatefulPod=false podCreationTimestamp="2026-07-15 17:00:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:00:19.786962804 +0000 UTC m=+75.944377617" watchObservedRunningTime="2026-07-15 17:00:19.787170541 +0000 UTC m=+75.944585356"
Jul 15 17:00:22.373903 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:22.373871    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:00:25.913961 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:25.913929    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:25.914341 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:25.913985    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:39.607349 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:39.607289    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cf7c9985c-r6vzk" podUID="0fb6e570-94cd-4d52-ac03-d374d684164f" containerName="console" containerID="cri-o://a25f737a865e34d28596519f27f414a18e8053f592ee9388ea1e06f25cbb60fa" gracePeriod=15
Jul 15 17:00:39.785676 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:39.785647    2556 generic.go:356] "Generic (PLEG): container finished" podID="0fb6e570-94cd-4d52-ac03-d374d684164f" containerID="a25f737a865e34d28596519f27f414a18e8053f592ee9388ea1e06f25cbb60fa" exitCode=0
Jul 15 17:00:39.785840 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:39.785696    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7c9985c-r6vzk" event={"ID":"0fb6e570-94cd-4d52-ac03-d374d684164f","Type":"ContainerDied","Data":"a25f737a865e34d28596519f27f414a18e8053f592ee9388ea1e06f25cbb60fa"}
Jul 15 17:00:39.871987 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:39.871962    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:40.048924 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.048884    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-console-config\") pod \"0fb6e570-94cd-4d52-ac03-d374d684164f\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") "
Jul 15 17:00:40.049106 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.048971    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-oauth-config\") pod \"0fb6e570-94cd-4d52-ac03-d374d684164f\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") "
Jul 15 17:00:40.049106 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.049067    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-serving-cert\") pod \"0fb6e570-94cd-4d52-ac03-d374d684164f\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") "
Jul 15 17:00:40.049106 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.049101    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-oauth-serving-cert\") pod \"0fb6e570-94cd-4d52-ac03-d374d684164f\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") "
Jul 15 17:00:40.049264 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.049122    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-service-ca\") pod \"0fb6e570-94cd-4d52-ac03-d374d684164f\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") "
Jul 15 17:00:40.049264 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.049140    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-trusted-ca-bundle\") pod \"0fb6e570-94cd-4d52-ac03-d374d684164f\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") "
Jul 15 17:00:40.049264 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.049220    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgq8l\" (UniqueName: \"kubernetes.io/projected/0fb6e570-94cd-4d52-ac03-d374d684164f-kube-api-access-dgq8l\") pod \"0fb6e570-94cd-4d52-ac03-d374d684164f\" (UID: \"0fb6e570-94cd-4d52-ac03-d374d684164f\") "
Jul 15 17:00:40.049456 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.049311    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-console-config" (OuterVolumeSpecName: "console-config") pod "0fb6e570-94cd-4d52-ac03-d374d684164f" (UID: "0fb6e570-94cd-4d52-ac03-d374d684164f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:00:40.049552 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.049479    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-service-ca" (OuterVolumeSpecName: "service-ca") pod "0fb6e570-94cd-4d52-ac03-d374d684164f" (UID: "0fb6e570-94cd-4d52-ac03-d374d684164f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:00:40.049552 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.049503    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0fb6e570-94cd-4d52-ac03-d374d684164f" (UID: "0fb6e570-94cd-4d52-ac03-d374d684164f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:00:40.049552 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.049518    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0fb6e570-94cd-4d52-ac03-d374d684164f" (UID: "0fb6e570-94cd-4d52-ac03-d374d684164f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:00:40.051425 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.051395    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0fb6e570-94cd-4d52-ac03-d374d684164f" (UID: "0fb6e570-94cd-4d52-ac03-d374d684164f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:00:40.051524 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.051430    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fb6e570-94cd-4d52-ac03-d374d684164f-kube-api-access-dgq8l" (OuterVolumeSpecName: "kube-api-access-dgq8l") pod "0fb6e570-94cd-4d52-ac03-d374d684164f" (UID: "0fb6e570-94cd-4d52-ac03-d374d684164f"). InnerVolumeSpecName "kube-api-access-dgq8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:00:40.051524 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.051465    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0fb6e570-94cd-4d52-ac03-d374d684164f" (UID: "0fb6e570-94cd-4d52-ac03-d374d684164f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:00:40.150128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.150029    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-console-config\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:00:40.150128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.150065    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-oauth-config\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:00:40.150128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.150076    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fb6e570-94cd-4d52-ac03-d374d684164f-console-serving-cert\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:00:40.150128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.150085    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-oauth-serving-cert\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:00:40.150128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.150094    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:00:40.150128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.150102    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fb6e570-94cd-4d52-ac03-d374d684164f-trusted-ca-bundle\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:00:40.150128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.150110    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgq8l\" (UniqueName: \"kubernetes.io/projected/0fb6e570-94cd-4d52-ac03-d374d684164f-kube-api-access-dgq8l\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:00:40.790253 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.790214    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7c9985c-r6vzk" event={"ID":"0fb6e570-94cd-4d52-ac03-d374d684164f","Type":"ContainerDied","Data":"34952252fa37a62df7f5836a1fe236ae359209df2913d00b44aded185bbbee4b"}
Jul 15 17:00:40.790253 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.790236    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7c9985c-r6vzk"
Jul 15 17:00:40.790700 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.790269    2556 scope.go:117] "RemoveContainer" containerID="a25f737a865e34d28596519f27f414a18e8053f592ee9388ea1e06f25cbb60fa"
Jul 15 17:00:40.809020 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.808990    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf7c9985c-r6vzk"]
Jul 15 17:00:40.818871 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:40.817538    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cf7c9985c-r6vzk"]
Jul 15 17:00:42.364392 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:42.364357    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fb6e570-94cd-4d52-ac03-d374d684164f" path="/var/lib/kubelet/pods/0fb6e570-94cd-4d52-ac03-d374d684164f/volumes"
Jul 15 17:00:45.919474 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:45.919443    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:45.923349 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:45.923327    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b65767697-f8qcz"
Jul 15 17:00:48.707358 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:00:48.707325    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4gg7t"
Jul 15 17:01:07.373799 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:07.373752    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:01:07.392367 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:07.392340    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:01:07.901733 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:07.901693    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 17:01:30.878207 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.878170    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6856f56d76-nq4s2"]
Jul 15 17:01:30.878827 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.878527    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fb6e570-94cd-4d52-ac03-d374d684164f" containerName="console"
Jul 15 17:01:30.878827 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.878544    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fb6e570-94cd-4d52-ac03-d374d684164f" containerName="console"
Jul 15 17:01:30.878827 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.878622    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fb6e570-94cd-4d52-ac03-d374d684164f" containerName="console"
Jul 15 17:01:30.880985 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.880966    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:30.883871 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.883847    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 17:01:30.883977 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.883960    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 17:01:30.884941 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.884903    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 17:01:30.885049 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.884971    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 17:01:30.885212 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.885196    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 17:01:30.885212 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.885206    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g6j9q\""
Jul 15 17:01:30.886127 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.886107    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 17:01:30.886236 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.886107    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 17:01:30.889133 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.889111    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 17:01:30.890690 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.890671    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6856f56d76-nq4s2"]
Jul 15 17:01:30.929123 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.929088    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-oauth-config\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:30.929123 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.929120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-console-config\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:30.929378 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.929150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-oauth-serving-cert\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:30.929378 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.929241    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-service-ca\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:30.929378 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.929285    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-trusted-ca-bundle\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:30.929378 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.929317    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-serving-cert\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:30.929378 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:30.929341    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cldw9\" (UniqueName: \"kubernetes.io/projected/c0b243c3-be26-48b2-add0-29bada87da5d-kube-api-access-cldw9\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.030785 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.030744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-service-ca\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.030972 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.030795    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-trusted-ca-bundle\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.030972 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.030817    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-serving-cert\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.030972 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.030842    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cldw9\" (UniqueName: \"kubernetes.io/projected/c0b243c3-be26-48b2-add0-29bada87da5d-kube-api-access-cldw9\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.030972 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.030880    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-oauth-config\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.030972 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.030895    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-console-config\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.030972 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.030920    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-oauth-serving-cert\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.031682 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.031642    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-service-ca\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.031824 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.031701    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-console-config\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.031824 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.031701    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-oauth-serving-cert\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.031824 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.031758    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-trusted-ca-bundle\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.033492 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.033464    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-oauth-config\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.033573 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.033542    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-serving-cert\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.039316 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.039297    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cldw9\" (UniqueName: \"kubernetes.io/projected/c0b243c3-be26-48b2-add0-29bada87da5d-kube-api-access-cldw9\") pod \"console-6856f56d76-nq4s2\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") " pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.190331 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.190241    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:31.318998 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.318965    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6856f56d76-nq4s2"]
Jul 15 17:01:31.321874 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:01:31.321841    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b243c3_be26_48b2_add0_29bada87da5d.slice/crio-0ae8a7abbe1cd24c8b40146429bc2255d3cf1ed1eaf8d9d4e865c210604a3388 WatchSource:0}: Error finding container 0ae8a7abbe1cd24c8b40146429bc2255d3cf1ed1eaf8d9d4e865c210604a3388: Status 404 returned error can't find the container with id 0ae8a7abbe1cd24c8b40146429bc2255d3cf1ed1eaf8d9d4e865c210604a3388
Jul 15 17:01:31.969605 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.969562    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6856f56d76-nq4s2" event={"ID":"c0b243c3-be26-48b2-add0-29bada87da5d","Type":"ContainerStarted","Data":"477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2"}
Jul 15 17:01:31.970181 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.969629    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6856f56d76-nq4s2" event={"ID":"c0b243c3-be26-48b2-add0-29bada87da5d","Type":"ContainerStarted","Data":"0ae8a7abbe1cd24c8b40146429bc2255d3cf1ed1eaf8d9d4e865c210604a3388"}
Jul 15 17:01:31.993636 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:31.993572    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6856f56d76-nq4s2" podStartSLOduration=1.993550838 podStartE2EDuration="1.993550838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:01:31.992244393 +0000 UTC m=+148.149659208" watchObservedRunningTime="2026-07-15 17:01:31.993550838 +0000 UTC m=+148.150965653"
Jul 15 17:01:41.190731 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:41.190681    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:41.191209 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:41.190787    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:41.195545 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:41.195520    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:01:42.011944 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:01:42.011912    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:03:28.382115 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.382029    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kphzv"]
Jul 15 17:03:28.385104 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.385087    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kphzv"
Jul 15 17:03:28.387622 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.387593    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 17:03:28.388524 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.388496    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wdcl7\""
Jul 15 17:03:28.388623 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.388525    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 17:03:28.395984 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.395957    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kphzv"]
Jul 15 17:03:28.488088 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.488043    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9607933d-e58c-4d2e-9cb3-e6b4364d9358-bound-sa-token\") pod \"cert-manager-55b4d954d5-kphzv\" (UID: \"9607933d-e58c-4d2e-9cb3-e6b4364d9358\") " pod="cert-manager/cert-manager-55b4d954d5-kphzv"
Jul 15 17:03:28.488088 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.488097    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grwbp\" (UniqueName: \"kubernetes.io/projected/9607933d-e58c-4d2e-9cb3-e6b4364d9358-kube-api-access-grwbp\") pod \"cert-manager-55b4d954d5-kphzv\" (UID: \"9607933d-e58c-4d2e-9cb3-e6b4364d9358\") " pod="cert-manager/cert-manager-55b4d954d5-kphzv"
Jul 15 17:03:28.588900 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.588851    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grwbp\" (UniqueName: \"kubernetes.io/projected/9607933d-e58c-4d2e-9cb3-e6b4364d9358-kube-api-access-grwbp\") pod \"cert-manager-55b4d954d5-kphzv\" (UID: \"9607933d-e58c-4d2e-9cb3-e6b4364d9358\") " pod="cert-manager/cert-manager-55b4d954d5-kphzv"
Jul 15 17:03:28.589095 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.588952    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9607933d-e58c-4d2e-9cb3-e6b4364d9358-bound-sa-token\") pod \"cert-manager-55b4d954d5-kphzv\" (UID: \"9607933d-e58c-4d2e-9cb3-e6b4364d9358\") " pod="cert-manager/cert-manager-55b4d954d5-kphzv"
Jul 15 17:03:28.597407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.597374    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9607933d-e58c-4d2e-9cb3-e6b4364d9358-bound-sa-token\") pod \"cert-manager-55b4d954d5-kphzv\" (UID: \"9607933d-e58c-4d2e-9cb3-e6b4364d9358\") " pod="cert-manager/cert-manager-55b4d954d5-kphzv"
Jul 15 17:03:28.597546 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.597437    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grwbp\" (UniqueName: \"kubernetes.io/projected/9607933d-e58c-4d2e-9cb3-e6b4364d9358-kube-api-access-grwbp\") pod \"cert-manager-55b4d954d5-kphzv\" (UID: \"9607933d-e58c-4d2e-9cb3-e6b4364d9358\") " pod="cert-manager/cert-manager-55b4d954d5-kphzv"
Jul 15 17:03:28.710525 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.710432    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kphzv"
Jul 15 17:03:28.839379 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:28.839346    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kphzv"]
Jul 15 17:03:28.842305 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:03:28.842276    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9607933d_e58c_4d2e_9cb3_e6b4364d9358.slice/crio-063fd98ba5259607e3fb58ea8c4a605bc4d6adfaa0439c9c64ccf216021673cf WatchSource:0}: Error finding container 063fd98ba5259607e3fb58ea8c4a605bc4d6adfaa0439c9c64ccf216021673cf: Status 404 returned error can't find the container with id 063fd98ba5259607e3fb58ea8c4a605bc4d6adfaa0439c9c64ccf216021673cf
Jul 15 17:03:29.394867 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:29.394823    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kphzv" event={"ID":"9607933d-e58c-4d2e-9cb3-e6b4364d9358","Type":"ContainerStarted","Data":"063fd98ba5259607e3fb58ea8c4a605bc4d6adfaa0439c9c64ccf216021673cf"}
Jul 15 17:03:32.408449 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:32.408418    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kphzv" event={"ID":"9607933d-e58c-4d2e-9cb3-e6b4364d9358","Type":"ContainerStarted","Data":"9b37d0d371e6760006000f5f01817e23943b9585e8dc5f4b321e94b32058b877"}
Jul 15 17:03:32.428224 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:32.428171    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kphzv" podStartSLOduration=1.066114839 podStartE2EDuration="4.428151072s" totalImagesPullingTime="3.362036233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:03:32.427297147 +0000 UTC m=+268.584711978" watchObservedRunningTime="2026-07-15 17:03:32.428151072 +0000 UTC m=+268.585565886"
Jul 15 17:03:36.353236 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.353202    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"]
Jul 15 17:03:36.356369 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.356348    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.360425 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.360394    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 17:03:36.360726 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.360686    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 17:03:36.361510 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.361490    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 17:03:36.361781 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.361758    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 17:03:36.361781 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.361778    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 17:03:36.361939 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.361777    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xzr2b\""
Jul 15 17:03:36.373851 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.373824    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"]
Jul 15 17:03:36.456340 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.456301    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8656292b-e3f3-4a82-96f6-414702dddf57-metrics-cert\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.456340 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.456345    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8656292b-e3f3-4a82-96f6-414702dddf57-manager-config\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.456556 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.456370    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzfp6\" (UniqueName: \"kubernetes.io/projected/8656292b-e3f3-4a82-96f6-414702dddf57-kube-api-access-lzfp6\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.456556 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.456458    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8656292b-e3f3-4a82-96f6-414702dddf57-cert\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.557332 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.557294    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8656292b-e3f3-4a82-96f6-414702dddf57-metrics-cert\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.557457 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.557340    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8656292b-e3f3-4a82-96f6-414702dddf57-manager-config\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.557457 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.557360    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzfp6\" (UniqueName: \"kubernetes.io/projected/8656292b-e3f3-4a82-96f6-414702dddf57-kube-api-access-lzfp6\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.557457 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.557396    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8656292b-e3f3-4a82-96f6-414702dddf57-cert\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.558003 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.557980    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8656292b-e3f3-4a82-96f6-414702dddf57-manager-config\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.559893 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.559869    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8656292b-e3f3-4a82-96f6-414702dddf57-metrics-cert\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.560040 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.560019    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8656292b-e3f3-4a82-96f6-414702dddf57-cert\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.566734 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.566689    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzfp6\" (UniqueName: \"kubernetes.io/projected/8656292b-e3f3-4a82-96f6-414702dddf57-kube-api-access-lzfp6\") pod \"lws-controller-manager-6744c79bb-vxpww\" (UID: \"8656292b-e3f3-4a82-96f6-414702dddf57\") " pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.666135 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.666040    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:36.794779 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:36.794756    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"]
Jul 15 17:03:36.797005 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:03:36.796977    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8656292b_e3f3_4a82_96f6_414702dddf57.slice/crio-5f8ec9d06148eb2d1a60bf357d73cbbdef73ab442ad99f227462265707ad8939 WatchSource:0}: Error finding container 5f8ec9d06148eb2d1a60bf357d73cbbdef73ab442ad99f227462265707ad8939: Status 404 returned error can't find the container with id 5f8ec9d06148eb2d1a60bf357d73cbbdef73ab442ad99f227462265707ad8939
Jul 15 17:03:37.427458 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:37.427421    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww" event={"ID":"8656292b-e3f3-4a82-96f6-414702dddf57","Type":"ContainerStarted","Data":"5f8ec9d06148eb2d1a60bf357d73cbbdef73ab442ad99f227462265707ad8939"}
Jul 15 17:03:45.022732 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.022684    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"]
Jul 15 17:03:45.027104 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.027085    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.030015 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.029988    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 17:03:45.030120 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.030079    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 17:03:45.030120 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.030079    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z4dlf\""
Jul 15 17:03:45.030463 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.030449    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 17:03:45.030635 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.030609    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 17:03:45.042441 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.042416    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"]
Jul 15 17:03:45.115466 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.115431    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9639d4d-d94c-450c-9aed-adabb937d9ee-tmp\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.115637 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.115482    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b9639d4d-d94c-450c-9aed-adabb937d9ee-manifests\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.115637 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.115542    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2pv6\" (UniqueName: \"kubernetes.io/projected/b9639d4d-d94c-450c-9aed-adabb937d9ee-kube-api-access-n2pv6\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.115637 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.115586    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9639d4d-d94c-450c-9aed-adabb937d9ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.115637 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.115606    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b9639d4d-d94c-450c-9aed-adabb937d9ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.215978 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.215936    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b9639d4d-d94c-450c-9aed-adabb937d9ee-manifests\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.216163 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.215989    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2pv6\" (UniqueName: \"kubernetes.io/projected/b9639d4d-d94c-450c-9aed-adabb937d9ee-kube-api-access-n2pv6\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.216163 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.216015    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9639d4d-d94c-450c-9aed-adabb937d9ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.216163 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.216032    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b9639d4d-d94c-450c-9aed-adabb937d9ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.216163 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.216064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9639d4d-d94c-450c-9aed-adabb937d9ee-tmp\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.216433 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.216405    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b9639d4d-d94c-450c-9aed-adabb937d9ee-manifests\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.218613 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.218585    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9639d4d-d94c-450c-9aed-adabb937d9ee-tmp\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.218979 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.218956    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9639d4d-d94c-450c-9aed-adabb937d9ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.219342 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.219322    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b9639d4d-d94c-450c-9aed-adabb937d9ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.224655 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.224631    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2pv6\" (UniqueName: \"kubernetes.io/projected/b9639d4d-d94c-450c-9aed-adabb937d9ee-kube-api-access-n2pv6\") pod \"opendatahub-operator-controller-manager-7fdf764586-wc7nf\" (UID: \"b9639d4d-d94c-450c-9aed-adabb937d9ee\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.337172 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.337070    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:45.472302 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:45.472268    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"]
Jul 15 17:03:45.475435 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:03:45.475405    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9639d4d_d94c_450c_9aed_adabb937d9ee.slice/crio-1a18e2ff2f6d2870edfa1473c7de2a7cb9db89a5b7355929db5ec21dc48261ce WatchSource:0}: Error finding container 1a18e2ff2f6d2870edfa1473c7de2a7cb9db89a5b7355929db5ec21dc48261ce: Status 404 returned error can't find the container with id 1a18e2ff2f6d2870edfa1473c7de2a7cb9db89a5b7355929db5ec21dc48261ce
Jul 15 17:03:46.464235 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:46.464196    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf" event={"ID":"b9639d4d-d94c-450c-9aed-adabb937d9ee","Type":"ContainerStarted","Data":"1a18e2ff2f6d2870edfa1473c7de2a7cb9db89a5b7355929db5ec21dc48261ce"}
Jul 15 17:03:48.473849 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:48.473809    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf" event={"ID":"b9639d4d-d94c-450c-9aed-adabb937d9ee","Type":"ContainerStarted","Data":"47fe09a0652859f7806a9bb4e15e65b3558c0466f1e9b3b854278aa2e66cc554"}
Jul 15 17:03:50.482902 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:50.482857    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww" event={"ID":"8656292b-e3f3-4a82-96f6-414702dddf57","Type":"ContainerStarted","Data":"35caa54d9ffebe07dfe065b9f533e069949a5654e72165d0d16ebba056b6254c"}
Jul 15 17:03:50.483348 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:50.482926    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:03:50.484609 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:50.484552    2556 generic.go:356] "Generic (PLEG): container finished" podID="b9639d4d-d94c-450c-9aed-adabb937d9ee" containerID="47fe09a0652859f7806a9bb4e15e65b3558c0466f1e9b3b854278aa2e66cc554" exitCode=0
Jul 15 17:03:50.484775 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:50.484629    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf" event={"ID":"b9639d4d-d94c-450c-9aed-adabb937d9ee","Type":"ContainerDied","Data":"47fe09a0652859f7806a9bb4e15e65b3558c0466f1e9b3b854278aa2e66cc554"}
Jul 15 17:03:50.528861 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:50.528808    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww" podStartSLOduration=1.180455536 podStartE2EDuration="14.528790571s" totalImagesPullingTime="13.348335035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:03:50.503780097 +0000 UTC m=+286.661194927" watchObservedRunningTime="2026-07-15 17:03:50.528790571 +0000 UTC m=+286.686205403"
Jul 15 17:03:51.493456 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:51.493410    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf" event={"ID":"b9639d4d-d94c-450c-9aed-adabb937d9ee","Type":"ContainerStarted","Data":"8ee9ca43ec08f4cc7edc1273243503cb69e6cbcdc717f08ad9185c0895335008"}
Jul 15 17:03:51.493953 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:51.493851    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:03:51.524067 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:03:51.524007    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf" podStartSLOduration=2.925615093 podStartE2EDuration="7.523989629s" totalImagesPullingTime="3.254367173s" totalInitContainerRuntime="1.344007363s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:03:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:03:51.521975131 +0000 UTC m=+287.679389973" watchObservedRunningTime="2026-07-15 17:03:51.523989629 +0000 UTC m=+287.681404445"
Jul 15 17:04:01.495989 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:01.495958    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6744c79bb-vxpww"
Jul 15 17:04:02.499580 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:02.499551    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fdf764586-wc7nf"
Jul 15 17:04:04.189802 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.189772    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:04:04.190577 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.190558    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:04:04.193267 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.193253    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 17:04:04.745296 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.745262    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-667d575688-7swgk"]
Jul 15 17:04:04.747737 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.747703    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk"
Jul 15 17:04:04.754357 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.754335    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 17:04:04.754461 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.754396    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 17:04:04.754532 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.754400    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 17:04:04.754584 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.754404    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ps98l\""
Jul 15 17:04:04.765728 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.765697    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 17:04:04.766836 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.766811    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-667d575688-7swgk"]
Jul 15 17:04:04.887189 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.887150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx4c8\" (UniqueName: \"kubernetes.io/projected/772f8699-bfcb-43b9-a90c-6ec4ebc38f8f-kube-api-access-xx4c8\") pod \"kube-auth-proxy-667d575688-7swgk\" (UID: \"772f8699-bfcb-43b9-a90c-6ec4ebc38f8f\") " pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk"
Jul 15 17:04:04.887362 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.887204    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/772f8699-bfcb-43b9-a90c-6ec4ebc38f8f-tls-certs\") pod \"kube-auth-proxy-667d575688-7swgk\" (UID: \"772f8699-bfcb-43b9-a90c-6ec4ebc38f8f\") " pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk"
Jul 15 17:04:04.887362 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.887295    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/772f8699-bfcb-43b9-a90c-6ec4ebc38f8f-tmp\") pod \"kube-auth-proxy-667d575688-7swgk\" (UID: \"772f8699-bfcb-43b9-a90c-6ec4ebc38f8f\") " pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk"
Jul 15 17:04:04.988132 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.988072    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/772f8699-bfcb-43b9-a90c-6ec4ebc38f8f-tls-certs\") pod \"kube-auth-proxy-667d575688-7swgk\" (UID: \"772f8699-bfcb-43b9-a90c-6ec4ebc38f8f\") " pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk"
Jul 15 17:04:04.988327 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.988156    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/772f8699-bfcb-43b9-a90c-6ec4ebc38f8f-tmp\") pod \"kube-auth-proxy-667d575688-7swgk\" (UID: \"772f8699-bfcb-43b9-a90c-6ec4ebc38f8f\") " pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk"
Jul 15 17:04:04.988327 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.988200    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx4c8\" (UniqueName: \"kubernetes.io/projected/772f8699-bfcb-43b9-a90c-6ec4ebc38f8f-kube-api-access-xx4c8\") pod \"kube-auth-proxy-667d575688-7swgk\" (UID: \"772f8699-bfcb-43b9-a90c-6ec4ebc38f8f\") " pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk"
Jul 15 17:04:04.990637 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.990596    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/772f8699-bfcb-43b9-a90c-6ec4ebc38f8f-tmp\") pod \"kube-auth-proxy-667d575688-7swgk\" (UID: \"772f8699-bfcb-43b9-a90c-6ec4ebc38f8f\") " pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk"
Jul 15 17:04:04.990813 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.990791    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/772f8699-bfcb-43b9-a90c-6ec4ebc38f8f-tls-certs\") pod \"kube-auth-proxy-667d575688-7swgk\" (UID: \"772f8699-bfcb-43b9-a90c-6ec4ebc38f8f\") " pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk"
Jul 15 17:04:04.998489 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:04.998420    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx4c8\" (UniqueName: \"kubernetes.io/projected/772f8699-bfcb-43b9-a90c-6ec4ebc38f8f-kube-api-access-xx4c8\") pod \"kube-auth-proxy-667d575688-7swgk\" (UID: \"772f8699-bfcb-43b9-a90c-6ec4ebc38f8f\") " pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk"
Jul 15 17:04:05.057439 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:05.057403    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk"
Jul 15 17:04:05.189792 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:05.189765    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-667d575688-7swgk"]
Jul 15 17:04:05.192024 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:04:05.191998    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772f8699_bfcb_43b9_a90c_6ec4ebc38f8f.slice/crio-2f55493c8ad2a09aba6e5e86f63957a1d1a253d58696bb70de846187adcc89d3 WatchSource:0}: Error finding container 2f55493c8ad2a09aba6e5e86f63957a1d1a253d58696bb70de846187adcc89d3: Status 404 returned error can't find the container with id 2f55493c8ad2a09aba6e5e86f63957a1d1a253d58696bb70de846187adcc89d3
Jul 15 17:04:05.545436 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:05.545401    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk" event={"ID":"772f8699-bfcb-43b9-a90c-6ec4ebc38f8f","Type":"ContainerStarted","Data":"2f55493c8ad2a09aba6e5e86f63957a1d1a253d58696bb70de846187adcc89d3"}
Jul 15 17:04:09.563189 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:09.563146    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk" event={"ID":"772f8699-bfcb-43b9-a90c-6ec4ebc38f8f","Type":"ContainerStarted","Data":"6add03d8b3743db2cf22929dce8b9134d65c83ba14c51b9c0df545832eebb5f4"}
Jul 15 17:04:09.605949 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:09.605899    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-667d575688-7swgk" podStartSLOduration=2.269130038 podStartE2EDuration="5.605884051s" totalImagesPullingTime="3.336754013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:04:09.60541282 +0000 UTC m=+305.762827634" watchObservedRunningTime="2026-07-15 17:04:09.605884051 +0000 UTC m=+305.763298865"
Jul 15 17:04:16.154274 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.154236    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-85d47"]
Jul 15 17:04:16.157417 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.157401    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47"
Jul 15 17:04:16.161672 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.161652    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 17:04:16.174247 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.174220    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-85d47"]
Jul 15 17:04:16.188007 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.187985    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cr96b\""
Jul 15 17:04:16.288751 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.288693    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9d82f3e-69c2-4ecc-8222-885c1b7fcc63-cert\") pod \"kserve-controller-manager-d6f4b65b8-85d47\" (UID: \"a9d82f3e-69c2-4ecc-8222-885c1b7fcc63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47"
Jul 15 17:04:16.288751 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.288753    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74l2g\" (UniqueName: \"kubernetes.io/projected/a9d82f3e-69c2-4ecc-8222-885c1b7fcc63-kube-api-access-74l2g\") pod \"kserve-controller-manager-d6f4b65b8-85d47\" (UID: \"a9d82f3e-69c2-4ecc-8222-885c1b7fcc63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47"
Jul 15 17:04:16.389703 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.389670    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74l2g\" (UniqueName: \"kubernetes.io/projected/a9d82f3e-69c2-4ecc-8222-885c1b7fcc63-kube-api-access-74l2g\") pod \"kserve-controller-manager-d6f4b65b8-85d47\" (UID: \"a9d82f3e-69c2-4ecc-8222-885c1b7fcc63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47"
Jul 15 17:04:16.389862 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.389787    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9d82f3e-69c2-4ecc-8222-885c1b7fcc63-cert\") pod \"kserve-controller-manager-d6f4b65b8-85d47\" (UID: \"a9d82f3e-69c2-4ecc-8222-885c1b7fcc63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47"
Jul 15 17:04:16.392210 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.392190    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9d82f3e-69c2-4ecc-8222-885c1b7fcc63-cert\") pod \"kserve-controller-manager-d6f4b65b8-85d47\" (UID: \"a9d82f3e-69c2-4ecc-8222-885c1b7fcc63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47"
Jul 15 17:04:16.399904 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.399872    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74l2g\" (UniqueName: \"kubernetes.io/projected/a9d82f3e-69c2-4ecc-8222-885c1b7fcc63-kube-api-access-74l2g\") pod \"kserve-controller-manager-d6f4b65b8-85d47\" (UID: \"a9d82f3e-69c2-4ecc-8222-885c1b7fcc63\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47"
Jul 15 17:04:16.466818 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.466730    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47"
Jul 15 17:04:16.612749 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.612725    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-85d47"]
Jul 15 17:04:16.614817 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:04:16.614790    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d82f3e_69c2_4ecc_8222_885c1b7fcc63.slice/crio-4fd341776de07ec615243da9d040f79e0ec63d8c0094404c1692991a1f47b973 WatchSource:0}: Error finding container 4fd341776de07ec615243da9d040f79e0ec63d8c0094404c1692991a1f47b973: Status 404 returned error can't find the container with id 4fd341776de07ec615243da9d040f79e0ec63d8c0094404c1692991a1f47b973
Jul 15 17:04:16.616537 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:16.616521    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 17:04:17.594549 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:17.594516    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47" event={"ID":"a9d82f3e-69c2-4ecc-8222-885c1b7fcc63","Type":"ContainerStarted","Data":"4fd341776de07ec615243da9d040f79e0ec63d8c0094404c1692991a1f47b973"}
Jul 15 17:04:19.604784 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:19.604745    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47" event={"ID":"a9d82f3e-69c2-4ecc-8222-885c1b7fcc63","Type":"ContainerStarted","Data":"c6c3c006ec04334db2a37cbb9af1a1095f2cda73f0864daa25e364d954ee6b56"}
Jul 15 17:04:19.605133 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:19.604830    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47"
Jul 15 17:04:19.624763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:19.624695    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47" podStartSLOduration=1.237535934 podStartE2EDuration="3.624679903s" totalImagesPullingTime="2.387143969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:04:19.623072597 +0000 UTC m=+315.780487411" watchObservedRunningTime="2026-07-15 17:04:19.624679903 +0000 UTC m=+315.782094734"
Jul 15 17:04:50.615120 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:04:50.615082    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-85d47"
Jul 15 17:05:15.598927 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.598883    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-746bb5bb5b-kwztl"]
Jul 15 17:05:15.602297 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.602278    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.618217 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.618188    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746bb5bb5b-kwztl"]
Jul 15 17:05:15.695662 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.695619    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-service-ca\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.695858 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.695671    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-oauth-serving-cert\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.695858 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.695759    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/192befe7-3999-491e-a903-2bb7c5e6b3e3-console-oauth-config\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.695858 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.695784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-console-config\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.695858 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.695805    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmtvw\" (UniqueName: \"kubernetes.io/projected/192befe7-3999-491e-a903-2bb7c5e6b3e3-kube-api-access-wmtvw\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.695858 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.695828    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-trusted-ca-bundle\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.696018 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.695883    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/192befe7-3999-491e-a903-2bb7c5e6b3e3-console-serving-cert\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.796823 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.796783    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-trusted-ca-bundle\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.796928 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.796840    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/192befe7-3999-491e-a903-2bb7c5e6b3e3-console-serving-cert\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.796928 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.796874    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-service-ca\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.796928 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.796912    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-oauth-serving-cert\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.797033 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.796947    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/192befe7-3999-491e-a903-2bb7c5e6b3e3-console-oauth-config\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.797106 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.797076    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-console-config\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.797159 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.797132    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmtvw\" (UniqueName: \"kubernetes.io/projected/192befe7-3999-491e-a903-2bb7c5e6b3e3-kube-api-access-wmtvw\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.797694 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.797669    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-service-ca\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.797694 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.797687    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-oauth-serving-cert\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.797868 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.797830    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-trusted-ca-bundle\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.797931 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.797907    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/192befe7-3999-491e-a903-2bb7c5e6b3e3-console-config\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.799604 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.799577    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/192befe7-3999-491e-a903-2bb7c5e6b3e3-console-oauth-config\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.799692 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.799579    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/192befe7-3999-491e-a903-2bb7c5e6b3e3-console-serving-cert\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.808284 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.808256    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmtvw\" (UniqueName: \"kubernetes.io/projected/192befe7-3999-491e-a903-2bb7c5e6b3e3-kube-api-access-wmtvw\") pod \"console-746bb5bb5b-kwztl\" (UID: \"192befe7-3999-491e-a903-2bb7c5e6b3e3\") " pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:15.911705 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:15.911617    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:16.047074 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:16.047045    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746bb5bb5b-kwztl"]
Jul 15 17:05:16.049445 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:05:16.049420    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192befe7_3999_491e_a903_2bb7c5e6b3e3.slice/crio-2de9f94220f78bf11d38c37b40351ceffc7df907483bfe6e04acf9a18a1cd4c2 WatchSource:0}: Error finding container 2de9f94220f78bf11d38c37b40351ceffc7df907483bfe6e04acf9a18a1cd4c2: Status 404 returned error can't find the container with id 2de9f94220f78bf11d38c37b40351ceffc7df907483bfe6e04acf9a18a1cd4c2
Jul 15 17:05:16.848546 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:16.848506    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746bb5bb5b-kwztl" event={"ID":"192befe7-3999-491e-a903-2bb7c5e6b3e3","Type":"ContainerStarted","Data":"c3762fd32159b7856fe54fbafaa8e85c5c139d430a6e0a122f8732cdab1d8839"}
Jul 15 17:05:16.849027 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:16.848564    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746bb5bb5b-kwztl" event={"ID":"192befe7-3999-491e-a903-2bb7c5e6b3e3","Type":"ContainerStarted","Data":"2de9f94220f78bf11d38c37b40351ceffc7df907483bfe6e04acf9a18a1cd4c2"}
Jul 15 17:05:16.869025 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:16.868973    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-746bb5bb5b-kwztl" podStartSLOduration=1.8689556870000001 podStartE2EDuration="1.868955687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:05:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:05:16.86798311 +0000 UTC m=+373.025397937" watchObservedRunningTime="2026-07-15 17:05:16.868955687 +0000 UTC m=+373.026370501"
Jul 15 17:05:25.911942 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:25.911905    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:25.912444 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:25.911968    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:25.916548 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:25.916526    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:26.891698 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:26.891671    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-746bb5bb5b-kwztl"
Jul 15 17:05:26.938023 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:26.937974    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6856f56d76-nq4s2"]
Jul 15 17:05:51.208383 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.208351    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228"]
Jul 15 17:05:51.211855 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.211835    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228"
Jul 15 17:05:51.215672 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.215652    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 17:05:51.216211 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.216191    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-phxdh\""
Jul 15 17:05:51.216296 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.216201    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 17:05:51.216296 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.216239    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 17:05:51.227835 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.227808    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228"]
Jul 15 17:05:51.304106 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.304063    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s226j\" (UniqueName: \"kubernetes.io/projected/4e7a3d57-4b36-44a9-94fb-6a55a39faf6e-kube-api-access-s226j\") pod \"dns-operator-controller-manager-864dd78c4c-rj228\" (UID: \"4e7a3d57-4b36-44a9-94fb-6a55a39faf6e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228"
Jul 15 17:05:51.405232 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.405189    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s226j\" (UniqueName: \"kubernetes.io/projected/4e7a3d57-4b36-44a9-94fb-6a55a39faf6e-kube-api-access-s226j\") pod \"dns-operator-controller-manager-864dd78c4c-rj228\" (UID: \"4e7a3d57-4b36-44a9-94fb-6a55a39faf6e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228"
Jul 15 17:05:51.416612 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.416582    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s226j\" (UniqueName: \"kubernetes.io/projected/4e7a3d57-4b36-44a9-94fb-6a55a39faf6e-kube-api-access-s226j\") pod \"dns-operator-controller-manager-864dd78c4c-rj228\" (UID: \"4e7a3d57-4b36-44a9-94fb-6a55a39faf6e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228"
Jul 15 17:05:51.522269 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.522234    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228"
Jul 15 17:05:51.666725 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.666688    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228"]
Jul 15 17:05:51.667988 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:05:51.667963    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e7a3d57_4b36_44a9_94fb_6a55a39faf6e.slice/crio-d92e7e380465daf7e8e9601dd7c38eb19387ef16a51eaf51d57fdf04f3a6e07c WatchSource:0}: Error finding container d92e7e380465daf7e8e9601dd7c38eb19387ef16a51eaf51d57fdf04f3a6e07c: Status 404 returned error can't find the container with id d92e7e380465daf7e8e9601dd7c38eb19387ef16a51eaf51d57fdf04f3a6e07c
Jul 15 17:05:51.966890 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.966773    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6856f56d76-nq4s2" podUID="c0b243c3-be26-48b2-add0-29bada87da5d" containerName="console" containerID="cri-o://477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2" gracePeriod=15
Jul 15 17:05:51.997268 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:51.997231    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228" event={"ID":"4e7a3d57-4b36-44a9-94fb-6a55a39faf6e","Type":"ContainerStarted","Data":"d92e7e380465daf7e8e9601dd7c38eb19387ef16a51eaf51d57fdf04f3a6e07c"}
Jul 15 17:05:52.008765 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.008707    2556 patch_prober.go:28] interesting pod/console-6856f56d76-nq4s2 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused" start-of-body=
Jul 15 17:05:52.008903 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.008803    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6856f56d76-nq4s2" podUID="c0b243c3-be26-48b2-add0-29bada87da5d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused"
Jul 15 17:05:52.199128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.199102    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:05:52.313412 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.313384    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-service-ca\") pod \"c0b243c3-be26-48b2-add0-29bada87da5d\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") "
Jul 15 17:05:52.313412 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.313418    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-console-config\") pod \"c0b243c3-be26-48b2-add0-29bada87da5d\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") "
Jul 15 17:05:52.313881 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.313449    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-oauth-serving-cert\") pod \"c0b243c3-be26-48b2-add0-29bada87da5d\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") "
Jul 15 17:05:52.313881 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.313555    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-trusted-ca-bundle\") pod \"c0b243c3-be26-48b2-add0-29bada87da5d\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") "
Jul 15 17:05:52.313881 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.313585    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-serving-cert\") pod \"c0b243c3-be26-48b2-add0-29bada87da5d\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") "
Jul 15 17:05:52.313881 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.313630    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cldw9\" (UniqueName: \"kubernetes.io/projected/c0b243c3-be26-48b2-add0-29bada87da5d-kube-api-access-cldw9\") pod \"c0b243c3-be26-48b2-add0-29bada87da5d\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") "
Jul 15 17:05:52.313881 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.313656    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-oauth-config\") pod \"c0b243c3-be26-48b2-add0-29bada87da5d\" (UID: \"c0b243c3-be26-48b2-add0-29bada87da5d\") "
Jul 15 17:05:52.313881 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.313864    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-console-config" (OuterVolumeSpecName: "console-config") pod "c0b243c3-be26-48b2-add0-29bada87da5d" (UID: "c0b243c3-be26-48b2-add0-29bada87da5d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:05:52.314149 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.313876    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-service-ca" (OuterVolumeSpecName: "service-ca") pod "c0b243c3-be26-48b2-add0-29bada87da5d" (UID: "c0b243c3-be26-48b2-add0-29bada87da5d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:05:52.314149 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.313925    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c0b243c3-be26-48b2-add0-29bada87da5d" (UID: "c0b243c3-be26-48b2-add0-29bada87da5d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:05:52.314222 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.314191    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c0b243c3-be26-48b2-add0-29bada87da5d" (UID: "c0b243c3-be26-48b2-add0-29bada87da5d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:05:52.315639 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.315617    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c0b243c3-be26-48b2-add0-29bada87da5d" (UID: "c0b243c3-be26-48b2-add0-29bada87da5d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:05:52.315756 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.315738    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b243c3-be26-48b2-add0-29bada87da5d-kube-api-access-cldw9" (OuterVolumeSpecName: "kube-api-access-cldw9") pod "c0b243c3-be26-48b2-add0-29bada87da5d" (UID: "c0b243c3-be26-48b2-add0-29bada87da5d"). InnerVolumeSpecName "kube-api-access-cldw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:05:52.315807 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.315759    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c0b243c3-be26-48b2-add0-29bada87da5d" (UID: "c0b243c3-be26-48b2-add0-29bada87da5d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:05:52.414468 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.414433    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-oauth-serving-cert\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:05:52.414468 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.414467    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-trusted-ca-bundle\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:05:52.414673 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.414479    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-serving-cert\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:05:52.414673 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.414491    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cldw9\" (UniqueName: \"kubernetes.io/projected/c0b243c3-be26-48b2-add0-29bada87da5d-kube-api-access-cldw9\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:05:52.414673 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.414504    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0b243c3-be26-48b2-add0-29bada87da5d-console-oauth-config\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:05:52.414673 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.414517    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:05:52.414673 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:52.414527    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0b243c3-be26-48b2-add0-29bada87da5d-console-config\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:05:53.005108 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:53.005072    2556 generic.go:356] "Generic (PLEG): container finished" podID="c0b243c3-be26-48b2-add0-29bada87da5d" containerID="477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2" exitCode=0
Jul 15 17:05:53.005294 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:53.005124    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6856f56d76-nq4s2"
Jul 15 17:05:53.005294 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:53.005149    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6856f56d76-nq4s2" event={"ID":"c0b243c3-be26-48b2-add0-29bada87da5d","Type":"ContainerDied","Data":"477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2"}
Jul 15 17:05:53.005294 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:53.005214    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6856f56d76-nq4s2" event={"ID":"c0b243c3-be26-48b2-add0-29bada87da5d","Type":"ContainerDied","Data":"0ae8a7abbe1cd24c8b40146429bc2255d3cf1ed1eaf8d9d4e865c210604a3388"}
Jul 15 17:05:53.005294 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:53.005244    2556 scope.go:117] "RemoveContainer" containerID="477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2"
Jul 15 17:05:53.028005 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:53.027970    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6856f56d76-nq4s2"]
Jul 15 17:05:53.036932 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:53.036900    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6856f56d76-nq4s2"]
Jul 15 17:05:53.112967 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:53.112942    2556 scope.go:117] "RemoveContainer" containerID="477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2"
Jul 15 17:05:53.113387 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:05:53.113359    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2\": container with ID starting with 477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2 not found: ID does not exist" containerID="477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2"
Jul 15 17:05:53.113466 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:53.113397    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2"} err="failed to get container status \"477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2\": rpc error: code = NotFound desc = could not find container \"477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2\": container with ID starting with 477e1be756b971e31f1e23bfdf4236d03ddb24390f1117e6f2033f7a83a110c2 not found: ID does not exist"
Jul 15 17:05:54.365570 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:54.365530    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0b243c3-be26-48b2-add0-29bada87da5d" path="/var/lib/kubelet/pods/c0b243c3-be26-48b2-add0-29bada87da5d/volumes"
Jul 15 17:05:55.017020 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:55.016985    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228" event={"ID":"4e7a3d57-4b36-44a9-94fb-6a55a39faf6e","Type":"ContainerStarted","Data":"6809e37f1fa10e9faad6aad1547ff06c5859648e1116cec817a2223a7f76f458"}
Jul 15 17:05:55.017197 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:55.017114    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228"
Jul 15 17:05:55.072829 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:05:55.072775    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228" podStartSLOduration=1.535284775 podStartE2EDuration="4.07275617s" totalImagesPullingTime="2.537471395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:05:55.070660656 +0000 UTC m=+411.228075469" watchObservedRunningTime="2026-07-15 17:05:55.07275617 +0000 UTC m=+411.230170983"
Jul 15 17:06:06.024131 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:06.024098    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rj228"
Jul 15 17:06:49.877407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:49.877363    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"]
Jul 15 17:06:49.877857 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:49.877693    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b243c3-be26-48b2-add0-29bada87da5d" containerName="console"
Jul 15 17:06:49.877857 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:49.877704    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b243c3-be26-48b2-add0-29bada87da5d" containerName="console"
Jul 15 17:06:49.877857 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:49.877788    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b243c3-be26-48b2-add0-29bada87da5d" containerName="console"
Jul 15 17:06:49.880786 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:49.880769    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:06:49.883361 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:49.883341    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7clnc\""
Jul 15 17:06:49.883470 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:49.883371    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 17:06:49.891249 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:49.891223    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"]
Jul 15 17:06:49.970103 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:49.970068    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"]
Jul 15 17:06:50.022847 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.022810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de499047-c2c7-4041-a61c-876837867c52-config-file\") pod \"limitador-limitador-64c94fd64f-hp7xq\" (UID: \"de499047-c2c7-4041-a61c-876837867c52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:06:50.023025 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.022898    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9mnx\" (UniqueName: \"kubernetes.io/projected/de499047-c2c7-4041-a61c-876837867c52-kube-api-access-z9mnx\") pod \"limitador-limitador-64c94fd64f-hp7xq\" (UID: \"de499047-c2c7-4041-a61c-876837867c52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:06:50.124134 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.124090    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9mnx\" (UniqueName: \"kubernetes.io/projected/de499047-c2c7-4041-a61c-876837867c52-kube-api-access-z9mnx\") pod \"limitador-limitador-64c94fd64f-hp7xq\" (UID: \"de499047-c2c7-4041-a61c-876837867c52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:06:50.124314 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.124152    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de499047-c2c7-4041-a61c-876837867c52-config-file\") pod \"limitador-limitador-64c94fd64f-hp7xq\" (UID: \"de499047-c2c7-4041-a61c-876837867c52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:06:50.124841 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.124824    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de499047-c2c7-4041-a61c-876837867c52-config-file\") pod \"limitador-limitador-64c94fd64f-hp7xq\" (UID: \"de499047-c2c7-4041-a61c-876837867c52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:06:50.133142 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.133088    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9mnx\" (UniqueName: \"kubernetes.io/projected/de499047-c2c7-4041-a61c-876837867c52-kube-api-access-z9mnx\") pod \"limitador-limitador-64c94fd64f-hp7xq\" (UID: \"de499047-c2c7-4041-a61c-876837867c52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:06:50.190874 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.190838    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:06:50.323565 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.321530    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"]
Jul 15 17:06:50.329349 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:06:50.329314    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde499047_c2c7_4041_a61c_876837867c52.slice/crio-fd97ddef5538e7779569f1028924de6c6a6b55ef08426d9761da7967706b285d WatchSource:0}: Error finding container fd97ddef5538e7779569f1028924de6c6a6b55ef08426d9761da7967706b285d: Status 404 returned error can't find the container with id fd97ddef5538e7779569f1028924de6c6a6b55ef08426d9761da7967706b285d
Jul 15 17:06:50.950615 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.950584    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7sgj"]
Jul 15 17:06:50.953615 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.953596    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7sgj"
Jul 15 17:06:50.956378 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.956359    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pwpzs\""
Jul 15 17:06:50.963384 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:50.963363    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7sgj"]
Jul 15 17:06:51.131277 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:51.131170    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wm8w\" (UniqueName: \"kubernetes.io/projected/4d00131c-a8a6-4085-8c79-d4a8f561ee43-kube-api-access-5wm8w\") pod \"authorino-75d556bd77-b7sgj\" (UID: \"4d00131c-a8a6-4085-8c79-d4a8f561ee43\") " pod="kuadrant-system/authorino-75d556bd77-b7sgj"
Jul 15 17:06:51.232270 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:51.232228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wm8w\" (UniqueName: \"kubernetes.io/projected/4d00131c-a8a6-4085-8c79-d4a8f561ee43-kube-api-access-5wm8w\") pod \"authorino-75d556bd77-b7sgj\" (UID: \"4d00131c-a8a6-4085-8c79-d4a8f561ee43\") " pod="kuadrant-system/authorino-75d556bd77-b7sgj"
Jul 15 17:06:51.241844 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:51.241815    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wm8w\" (UniqueName: \"kubernetes.io/projected/4d00131c-a8a6-4085-8c79-d4a8f561ee43-kube-api-access-5wm8w\") pod \"authorino-75d556bd77-b7sgj\" (UID: \"4d00131c-a8a6-4085-8c79-d4a8f561ee43\") " pod="kuadrant-system/authorino-75d556bd77-b7sgj"
Jul 15 17:06:51.253477 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:51.253441    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq" event={"ID":"de499047-c2c7-4041-a61c-876837867c52","Type":"ContainerStarted","Data":"fd97ddef5538e7779569f1028924de6c6a6b55ef08426d9761da7967706b285d"}
Jul 15 17:06:51.262828 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:51.262796    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7sgj"
Jul 15 17:06:51.431319 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:51.431248    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7sgj"]
Jul 15 17:06:51.434555 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:06:51.434522    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d00131c_a8a6_4085_8c79_d4a8f561ee43.slice/crio-c9c0c6645f7bd8c04163dee96d4b347c6bf5e04f2e9c0bb94ea9f65d0ec29df3 WatchSource:0}: Error finding container c9c0c6645f7bd8c04163dee96d4b347c6bf5e04f2e9c0bb94ea9f65d0ec29df3: Status 404 returned error can't find the container with id c9c0c6645f7bd8c04163dee96d4b347c6bf5e04f2e9c0bb94ea9f65d0ec29df3
Jul 15 17:06:52.258983 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:52.258953    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7sgj" event={"ID":"4d00131c-a8a6-4085-8c79-d4a8f561ee43","Type":"ContainerStarted","Data":"c9c0c6645f7bd8c04163dee96d4b347c6bf5e04f2e9c0bb94ea9f65d0ec29df3"}
Jul 15 17:06:53.265465 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:53.265426    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq" event={"ID":"de499047-c2c7-4041-a61c-876837867c52","Type":"ContainerStarted","Data":"c1e991332eca12c5d014260427902140f82ecf5ceff56e0a7a67dc941f42dd33"}
Jul 15 17:06:53.265932 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:53.265740    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:06:53.289632 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:53.289524    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq" podStartSLOduration=1.450863566 podStartE2EDuration="4.289505768s" totalImagesPullingTime="2.838642202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:06:53.287970811 +0000 UTC m=+469.445385628" watchObservedRunningTime="2026-07-15 17:06:53.289505768 +0000 UTC m=+469.446920582"
Jul 15 17:06:56.280649 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:56.280615    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7sgj" event={"ID":"4d00131c-a8a6-4085-8c79-d4a8f561ee43","Type":"ContainerStarted","Data":"0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899"}
Jul 15 17:06:56.297500 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:06:56.297448    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-b7sgj" podStartSLOduration=1.7847063680000002 podStartE2EDuration="6.297432521s" totalImagesPullingTime="4.512726153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:06:56.296703682 +0000 UTC m=+472.454118494" watchObservedRunningTime="2026-07-15 17:06:56.297432521 +0000 UTC m=+472.454847335"
Jul 15 17:07:04.272475 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:04.272438    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:07:05.876666 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:05.876626    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"]
Jul 15 17:07:05.877107 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:05.876817    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq" podUID="de499047-c2c7-4041-a61c-876837867c52" containerName="limitador" containerID="cri-o://c1e991332eca12c5d014260427902140f82ecf5ceff56e0a7a67dc941f42dd33" gracePeriod=30
Jul 15 17:07:06.323593 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:06.323560    2556 generic.go:356] "Generic (PLEG): container finished" podID="de499047-c2c7-4041-a61c-876837867c52" containerID="c1e991332eca12c5d014260427902140f82ecf5ceff56e0a7a67dc941f42dd33" exitCode=0
Jul 15 17:07:06.323778 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:06.323643    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq" event={"ID":"de499047-c2c7-4041-a61c-876837867c52","Type":"ContainerDied","Data":"c1e991332eca12c5d014260427902140f82ecf5ceff56e0a7a67dc941f42dd33"}
Jul 15 17:07:06.422485 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:06.422460    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:07:06.461742 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:06.461652    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de499047-c2c7-4041-a61c-876837867c52-config-file\") pod \"de499047-c2c7-4041-a61c-876837867c52\" (UID: \"de499047-c2c7-4041-a61c-876837867c52\") "
Jul 15 17:07:06.461742 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:06.461736    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9mnx\" (UniqueName: \"kubernetes.io/projected/de499047-c2c7-4041-a61c-876837867c52-kube-api-access-z9mnx\") pod \"de499047-c2c7-4041-a61c-876837867c52\" (UID: \"de499047-c2c7-4041-a61c-876837867c52\") "
Jul 15 17:07:06.462057 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:06.462036    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de499047-c2c7-4041-a61c-876837867c52-config-file" (OuterVolumeSpecName: "config-file") pod "de499047-c2c7-4041-a61c-876837867c52" (UID: "de499047-c2c7-4041-a61c-876837867c52"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:07:06.463985 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:06.463962    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de499047-c2c7-4041-a61c-876837867c52-kube-api-access-z9mnx" (OuterVolumeSpecName: "kube-api-access-z9mnx") pod "de499047-c2c7-4041-a61c-876837867c52" (UID: "de499047-c2c7-4041-a61c-876837867c52"). InnerVolumeSpecName "kube-api-access-z9mnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:07:06.563180 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:06.563138    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9mnx\" (UniqueName: \"kubernetes.io/projected/de499047-c2c7-4041-a61c-876837867c52-kube-api-access-z9mnx\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:07:06.563180 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:06.563173    2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de499047-c2c7-4041-a61c-876837867c52-config-file\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:07:07.328406 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:07.328378    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"
Jul 15 17:07:07.328828 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:07.328395    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hp7xq" event={"ID":"de499047-c2c7-4041-a61c-876837867c52","Type":"ContainerDied","Data":"fd97ddef5538e7779569f1028924de6c6a6b55ef08426d9761da7967706b285d"}
Jul 15 17:07:07.328828 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:07.328506    2556 scope.go:117] "RemoveContainer" containerID="c1e991332eca12c5d014260427902140f82ecf5ceff56e0a7a67dc941f42dd33"
Jul 15 17:07:07.349362 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:07.349330    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"]
Jul 15 17:07:07.351361 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:07.351336    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hp7xq"]
Jul 15 17:07:08.364787 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:08.364755    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de499047-c2c7-4041-a61c-876837867c52" path="/var/lib/kubelet/pods/de499047-c2c7-4041-a61c-876837867c52/volumes"
Jul 15 17:07:10.547684 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.547647    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"]
Jul 15 17:07:10.548060 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.547978    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de499047-c2c7-4041-a61c-876837867c52" containerName="limitador"
Jul 15 17:07:10.548060 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.547990    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="de499047-c2c7-4041-a61c-876837867c52" containerName="limitador"
Jul 15 17:07:10.548060 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.548047    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="de499047-c2c7-4041-a61c-876837867c52" containerName="limitador"
Jul 15 17:07:10.552225 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.552206    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"
Jul 15 17:07:10.555479 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.555453    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 17:07:10.555994 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.555977    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-snwbh\""
Jul 15 17:07:10.556098 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.556008    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 17:07:10.556505 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.556490    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 17:07:10.564128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.564085    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"]
Jul 15 17:07:10.599885 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.599847    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/88ed18a9-d506-472a-95aa-b17721f01854-data\") pod \"postgres-69fb4594cf-pgpnw\" (UID: \"88ed18a9-d506-472a-95aa-b17721f01854\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"
Jul 15 17:07:10.599885 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.599887    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwrsn\" (UniqueName: \"kubernetes.io/projected/88ed18a9-d506-472a-95aa-b17721f01854-kube-api-access-qwrsn\") pod \"postgres-69fb4594cf-pgpnw\" (UID: \"88ed18a9-d506-472a-95aa-b17721f01854\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"
Jul 15 17:07:10.701082 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.701048    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/88ed18a9-d506-472a-95aa-b17721f01854-data\") pod \"postgres-69fb4594cf-pgpnw\" (UID: \"88ed18a9-d506-472a-95aa-b17721f01854\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"
Jul 15 17:07:10.701082 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.701087    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwrsn\" (UniqueName: \"kubernetes.io/projected/88ed18a9-d506-472a-95aa-b17721f01854-kube-api-access-qwrsn\") pod \"postgres-69fb4594cf-pgpnw\" (UID: \"88ed18a9-d506-472a-95aa-b17721f01854\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"
Jul 15 17:07:10.701473 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.701452    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/88ed18a9-d506-472a-95aa-b17721f01854-data\") pod \"postgres-69fb4594cf-pgpnw\" (UID: \"88ed18a9-d506-472a-95aa-b17721f01854\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"
Jul 15 17:07:10.712254 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.712226    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwrsn\" (UniqueName: \"kubernetes.io/projected/88ed18a9-d506-472a-95aa-b17721f01854-kube-api-access-qwrsn\") pod \"postgres-69fb4594cf-pgpnw\" (UID: \"88ed18a9-d506-472a-95aa-b17721f01854\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"
Jul 15 17:07:10.862497 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.862404    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"
Jul 15 17:07:10.995097 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:10.995071    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"]
Jul 15 17:07:10.997363 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:07:10.997337    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ed18a9_d506_472a_95aa_b17721f01854.slice/crio-7514ee7bedf9ee980d12f51487161f9ce3abadcfa1d61cf8d36208eaba325e3e WatchSource:0}: Error finding container 7514ee7bedf9ee980d12f51487161f9ce3abadcfa1d61cf8d36208eaba325e3e: Status 404 returned error can't find the container with id 7514ee7bedf9ee980d12f51487161f9ce3abadcfa1d61cf8d36208eaba325e3e
Jul 15 17:07:11.347555 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:11.347518    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw" event={"ID":"88ed18a9-d506-472a-95aa-b17721f01854","Type":"ContainerStarted","Data":"7514ee7bedf9ee980d12f51487161f9ce3abadcfa1d61cf8d36208eaba325e3e"}
Jul 15 17:07:16.373065 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:16.373021    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw" event={"ID":"88ed18a9-d506-472a-95aa-b17721f01854","Type":"ContainerStarted","Data":"75099a26c5695dfd0354fd85ea0d063d97ecac372d2039238ce8b339308d7354"}
Jul 15 17:07:16.373472 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:16.373149    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"
Jul 15 17:07:16.391525 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:16.391459    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw" podStartSLOduration=1.700120858 podStartE2EDuration="6.391442131s" totalImagesPullingTime="4.691321273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:07:16.38997236 +0000 UTC m=+492.547387175" watchObservedRunningTime="2026-07-15 17:07:16.391442131 +0000 UTC m=+492.548856993"
Jul 15 17:07:22.408122 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:22.408083    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-pgpnw"
Jul 15 17:07:23.488525 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.488487    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d88cd66d6-b9ccb"]
Jul 15 17:07:23.494841 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.494821    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d88cd66d6-b9ccb"
Jul 15 17:07:23.497620 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.497596    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 17:07:23.509757 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.509730    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d88cd66d6-b9ccb"]
Jul 15 17:07:23.627697 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.627654    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcxc6\" (UniqueName: \"kubernetes.io/projected/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-kube-api-access-gcxc6\") pod \"authorino-5d88cd66d6-b9ccb\" (UID: \"7b65f1d9-cca4-4a52-92c3-29ebb0f12144\") " pod="kuadrant-system/authorino-5d88cd66d6-b9ccb"
Jul 15 17:07:23.627904 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.627736    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-tls-cert\") pod \"authorino-5d88cd66d6-b9ccb\" (UID: \"7b65f1d9-cca4-4a52-92c3-29ebb0f12144\") " pod="kuadrant-system/authorino-5d88cd66d6-b9ccb"
Jul 15 17:07:23.728776 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.728734    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcxc6\" (UniqueName: \"kubernetes.io/projected/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-kube-api-access-gcxc6\") pod \"authorino-5d88cd66d6-b9ccb\" (UID: \"7b65f1d9-cca4-4a52-92c3-29ebb0f12144\") " pod="kuadrant-system/authorino-5d88cd66d6-b9ccb"
Jul 15 17:07:23.728776 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.728782    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-tls-cert\") pod \"authorino-5d88cd66d6-b9ccb\" (UID: \"7b65f1d9-cca4-4a52-92c3-29ebb0f12144\") " pod="kuadrant-system/authorino-5d88cd66d6-b9ccb"
Jul 15 17:07:23.731193 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.731169    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-tls-cert\") pod \"authorino-5d88cd66d6-b9ccb\" (UID: \"7b65f1d9-cca4-4a52-92c3-29ebb0f12144\") " pod="kuadrant-system/authorino-5d88cd66d6-b9ccb"
Jul 15 17:07:23.738334 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.738307    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcxc6\" (UniqueName: \"kubernetes.io/projected/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-kube-api-access-gcxc6\") pod \"authorino-5d88cd66d6-b9ccb\" (UID: \"7b65f1d9-cca4-4a52-92c3-29ebb0f12144\") " pod="kuadrant-system/authorino-5d88cd66d6-b9ccb"
Jul 15 17:07:23.803356 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.803260    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d88cd66d6-b9ccb"
Jul 15 17:07:23.935940 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:23.935906    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d88cd66d6-b9ccb"]
Jul 15 17:07:23.939649 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:07:23.939618    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b65f1d9_cca4_4a52_92c3_29ebb0f12144.slice/crio-323c8f08a5b49c4e767d19943c9b96fe0097ea4172b0a95f8bce2f04dd809a34 WatchSource:0}: Error finding container 323c8f08a5b49c4e767d19943c9b96fe0097ea4172b0a95f8bce2f04dd809a34: Status 404 returned error can't find the container with id 323c8f08a5b49c4e767d19943c9b96fe0097ea4172b0a95f8bce2f04dd809a34
Jul 15 17:07:24.408036 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:24.408002    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d88cd66d6-b9ccb" event={"ID":"7b65f1d9-cca4-4a52-92c3-29ebb0f12144","Type":"ContainerStarted","Data":"323c8f08a5b49c4e767d19943c9b96fe0097ea4172b0a95f8bce2f04dd809a34"}
Jul 15 17:07:25.414445 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:25.414395    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d88cd66d6-b9ccb" event={"ID":"7b65f1d9-cca4-4a52-92c3-29ebb0f12144","Type":"ContainerStarted","Data":"40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad"}
Jul 15 17:07:25.433186 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:25.433128    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d88cd66d6-b9ccb" podStartSLOduration=1.969141362 podStartE2EDuration="2.433112384s" totalImagesPullingTime="463.971022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:07:25.43099383 +0000 UTC m=+501.588408647" watchObservedRunningTime="2026-07-15 17:07:25.433112384 +0000 UTC m=+501.590527206"
Jul 15 17:07:25.461195 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:25.461160    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7sgj"]
Jul 15 17:07:25.461407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:25.461384    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-b7sgj" podUID="4d00131c-a8a6-4085-8c79-d4a8f561ee43" containerName="authorino" containerID="cri-o://0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899" gracePeriod=30
Jul 15 17:07:25.713593 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:25.713567    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7sgj"
Jul 15 17:07:25.845891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:25.845851    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wm8w\" (UniqueName: \"kubernetes.io/projected/4d00131c-a8a6-4085-8c79-d4a8f561ee43-kube-api-access-5wm8w\") pod \"4d00131c-a8a6-4085-8c79-d4a8f561ee43\" (UID: \"4d00131c-a8a6-4085-8c79-d4a8f561ee43\") "
Jul 15 17:07:25.847894 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:25.847866    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d00131c-a8a6-4085-8c79-d4a8f561ee43-kube-api-access-5wm8w" (OuterVolumeSpecName: "kube-api-access-5wm8w") pod "4d00131c-a8a6-4085-8c79-d4a8f561ee43" (UID: "4d00131c-a8a6-4085-8c79-d4a8f561ee43"). InnerVolumeSpecName "kube-api-access-5wm8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:07:25.947049 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:25.946956    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wm8w\" (UniqueName: \"kubernetes.io/projected/4d00131c-a8a6-4085-8c79-d4a8f561ee43-kube-api-access-5wm8w\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:07:26.419756 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:26.419724    2556 generic.go:356] "Generic (PLEG): container finished" podID="4d00131c-a8a6-4085-8c79-d4a8f561ee43" containerID="0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899" exitCode=0
Jul 15 17:07:26.419756 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:26.419761    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-b7sgj"
Jul 15 17:07:26.420223 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:26.419802    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7sgj" event={"ID":"4d00131c-a8a6-4085-8c79-d4a8f561ee43","Type":"ContainerDied","Data":"0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899"}
Jul 15 17:07:26.420223 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:26.419843    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-b7sgj" event={"ID":"4d00131c-a8a6-4085-8c79-d4a8f561ee43","Type":"ContainerDied","Data":"c9c0c6645f7bd8c04163dee96d4b347c6bf5e04f2e9c0bb94ea9f65d0ec29df3"}
Jul 15 17:07:26.420223 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:26.419860    2556 scope.go:117] "RemoveContainer" containerID="0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899"
Jul 15 17:07:26.428032 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:26.428012    2556 scope.go:117] "RemoveContainer" containerID="0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899"
Jul 15 17:07:26.428296 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:07:26.428276    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899\": container with ID starting with 0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899 not found: ID does not exist" containerID="0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899"
Jul 15 17:07:26.428354 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:26.428306    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899"} err="failed to get container status \"0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899\": rpc error: code = NotFound desc = could not find container \"0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899\": container with ID starting with 0e3d82352bbc1c0cc28252f68f473f5e6e30eee52628c791d271d96d1e3f2899 not found: ID does not exist"
Jul 15 17:07:26.437092 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:26.437064    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7sgj"]
Jul 15 17:07:26.441313 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:26.441285    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-b7sgj"]
Jul 15 17:07:28.364641 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:07:28.364612    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d00131c-a8a6-4085-8c79-d4a8f561ee43" path="/var/lib/kubelet/pods/4d00131c-a8a6-4085-8c79-d4a8f561ee43/volumes"
Jul 15 17:08:28.326212 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.326179    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"]
Jul 15 17:08:28.326736 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.326494    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d00131c-a8a6-4085-8c79-d4a8f561ee43" containerName="authorino"
Jul 15 17:08:28.326736 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.326506    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d00131c-a8a6-4085-8c79-d4a8f561ee43" containerName="authorino"
Jul 15 17:08:28.326736 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.326564    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d00131c-a8a6-4085-8c79-d4a8f561ee43" containerName="authorino"
Jul 15 17:08:28.329200 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.329184    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.332677 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.332648    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 17:08:28.332820 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.332726    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 17:08:28.332820 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.332746    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 17:08:28.332942 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.332880    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4bf9z\""
Jul 15 17:08:28.338775 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.338744    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"]
Jul 15 17:08:28.504018 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.503980    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.504185 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.504030    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.504185 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.504079    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.504185 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.504113    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.504185 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.504175    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dc332f4-7cff-4564-82d5-ef3fa61f820b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.504319 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.504201    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2csp\" (UniqueName: \"kubernetes.io/projected/3dc332f4-7cff-4564-82d5-ef3fa61f820b-kube-api-access-t2csp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.604773 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.604672    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.604773 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.604744    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.604773 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.604778    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.605046 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.604803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dc332f4-7cff-4564-82d5-ef3fa61f820b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.605046 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.604838    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2csp\" (UniqueName: \"kubernetes.io/projected/3dc332f4-7cff-4564-82d5-ef3fa61f820b-kube-api-access-t2csp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.605046 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.604962    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.605200 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.605154    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.605200 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.605170    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.605299 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.605235    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.607138 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.607110    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dc332f4-7cff-4564-82d5-ef3fa61f820b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.607378 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.607362    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dc332f4-7cff-4564-82d5-ef3fa61f820b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.613761 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.613737    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2csp\" (UniqueName: \"kubernetes.io/projected/3dc332f4-7cff-4564-82d5-ef3fa61f820b-kube-api-access-t2csp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx\" (UID: \"3dc332f4-7cff-4564-82d5-ef3fa61f820b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.639512 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.639464    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:28.772905 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:28.772868    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"]
Jul 15 17:08:28.776761 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:08:28.776733    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc332f4_7cff_4564_82d5_ef3fa61f820b.slice/crio-7be2b45fa5f9456665c5aa97d3254a65bde6d9c0cb15aaca2907cd2048f6088e WatchSource:0}: Error finding container 7be2b45fa5f9456665c5aa97d3254a65bde6d9c0cb15aaca2907cd2048f6088e: Status 404 returned error can't find the container with id 7be2b45fa5f9456665c5aa97d3254a65bde6d9c0cb15aaca2907cd2048f6088e
Jul 15 17:08:29.683779 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:29.683743    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx" event={"ID":"3dc332f4-7cff-4564-82d5-ef3fa61f820b","Type":"ContainerStarted","Data":"7be2b45fa5f9456665c5aa97d3254a65bde6d9c0cb15aaca2907cd2048f6088e"}
Jul 15 17:08:30.690319 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:30.690276    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx" event={"ID":"3dc332f4-7cff-4564-82d5-ef3fa61f820b","Type":"ContainerStarted","Data":"d7070819ffde75b168a709299fc03290bc1bedcb9a105ac06c4779e6693fc502"}
Jul 15 17:08:30.709854 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:30.709801    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx" podStartSLOduration=1.455248751 podStartE2EDuration="2.709785617s" totalImagesPullingTime="1.254536866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:08:30.708639032 +0000 UTC m=+566.866053866" watchObservedRunningTime="2026-07-15 17:08:30.709785617 +0000 UTC m=+566.867200432"
Jul 15 17:08:38.639785 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:38.639738    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:38.640336 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:38.639834    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:38.652451 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:38.652425    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:08:38.734412 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:08:38.734384    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx"
Jul 15 17:09:04.222066 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:04.222036    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:09:04.223247 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:04.223225    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:09:05.627287 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.627246    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"]
Jul 15 17:09:05.631102 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.631081    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.633510 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.633494    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 17:09:05.640076 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.640048    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"]
Jul 15 17:09:05.718606 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.718567    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.718606 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.718608    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.718843 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.718644    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.718843 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.718679    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.718843 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.718739    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.718843 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.718787    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27bqc\" (UniqueName: \"kubernetes.io/projected/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-kube-api-access-27bqc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.819726 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.819690    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.819933 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.819759    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.819933 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.819808    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.819933 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.819834    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.819933 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.819902    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.820131 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.819930    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27bqc\" (UniqueName: \"kubernetes.io/projected/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-kube-api-access-27bqc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.820131 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.820099    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.820254 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.820229    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.820254 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.820248    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.822045 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.822020    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.822313 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.822297    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.831022 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.830996    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27bqc\" (UniqueName: \"kubernetes.io/projected/57fe77ef-b781-4e58-b8bb-4f7dd4333f94-kube-api-access-27bqc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bzr6w\" (UID: \"57fe77ef-b781-4e58-b8bb-4f7dd4333f94\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:05.945366 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:05.945277    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:06.073989 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:06.073958    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"]
Jul 15 17:09:06.076063 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:09:06.076040    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57fe77ef_b781_4e58_b8bb_4f7dd4333f94.slice/crio-088998204df2fd18f993c9032ec17f657ec07c63f01cb662f0bdc0cf428820d8 WatchSource:0}: Error finding container 088998204df2fd18f993c9032ec17f657ec07c63f01cb662f0bdc0cf428820d8: Status 404 returned error can't find the container with id 088998204df2fd18f993c9032ec17f657ec07c63f01cb662f0bdc0cf428820d8
Jul 15 17:09:06.846835 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:06.846796    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w" event={"ID":"57fe77ef-b781-4e58-b8bb-4f7dd4333f94","Type":"ContainerStarted","Data":"6b9974fa301601ec378dc739780b36b54e7479e834af2d844c187466a636a02d"}
Jul 15 17:09:06.847245 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:06.846872    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w" event={"ID":"57fe77ef-b781-4e58-b8bb-4f7dd4333f94","Type":"ContainerStarted","Data":"088998204df2fd18f993c9032ec17f657ec07c63f01cb662f0bdc0cf428820d8"}
Jul 15 17:09:06.868397 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:06.868337    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w" podStartSLOduration=1.5493502239999999 podStartE2EDuration="1.868315523s" totalImagesPullingTime="318.965299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:09:06.867929263 +0000 UTC m=+603.025344077" watchObservedRunningTime="2026-07-15 17:09:06.868315523 +0000 UTC m=+603.025730338"
Jul 15 17:09:15.945510 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:15.945469    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:15.946057 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:15.945530    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:15.958245 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:15.958220    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:09:16.899390 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:09:16.899356    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bzr6w"
Jul 15 17:11:30.328537 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.328501    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d7db9f7dc-kn44h"]
Jul 15 17:11:30.331575 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.331559    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d7db9f7dc-kn44h"
Jul 15 17:11:30.340150 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.340123    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d7db9f7dc-kn44h"]
Jul 15 17:11:30.425918 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.425882    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgdx4\" (UniqueName: \"kubernetes.io/projected/bfb2c94e-53e4-4f8d-879d-3accc092ecbf-kube-api-access-mgdx4\") pod \"authorino-7d7db9f7dc-kn44h\" (UID: \"bfb2c94e-53e4-4f8d-879d-3accc092ecbf\") " pod="kuadrant-system/authorino-7d7db9f7dc-kn44h"
Jul 15 17:11:30.426089 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.425929    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bfb2c94e-53e4-4f8d-879d-3accc092ecbf-tls-cert\") pod \"authorino-7d7db9f7dc-kn44h\" (UID: \"bfb2c94e-53e4-4f8d-879d-3accc092ecbf\") " pod="kuadrant-system/authorino-7d7db9f7dc-kn44h"
Jul 15 17:11:30.526405 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.526354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgdx4\" (UniqueName: \"kubernetes.io/projected/bfb2c94e-53e4-4f8d-879d-3accc092ecbf-kube-api-access-mgdx4\") pod \"authorino-7d7db9f7dc-kn44h\" (UID: \"bfb2c94e-53e4-4f8d-879d-3accc092ecbf\") " pod="kuadrant-system/authorino-7d7db9f7dc-kn44h"
Jul 15 17:11:30.526405 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.526418    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bfb2c94e-53e4-4f8d-879d-3accc092ecbf-tls-cert\") pod \"authorino-7d7db9f7dc-kn44h\" (UID: \"bfb2c94e-53e4-4f8d-879d-3accc092ecbf\") " pod="kuadrant-system/authorino-7d7db9f7dc-kn44h"
Jul 15 17:11:30.528905 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.528881    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bfb2c94e-53e4-4f8d-879d-3accc092ecbf-tls-cert\") pod \"authorino-7d7db9f7dc-kn44h\" (UID: \"bfb2c94e-53e4-4f8d-879d-3accc092ecbf\") " pod="kuadrant-system/authorino-7d7db9f7dc-kn44h"
Jul 15 17:11:30.535182 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.535155    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgdx4\" (UniqueName: \"kubernetes.io/projected/bfb2c94e-53e4-4f8d-879d-3accc092ecbf-kube-api-access-mgdx4\") pod \"authorino-7d7db9f7dc-kn44h\" (UID: \"bfb2c94e-53e4-4f8d-879d-3accc092ecbf\") " pod="kuadrant-system/authorino-7d7db9f7dc-kn44h"
Jul 15 17:11:30.640922 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.640836    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d7db9f7dc-kn44h"
Jul 15 17:11:30.793022 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:11:30.792993    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfb2c94e_53e4_4f8d_879d_3accc092ecbf.slice/crio-3776a7fd0359f13d228057a727364755a694dd7bc9594c039ea05ac872b1adfc WatchSource:0}: Error finding container 3776a7fd0359f13d228057a727364755a694dd7bc9594c039ea05ac872b1adfc: Status 404 returned error can't find the container with id 3776a7fd0359f13d228057a727364755a694dd7bc9594c039ea05ac872b1adfc
Jul 15 17:11:30.794421 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.794403    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 17:11:30.794762 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:30.794728    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d7db9f7dc-kn44h"]
Jul 15 17:11:31.454660 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.454624    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d7db9f7dc-kn44h" event={"ID":"bfb2c94e-53e4-4f8d-879d-3accc092ecbf","Type":"ContainerStarted","Data":"68fe403a33f85b5e5f089920836f916b2ea24861b0b78c330f0297bcba8227c2"}
Jul 15 17:11:31.455130 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.454676    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d7db9f7dc-kn44h" event={"ID":"bfb2c94e-53e4-4f8d-879d-3accc092ecbf","Type":"ContainerStarted","Data":"3776a7fd0359f13d228057a727364755a694dd7bc9594c039ea05ac872b1adfc"}
Jul 15 17:11:31.473301 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.473254    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d7db9f7dc-kn44h" podStartSLOduration=0.974703169 podStartE2EDuration="1.473238984s" totalImagesPullingTime="498.535815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:11:31.472336827 +0000 UTC m=+747.629751679" watchObservedRunningTime="2026-07-15 17:11:31.473238984 +0000 UTC m=+747.630653797"
Jul 15 17:11:31.506889 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.506857    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d88cd66d6-b9ccb"]
Jul 15 17:11:31.507080 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.507051    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d88cd66d6-b9ccb" podUID="7b65f1d9-cca4-4a52-92c3-29ebb0f12144" containerName="authorino" containerID="cri-o://40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad" gracePeriod=30
Jul 15 17:11:31.764003 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.763977    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d88cd66d6-b9ccb"
Jul 15 17:11:31.839345 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.839256    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-tls-cert\") pod \"7b65f1d9-cca4-4a52-92c3-29ebb0f12144\" (UID: \"7b65f1d9-cca4-4a52-92c3-29ebb0f12144\") "
Jul 15 17:11:31.839493 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.839367    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcxc6\" (UniqueName: \"kubernetes.io/projected/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-kube-api-access-gcxc6\") pod \"7b65f1d9-cca4-4a52-92c3-29ebb0f12144\" (UID: \"7b65f1d9-cca4-4a52-92c3-29ebb0f12144\") "
Jul 15 17:11:31.841381 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.841352    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-kube-api-access-gcxc6" (OuterVolumeSpecName: "kube-api-access-gcxc6") pod "7b65f1d9-cca4-4a52-92c3-29ebb0f12144" (UID: "7b65f1d9-cca4-4a52-92c3-29ebb0f12144"). InnerVolumeSpecName "kube-api-access-gcxc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:11:31.851448 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.851418    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7b65f1d9-cca4-4a52-92c3-29ebb0f12144" (UID: "7b65f1d9-cca4-4a52-92c3-29ebb0f12144"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:11:31.940523 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.940482    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcxc6\" (UniqueName: \"kubernetes.io/projected/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-kube-api-access-gcxc6\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:11:31.940685 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:31.940535    2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7b65f1d9-cca4-4a52-92c3-29ebb0f12144-tls-cert\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:11:32.461254 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:32.461218    2556 generic.go:356] "Generic (PLEG): container finished" podID="7b65f1d9-cca4-4a52-92c3-29ebb0f12144" containerID="40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad" exitCode=0
Jul 15 17:11:32.461826 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:32.461262    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d88cd66d6-b9ccb"
Jul 15 17:11:32.461826 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:32.461297    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d88cd66d6-b9ccb" event={"ID":"7b65f1d9-cca4-4a52-92c3-29ebb0f12144","Type":"ContainerDied","Data":"40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad"}
Jul 15 17:11:32.461826 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:32.461340    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d88cd66d6-b9ccb" event={"ID":"7b65f1d9-cca4-4a52-92c3-29ebb0f12144","Type":"ContainerDied","Data":"323c8f08a5b49c4e767d19943c9b96fe0097ea4172b0a95f8bce2f04dd809a34"}
Jul 15 17:11:32.461826 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:32.461359    2556 scope.go:117] "RemoveContainer" containerID="40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad"
Jul 15 17:11:32.469874 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:32.469861    2556 scope.go:117] "RemoveContainer" containerID="40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad"
Jul 15 17:11:32.470167 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:11:32.470145    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad\": container with ID starting with 40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad not found: ID does not exist" containerID="40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad"
Jul 15 17:11:32.470247 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:32.470173    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad"} err="failed to get container status \"40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad\": rpc error: code = NotFound desc = could not find container \"40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad\": container with ID starting with 40776a594b188c5baac777fae91dd52054741b14a99be023ec0b15522c1092ad not found: ID does not exist"
Jul 15 17:11:32.482264 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:32.482237    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d88cd66d6-b9ccb"]
Jul 15 17:11:32.484838 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:32.484816    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d88cd66d6-b9ccb"]
Jul 15 17:11:34.365175 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:11:34.365143    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b65f1d9-cca4-4a52-92c3-29ebb0f12144" path="/var/lib/kubelet/pods/7b65f1d9-cca4-4a52-92c3-29ebb0f12144/volumes"
Jul 15 17:14:04.246090 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:14:04.246064    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:14:04.248184 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:14:04.248165    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:15:00.202548 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:00.202509    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735595-ng7mt"]
Jul 15 17:15:00.205191 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:00.202860    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b65f1d9-cca4-4a52-92c3-29ebb0f12144" containerName="authorino"
Jul 15 17:15:00.205191 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:00.202872    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b65f1d9-cca4-4a52-92c3-29ebb0f12144" containerName="authorino"
Jul 15 17:15:00.205191 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:00.202950    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b65f1d9-cca4-4a52-92c3-29ebb0f12144" containerName="authorino"
Jul 15 17:15:00.206205 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:00.206189    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-ng7mt"
Jul 15 17:15:00.208872 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:00.208846    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:15:00.215978 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:00.215955    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-ng7mt"
Jul 15 17:15:00.256956 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:00.256870    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735595-ng7mt"]
Jul 15 17:15:00.359336 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:00.359308    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735595-ng7mt"]
Jul 15 17:15:00.362104 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:15:00.362070    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1b09d4_6df7_4f88_aec9_b19de1768c9f.slice/crio-29fc52701c767b8cd374bc6c29c5a872a67a29941bdda715b386a2fcabdd8742 WatchSource:0}: Error finding container 29fc52701c767b8cd374bc6c29c5a872a67a29941bdda715b386a2fcabdd8742: Status 404 returned error can't find the container with id 29fc52701c767b8cd374bc6c29c5a872a67a29941bdda715b386a2fcabdd8742
Jul 15 17:15:01.373659 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:01.373622    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-ng7mt" event={"ID":"df1b09d4-6df7-4f88-aec9-b19de1768c9f","Type":"ContainerStarted","Data":"29fc52701c767b8cd374bc6c29c5a872a67a29941bdda715b386a2fcabdd8742"}
Jul 15 17:15:03.384209 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:03.384178    2556 generic.go:356] "Generic (PLEG): container finished" podID="df1b09d4-6df7-4f88-aec9-b19de1768c9f" containerID="ea6ed2aaa6393cf74c72ff902988b9dd91d2d342bd80f69e6add3bd15e824505" exitCode=0
Jul 15 17:15:03.384593 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:03.384260    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-ng7mt" event={"ID":"df1b09d4-6df7-4f88-aec9-b19de1768c9f","Type":"ContainerDied","Data":"ea6ed2aaa6393cf74c72ff902988b9dd91d2d342bd80f69e6add3bd15e824505"}
Jul 15 17:15:04.522471 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:04.522447    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-ng7mt"
Jul 15 17:15:05.394514 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:05.394485    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-ng7mt"
Jul 15 17:15:05.394514 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:05.394494    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-ng7mt" event={"ID":"df1b09d4-6df7-4f88-aec9-b19de1768c9f","Type":"ContainerDied","Data":"29fc52701c767b8cd374bc6c29c5a872a67a29941bdda715b386a2fcabdd8742"}
Jul 15 17:15:05.394764 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:15:05.394540    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29fc52701c767b8cd374bc6c29c5a872a67a29941bdda715b386a2fcabdd8742"
Jul 15 17:19:04.276278 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:19:04.276252    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:19:04.278526 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:19:04.278505    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:24:04.301451 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:04.301425    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:24:04.303136 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:04.303117    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:24:56.706755 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:56.706703    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"]
Jul 15 17:24:56.707215 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:56.707045    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df1b09d4-6df7-4f88-aec9-b19de1768c9f" containerName="cleanup"
Jul 15 17:24:56.707215 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:56.707057    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="df1b09d4-6df7-4f88-aec9-b19de1768c9f" containerName="cleanup"
Jul 15 17:24:56.707215 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:56.707117    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="df1b09d4-6df7-4f88-aec9-b19de1768c9f" containerName="cleanup"
Jul 15 17:24:56.710100 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:56.710084    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"
Jul 15 17:24:56.712499 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:56.712477    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:24:56.720639 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:56.720614    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"]
Jul 15 17:24:56.827413 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:56.827368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b07c38f3-ea52-4a3b-8519-0356b241f303-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-554abb3e-87xz5\" (UID: \"b07c38f3-ea52-4a3b-8519-0356b241f303\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"
Jul 15 17:24:56.928635 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:56.928600    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b07c38f3-ea52-4a3b-8519-0356b241f303-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-554abb3e-87xz5\" (UID: \"b07c38f3-ea52-4a3b-8519-0356b241f303\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"
Jul 15 17:24:56.929292 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:56.929267    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b07c38f3-ea52-4a3b-8519-0356b241f303-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-554abb3e-87xz5\" (UID: \"b07c38f3-ea52-4a3b-8519-0356b241f303\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"
Jul 15 17:24:57.020147 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:57.020117    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"
Jul 15 17:24:57.146453 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:57.146428    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"]
Jul 15 17:24:57.148859 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:24:57.148825    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb07c38f3_ea52_4a3b_8519_0356b241f303.slice/crio-52f5ba8de4fbab4a9bdeaffc5771f8fe439fca139b6b4dec8c7533f9c5020b74 WatchSource:0}: Error finding container 52f5ba8de4fbab4a9bdeaffc5771f8fe439fca139b6b4dec8c7533f9c5020b74: Status 404 returned error can't find the container with id 52f5ba8de4fbab4a9bdeaffc5771f8fe439fca139b6b4dec8c7533f9c5020b74
Jul 15 17:24:57.962898 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:57.962813    2556 generic.go:356] "Generic (PLEG): container finished" podID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerID="e72da21242d2af230a2f5c455c534c2dc1dc3bffca825ee7d41c0513ae0d17e4" exitCode=7
Jul 15 17:24:57.962898 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:57.962856    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5" event={"ID":"b07c38f3-ea52-4a3b-8519-0356b241f303","Type":"ContainerDied","Data":"e72da21242d2af230a2f5c455c534c2dc1dc3bffca825ee7d41c0513ae0d17e4"}
Jul 15 17:24:57.962898 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:57.962891    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5" event={"ID":"b07c38f3-ea52-4a3b-8519-0356b241f303","Type":"ContainerStarted","Data":"52f5ba8de4fbab4a9bdeaffc5771f8fe439fca139b6b4dec8c7533f9c5020b74"}
Jul 15 17:24:57.963432 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:57.963113    2556 scope.go:117] "RemoveContainer" containerID="e72da21242d2af230a2f5c455c534c2dc1dc3bffca825ee7d41c0513ae0d17e4"
Jul 15 17:24:58.968984 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:58.968951    2556 generic.go:356] "Generic (PLEG): container finished" podID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerID="40476526d6704c27703d13bb8cfcc7b2abd22faa6eb732f12f18d851b4c6242a" exitCode=7
Jul 15 17:24:58.969413 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:58.969033    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5" event={"ID":"b07c38f3-ea52-4a3b-8519-0356b241f303","Type":"ContainerDied","Data":"40476526d6704c27703d13bb8cfcc7b2abd22faa6eb732f12f18d851b4c6242a"}
Jul 15 17:24:58.969413 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:58.969098    2556 scope.go:117] "RemoveContainer" containerID="e72da21242d2af230a2f5c455c534c2dc1dc3bffca825ee7d41c0513ae0d17e4"
Jul 15 17:24:58.969413 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:58.969319    2556 scope.go:117] "RemoveContainer" containerID="40476526d6704c27703d13bb8cfcc7b2abd22faa6eb732f12f18d851b4c6242a"
Jul 15 17:24:58.969561 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:24:58.969504    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-554abb3e-87xz5_odh-ai-gateway-infra(b07c38f3-ea52-4a3b-8519-0356b241f303)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303"
Jul 15 17:24:59.980168 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:24:59.980140    2556 scope.go:117] "RemoveContainer" containerID="40476526d6704c27703d13bb8cfcc7b2abd22faa6eb732f12f18d851b4c6242a"
Jul 15 17:24:59.980541 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:24:59.980299    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-554abb3e-87xz5_odh-ai-gateway-infra(b07c38f3-ea52-4a3b-8519-0356b241f303)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303"
Jul 15 17:25:13.359872 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:13.359833    2556 scope.go:117] "RemoveContainer" containerID="40476526d6704c27703d13bb8cfcc7b2abd22faa6eb732f12f18d851b4c6242a"
Jul 15 17:25:14.050016 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:14.049982    2556 generic.go:356] "Generic (PLEG): container finished" podID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerID="5039750707c491f9be65f30b8a2c33a25e61306db1311564629a446d65cec8a3" exitCode=0
Jul 15 17:25:14.050179 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:14.050036    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5" event={"ID":"b07c38f3-ea52-4a3b-8519-0356b241f303","Type":"ContainerDied","Data":"5039750707c491f9be65f30b8a2c33a25e61306db1311564629a446d65cec8a3"}
Jul 15 17:25:14.050179 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:14.050124    2556 scope.go:117] "RemoveContainer" containerID="40476526d6704c27703d13bb8cfcc7b2abd22faa6eb732f12f18d851b4c6242a"
Jul 15 17:25:15.078606 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:15.078573    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"]
Jul 15 17:25:15.187121 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:15.187094    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"
Jul 15 17:25:15.285624 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:15.285580    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b07c38f3-ea52-4a3b-8519-0356b241f303-maas-api-service-ca\") pod \"b07c38f3-ea52-4a3b-8519-0356b241f303\" (UID: \"b07c38f3-ea52-4a3b-8519-0356b241f303\") "
Jul 15 17:25:15.286015 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:15.285990    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b07c38f3-ea52-4a3b-8519-0356b241f303-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b07c38f3-ea52-4a3b-8519-0356b241f303" (UID: "b07c38f3-ea52-4a3b-8519-0356b241f303"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:25:15.386375 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:15.386298    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b07c38f3-ea52-4a3b-8519-0356b241f303-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:25:16.062053 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:16.062023    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"
Jul 15 17:25:16.062245 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:16.062025    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5" event={"ID":"b07c38f3-ea52-4a3b-8519-0356b241f303","Type":"ContainerDied","Data":"52f5ba8de4fbab4a9bdeaffc5771f8fe439fca139b6b4dec8c7533f9c5020b74"}
Jul 15 17:25:16.062245 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:16.062150    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52f5ba8de4fbab4a9bdeaffc5771f8fe439fca139b6b4dec8c7533f9c5020b74"
Jul 15 17:25:16.092455 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:16.092418    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"]
Jul 15 17:25:16.094290 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:16.094267    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-87xz5"]
Jul 15 17:25:16.365261 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:16.365182    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303" path="/var/lib/kubelet/pods/b07c38f3-ea52-4a3b-8519-0356b241f303/volumes"
Jul 15 17:25:46.763739 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.763693    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8"]
Jul 15 17:25:46.764219 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.764020    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerName="revoke-keys"
Jul 15 17:25:46.764219 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.764030    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerName="revoke-keys"
Jul 15 17:25:46.764219 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.764055    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerName="revoke-keys"
Jul 15 17:25:46.764219 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.764061    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerName="revoke-keys"
Jul 15 17:25:46.764219 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.764107    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerName="revoke-keys"
Jul 15 17:25:46.764219 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.764115    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerName="revoke-keys"
Jul 15 17:25:46.764219 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.764123    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerName="revoke-keys"
Jul 15 17:25:46.767023 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.767002    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8"
Jul 15 17:25:46.769432 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.769407    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:25:46.775355 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.775333    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8"]
Jul 15 17:25:46.878353 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.878310    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f77b63-83ef-47ab-8e3f-b03aa1fc8618-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8\" (UID: \"c3f77b63-83ef-47ab-8e3f-b03aa1fc8618\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8"
Jul 15 17:25:46.979088 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.979054    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f77b63-83ef-47ab-8e3f-b03aa1fc8618-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8\" (UID: \"c3f77b63-83ef-47ab-8e3f-b03aa1fc8618\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8"
Jul 15 17:25:46.979760 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:46.979706    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f77b63-83ef-47ab-8e3f-b03aa1fc8618-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8\" (UID: \"c3f77b63-83ef-47ab-8e3f-b03aa1fc8618\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8"
Jul 15 17:25:47.077659 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:47.077563    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8"
Jul 15 17:25:47.211234 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:47.211211    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8"]
Jul 15 17:25:47.213857 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:25:47.213828    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f77b63_83ef_47ab_8e3f_b03aa1fc8618.slice/crio-840b8fee2fc5f7c88ab133426d04c9f6a2a8fb83210078bbc53ec4c50f2d2329 WatchSource:0}: Error finding container 840b8fee2fc5f7c88ab133426d04c9f6a2a8fb83210078bbc53ec4c50f2d2329: Status 404 returned error can't find the container with id 840b8fee2fc5f7c88ab133426d04c9f6a2a8fb83210078bbc53ec4c50f2d2329
Jul 15 17:25:48.200135 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:48.200044    2556 generic.go:356] "Generic (PLEG): container finished" podID="c3f77b63-83ef-47ab-8e3f-b03aa1fc8618" containerID="13ec007a35031f1dd1df41f07e508471b9f3248e3f97e88f868e8cdbf24f8ee9" exitCode=0
Jul 15 17:25:48.200135 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:48.200081    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8" event={"ID":"c3f77b63-83ef-47ab-8e3f-b03aa1fc8618","Type":"ContainerDied","Data":"13ec007a35031f1dd1df41f07e508471b9f3248e3f97e88f868e8cdbf24f8ee9"}
Jul 15 17:25:48.200135 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:48.200120    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8" event={"ID":"c3f77b63-83ef-47ab-8e3f-b03aa1fc8618","Type":"ContainerStarted","Data":"840b8fee2fc5f7c88ab133426d04c9f6a2a8fb83210078bbc53ec4c50f2d2329"}
Jul 15 17:25:49.333123 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:49.333097    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8"
Jul 15 17:25:49.403240 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:49.403208    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f77b63-83ef-47ab-8e3f-b03aa1fc8618-maas-api-service-ca\") pod \"c3f77b63-83ef-47ab-8e3f-b03aa1fc8618\" (UID: \"c3f77b63-83ef-47ab-8e3f-b03aa1fc8618\") "
Jul 15 17:25:49.403614 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:49.403586    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f77b63-83ef-47ab-8e3f-b03aa1fc8618-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c3f77b63-83ef-47ab-8e3f-b03aa1fc8618" (UID: "c3f77b63-83ef-47ab-8e3f-b03aa1fc8618"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:25:49.503926 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:49.503891    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f77b63-83ef-47ab-8e3f-b03aa1fc8618-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:25:50.210484 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:50.210456    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8"
Jul 15 17:25:50.210655 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:50.210484    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8" event={"ID":"c3f77b63-83ef-47ab-8e3f-b03aa1fc8618","Type":"ContainerDied","Data":"840b8fee2fc5f7c88ab133426d04c9f6a2a8fb83210078bbc53ec4c50f2d2329"}
Jul 15 17:25:50.210655 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:25:50.210526    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="840b8fee2fc5f7c88ab133426d04c9f6a2a8fb83210078bbc53ec4c50f2d2329"
Jul 15 17:26:18.350824 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.350791    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"]
Jul 15 17:26:18.351267 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.351124    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f77b63-83ef-47ab-8e3f-b03aa1fc8618" containerName="revoke-keys"
Jul 15 17:26:18.351267 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.351137    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f77b63-83ef-47ab-8e3f-b03aa1fc8618" containerName="revoke-keys"
Jul 15 17:26:18.351267 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.351158    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerName="revoke-keys"
Jul 15 17:26:18.351267 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.351163    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b07c38f3-ea52-4a3b-8519-0356b241f303" containerName="revoke-keys"
Jul 15 17:26:18.351267 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.351217    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f77b63-83ef-47ab-8e3f-b03aa1fc8618" containerName="revoke-keys"
Jul 15 17:26:18.354245 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.354229    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"
Jul 15 17:26:18.357764 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.357741    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:26:18.366606 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.366585    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"]
Jul 15 17:26:18.465161 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.465126    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd66124d-e4e4-4bcf-abe2-49aa345ddf06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j\" (UID: \"bd66124d-e4e4-4bcf-abe2-49aa345ddf06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"
Jul 15 17:26:18.565944 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.565905    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd66124d-e4e4-4bcf-abe2-49aa345ddf06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j\" (UID: \"bd66124d-e4e4-4bcf-abe2-49aa345ddf06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"
Jul 15 17:26:18.566540 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.566519    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd66124d-e4e4-4bcf-abe2-49aa345ddf06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j\" (UID: \"bd66124d-e4e4-4bcf-abe2-49aa345ddf06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"
Jul 15 17:26:18.665686 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.665591    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"
Jul 15 17:26:18.815538 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:18.815506    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"]
Jul 15 17:26:18.816616 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:26:18.816578    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd66124d_e4e4_4bcf_abe2_49aa345ddf06.slice/crio-854a054276ad681a6ac1286cf1fc5ba001f84d4b5fa8bc7566b474f55cf9c820 WatchSource:0}: Error finding container 854a054276ad681a6ac1286cf1fc5ba001f84d4b5fa8bc7566b474f55cf9c820: Status 404 returned error can't find the container with id 854a054276ad681a6ac1286cf1fc5ba001f84d4b5fa8bc7566b474f55cf9c820
Jul 15 17:26:19.343782 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:19.343672    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j" event={"ID":"bd66124d-e4e4-4bcf-abe2-49aa345ddf06","Type":"ContainerStarted","Data":"c488fed79a0abfc379e5510e36523f2a5ded125ed889320dabdd008e794202fa"}
Jul 15 17:26:19.343782 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:19.343744    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j" event={"ID":"bd66124d-e4e4-4bcf-abe2-49aa345ddf06","Type":"ContainerStarted","Data":"854a054276ad681a6ac1286cf1fc5ba001f84d4b5fa8bc7566b474f55cf9c820"}
Jul 15 17:26:19.361189 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:19.361148    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j" podStartSLOduration=1.361133092 podStartE2EDuration="1.361133092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:26:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:26:19.36099619 +0000 UTC m=+1635.518411001" watchObservedRunningTime="2026-07-15 17:26:19.361133092 +0000 UTC m=+1635.518547905"
Jul 15 17:26:20.349129 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:20.349093    2556 generic.go:356] "Generic (PLEG): container finished" podID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerID="c488fed79a0abfc379e5510e36523f2a5ded125ed889320dabdd008e794202fa" exitCode=7
Jul 15 17:26:20.349300 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:20.349179    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j" event={"ID":"bd66124d-e4e4-4bcf-abe2-49aa345ddf06","Type":"ContainerDied","Data":"c488fed79a0abfc379e5510e36523f2a5ded125ed889320dabdd008e794202fa"}
Jul 15 17:26:20.349365 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:20.349352    2556 scope.go:117] "RemoveContainer" containerID="c488fed79a0abfc379e5510e36523f2a5ded125ed889320dabdd008e794202fa"
Jul 15 17:26:21.355870 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:21.355784    2556 generic.go:356] "Generic (PLEG): container finished" podID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerID="2d83f1cd0c08fc8a8948216c930cda2f09a46d7c51ac03e595f74856f3f4fd27" exitCode=7
Jul 15 17:26:21.355870 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:21.355822    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j" event={"ID":"bd66124d-e4e4-4bcf-abe2-49aa345ddf06","Type":"ContainerDied","Data":"2d83f1cd0c08fc8a8948216c930cda2f09a46d7c51ac03e595f74856f3f4fd27"}
Jul 15 17:26:21.355870 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:21.355870    2556 scope.go:117] "RemoveContainer" containerID="c488fed79a0abfc379e5510e36523f2a5ded125ed889320dabdd008e794202fa"
Jul 15 17:26:21.356361 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:21.356058    2556 scope.go:117] "RemoveContainer" containerID="2d83f1cd0c08fc8a8948216c930cda2f09a46d7c51ac03e595f74856f3f4fd27"
Jul 15 17:26:21.356361 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:26:21.356263    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j_odh-ai-gateway-infra(bd66124d-e4e4-4bcf-abe2-49aa345ddf06)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06"
Jul 15 17:26:22.362002 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:22.361973    2556 scope.go:117] "RemoveContainer" containerID="2d83f1cd0c08fc8a8948216c930cda2f09a46d7c51ac03e595f74856f3f4fd27"
Jul 15 17:26:22.362380 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:26:22.362151    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j_odh-ai-gateway-infra(bd66124d-e4e4-4bcf-abe2-49aa345ddf06)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06"
Jul 15 17:26:34.362103 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:34.362073    2556 scope.go:117] "RemoveContainer" containerID="2d83f1cd0c08fc8a8948216c930cda2f09a46d7c51ac03e595f74856f3f4fd27"
Jul 15 17:26:35.419007 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:35.418908    2556 generic.go:356] "Generic (PLEG): container finished" podID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerID="4cd686aaa2bdaf0dc8466e56d6a6385ebb7b82bd9056c51c374cffd20be9d30b" exitCode=0
Jul 15 17:26:35.419007 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:35.418986    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j" event={"ID":"bd66124d-e4e4-4bcf-abe2-49aa345ddf06","Type":"ContainerDied","Data":"4cd686aaa2bdaf0dc8466e56d6a6385ebb7b82bd9056c51c374cffd20be9d30b"}
Jul 15 17:26:35.419433 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:35.419049    2556 scope.go:117] "RemoveContainer" containerID="2d83f1cd0c08fc8a8948216c930cda2f09a46d7c51ac03e595f74856f3f4fd27"
Jul 15 17:26:36.446301 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:36.446271    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"]
Jul 15 17:26:36.575679 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:36.575657    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"
Jul 15 17:26:36.643968 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:36.643932    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd66124d-e4e4-4bcf-abe2-49aa345ddf06-maas-api-service-ca\") pod \"bd66124d-e4e4-4bcf-abe2-49aa345ddf06\" (UID: \"bd66124d-e4e4-4bcf-abe2-49aa345ddf06\") "
Jul 15 17:26:36.644300 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:36.644278    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd66124d-e4e4-4bcf-abe2-49aa345ddf06-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bd66124d-e4e4-4bcf-abe2-49aa345ddf06" (UID: "bd66124d-e4e4-4bcf-abe2-49aa345ddf06"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:26:36.745321 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:36.745287    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd66124d-e4e4-4bcf-abe2-49aa345ddf06-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:26:37.429564 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:37.429531    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j" event={"ID":"bd66124d-e4e4-4bcf-abe2-49aa345ddf06","Type":"ContainerDied","Data":"854a054276ad681a6ac1286cf1fc5ba001f84d4b5fa8bc7566b474f55cf9c820"}
Jul 15 17:26:37.429564 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:37.429557    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"
Jul 15 17:26:37.429787 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:37.429581    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="854a054276ad681a6ac1286cf1fc5ba001f84d4b5fa8bc7566b474f55cf9c820"
Jul 15 17:26:37.458565 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:37.458534    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"]
Jul 15 17:26:37.466432 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:37.466409    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bxh8j"]
Jul 15 17:26:38.364990 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:26:38.364958    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" path="/var/lib/kubelet/pods/bd66124d-e4e4-4bcf-abe2-49aa345ddf06/volumes"
Jul 15 17:27:08.401618 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.401584    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng"]
Jul 15 17:27:08.402084 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.401927    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerName="revoke-keys"
Jul 15 17:27:08.402084 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.401938    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerName="revoke-keys"
Jul 15 17:27:08.402084 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.401948    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerName="revoke-keys"
Jul 15 17:27:08.402084 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.401955    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerName="revoke-keys"
Jul 15 17:27:08.402084 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.402004    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerName="revoke-keys"
Jul 15 17:27:08.402084 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.402014    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerName="revoke-keys"
Jul 15 17:27:08.402084 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.402019    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerName="revoke-keys"
Jul 15 17:27:08.404946 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.404931    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng"
Jul 15 17:27:08.407882 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.407863    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:27:08.414134 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.414104    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng"]
Jul 15 17:27:08.537489 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.537446    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c086b591-d96e-4883-b9cb-87558fd9173d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng\" (UID: \"c086b591-d96e-4883-b9cb-87558fd9173d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng"
Jul 15 17:27:08.638858 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.638808    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c086b591-d96e-4883-b9cb-87558fd9173d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng\" (UID: \"c086b591-d96e-4883-b9cb-87558fd9173d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng"
Jul 15 17:27:08.639430 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.639410    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c086b591-d96e-4883-b9cb-87558fd9173d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng\" (UID: \"c086b591-d96e-4883-b9cb-87558fd9173d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng"
Jul 15 17:27:08.715551 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.715473    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng"
Jul 15 17:27:08.851306 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:08.851281    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng"]
Jul 15 17:27:08.853843 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:27:08.853817    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc086b591_d96e_4883_b9cb_87558fd9173d.slice/crio-69f99dfad3672d9a306ad248e6fa68dfb7445600e969f17780ede4121b27af2d WatchSource:0}: Error finding container 69f99dfad3672d9a306ad248e6fa68dfb7445600e969f17780ede4121b27af2d: Status 404 returned error can't find the container with id 69f99dfad3672d9a306ad248e6fa68dfb7445600e969f17780ede4121b27af2d
Jul 15 17:27:09.573568 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:09.573533    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng" event={"ID":"c086b591-d96e-4883-b9cb-87558fd9173d","Type":"ContainerStarted","Data":"10e380547829c2a66af3c4c30f0c6aa0a668c38f456374864d447c807e22a2a0"}
Jul 15 17:27:09.574073 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:09.573594    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng" event={"ID":"c086b591-d96e-4883-b9cb-87558fd9173d","Type":"ContainerStarted","Data":"69f99dfad3672d9a306ad248e6fa68dfb7445600e969f17780ede4121b27af2d"}
Jul 15 17:27:09.596068 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:09.596022    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng" podStartSLOduration=1.596005605 podStartE2EDuration="1.596005605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:27:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:27:09.594804037 +0000 UTC m=+1685.752218854" watchObservedRunningTime="2026-07-15 17:27:09.596005605 +0000 UTC m=+1685.753420420"
Jul 15 17:27:10.580682 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:10.580644    2556 generic.go:356] "Generic (PLEG): container finished" podID="c086b591-d96e-4883-b9cb-87558fd9173d" containerID="10e380547829c2a66af3c4c30f0c6aa0a668c38f456374864d447c807e22a2a0" exitCode=0
Jul 15 17:27:10.581068 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:10.580691    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng" event={"ID":"c086b591-d96e-4883-b9cb-87558fd9173d","Type":"ContainerDied","Data":"10e380547829c2a66af3c4c30f0c6aa0a668c38f456374864d447c807e22a2a0"}
Jul 15 17:27:11.713608 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:11.713580    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng"
Jul 15 17:27:11.766774 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:11.766741    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c086b591-d96e-4883-b9cb-87558fd9173d-maas-api-service-ca\") pod \"c086b591-d96e-4883-b9cb-87558fd9173d\" (UID: \"c086b591-d96e-4883-b9cb-87558fd9173d\") "
Jul 15 17:27:11.767054 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:11.767031    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c086b591-d96e-4883-b9cb-87558fd9173d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c086b591-d96e-4883-b9cb-87558fd9173d" (UID: "c086b591-d96e-4883-b9cb-87558fd9173d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:27:11.867950 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:11.867859    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c086b591-d96e-4883-b9cb-87558fd9173d-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:27:12.590763 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:12.590736    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng"
Jul 15 17:27:12.590940 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:12.590762    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng" event={"ID":"c086b591-d96e-4883-b9cb-87558fd9173d","Type":"ContainerDied","Data":"69f99dfad3672d9a306ad248e6fa68dfb7445600e969f17780ede4121b27af2d"}
Jul 15 17:27:12.590940 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:12.590810    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69f99dfad3672d9a306ad248e6fa68dfb7445600e969f17780ede4121b27af2d"
Jul 15 17:27:31.191157 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.191113    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"]
Jul 15 17:27:31.191777 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.191585    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerName="revoke-keys"
Jul 15 17:27:31.191777 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.191603    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd66124d-e4e4-4bcf-abe2-49aa345ddf06" containerName="revoke-keys"
Jul 15 17:27:31.191777 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.191622    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c086b591-d96e-4883-b9cb-87558fd9173d" containerName="revoke-keys"
Jul 15 17:27:31.191777 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.191632    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c086b591-d96e-4883-b9cb-87558fd9173d" containerName="revoke-keys"
Jul 15 17:27:31.191777 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.191742    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c086b591-d96e-4883-b9cb-87558fd9173d" containerName="revoke-keys"
Jul 15 17:27:31.194915 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.194894    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"
Jul 15 17:27:31.197550 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.197532    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:27:31.203086 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.203056    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"]
Jul 15 17:27:31.338086 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.338046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27051d12-1535-4b30-9458-d9596c5f5444-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2\" (UID: \"27051d12-1535-4b30-9458-d9596c5f5444\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"
Jul 15 17:27:31.438920 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.438881    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27051d12-1535-4b30-9458-d9596c5f5444-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2\" (UID: \"27051d12-1535-4b30-9458-d9596c5f5444\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"
Jul 15 17:27:31.439589 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.439568    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27051d12-1535-4b30-9458-d9596c5f5444-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2\" (UID: \"27051d12-1535-4b30-9458-d9596c5f5444\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"
Jul 15 17:27:31.506055 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.506028    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"
Jul 15 17:27:31.632236 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.632211    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"]
Jul 15 17:27:31.634618 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:27:31.634591    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27051d12_1535_4b30_9458_d9596c5f5444.slice/crio-47b96391e76034d20313b5cf657870732e3841af163e0c7fc63f359dbe52ca35 WatchSource:0}: Error finding container 47b96391e76034d20313b5cf657870732e3841af163e0c7fc63f359dbe52ca35: Status 404 returned error can't find the container with id 47b96391e76034d20313b5cf657870732e3841af163e0c7fc63f359dbe52ca35
Jul 15 17:27:31.676739 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:31.676690    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2" event={"ID":"27051d12-1535-4b30-9458-d9596c5f5444","Type":"ContainerStarted","Data":"47b96391e76034d20313b5cf657870732e3841af163e0c7fc63f359dbe52ca35"}
Jul 15 17:27:32.682805 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:32.682770    2556 generic.go:356] "Generic (PLEG): container finished" podID="27051d12-1535-4b30-9458-d9596c5f5444" containerID="fe271512d8c348cc1fa9e622ec2c009fb039825242dbc9924af28c6ce0e90bb2" exitCode=7
Jul 15 17:27:32.683174 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:32.682844    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2" event={"ID":"27051d12-1535-4b30-9458-d9596c5f5444","Type":"ContainerDied","Data":"fe271512d8c348cc1fa9e622ec2c009fb039825242dbc9924af28c6ce0e90bb2"}
Jul 15 17:27:32.683174 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:32.682996    2556 scope.go:117] "RemoveContainer" containerID="fe271512d8c348cc1fa9e622ec2c009fb039825242dbc9924af28c6ce0e90bb2"
Jul 15 17:27:33.689579 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:33.689495    2556 generic.go:356] "Generic (PLEG): container finished" podID="27051d12-1535-4b30-9458-d9596c5f5444" containerID="6d8f88e35fffe649e93f27ee5a963c2dfff3f2477853f50c2d563ba85888bcfb" exitCode=7
Jul 15 17:27:33.690051 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:33.689586    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2" event={"ID":"27051d12-1535-4b30-9458-d9596c5f5444","Type":"ContainerDied","Data":"6d8f88e35fffe649e93f27ee5a963c2dfff3f2477853f50c2d563ba85888bcfb"}
Jul 15 17:27:33.690051 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:33.689665    2556 scope.go:117] "RemoveContainer" containerID="fe271512d8c348cc1fa9e622ec2c009fb039825242dbc9924af28c6ce0e90bb2"
Jul 15 17:27:33.690051 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:33.689879    2556 scope.go:117] "RemoveContainer" containerID="6d8f88e35fffe649e93f27ee5a963c2dfff3f2477853f50c2d563ba85888bcfb"
Jul 15 17:27:33.690211 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:27:33.690138    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2_odh-ai-gateway-infra(27051d12-1535-4b30-9458-d9596c5f5444)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2" podUID="27051d12-1535-4b30-9458-d9596c5f5444"
Jul 15 17:27:34.695261 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:34.695237    2556 scope.go:117] "RemoveContainer" containerID="6d8f88e35fffe649e93f27ee5a963c2dfff3f2477853f50c2d563ba85888bcfb"
Jul 15 17:27:34.695647 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:27:34.695413    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2_odh-ai-gateway-infra(27051d12-1535-4b30-9458-d9596c5f5444)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2" podUID="27051d12-1535-4b30-9458-d9596c5f5444"
Jul 15 17:27:49.360426 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:49.360385    2556 scope.go:117] "RemoveContainer" containerID="6d8f88e35fffe649e93f27ee5a963c2dfff3f2477853f50c2d563ba85888bcfb"
Jul 15 17:27:49.766348 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:49.766314    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2" event={"ID":"27051d12-1535-4b30-9458-d9596c5f5444","Type":"ContainerStarted","Data":"0ebd08bcf7bd1709cbf5dc79527f6c429dcd2e58d1c4d1df69f74a7eeaeb0a37"}
Jul 15 17:27:49.785475 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:49.785426    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2" podStartSLOduration=18.785410033 podStartE2EDuration="18.785410033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:27:49.784574576 +0000 UTC m=+1725.941989391" watchObservedRunningTime="2026-07-15 17:27:49.785410033 +0000 UTC m=+1725.942824846"
Jul 15 17:27:50.772602 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:50.772569    2556 generic.go:356] "Generic (PLEG): container finished" podID="27051d12-1535-4b30-9458-d9596c5f5444" containerID="0ebd08bcf7bd1709cbf5dc79527f6c429dcd2e58d1c4d1df69f74a7eeaeb0a37" exitCode=0
Jul 15 17:27:50.773056 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:50.772644    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2" event={"ID":"27051d12-1535-4b30-9458-d9596c5f5444","Type":"ContainerDied","Data":"0ebd08bcf7bd1709cbf5dc79527f6c429dcd2e58d1c4d1df69f74a7eeaeb0a37"}
Jul 15 17:27:50.773056 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:50.772707    2556 scope.go:117] "RemoveContainer" containerID="6d8f88e35fffe649e93f27ee5a963c2dfff3f2477853f50c2d563ba85888bcfb"
Jul 15 17:27:50.794444 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:50.794410    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"]
Jul 15 17:27:51.907118 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:51.907092    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"
Jul 15 17:27:51.920366 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:51.920330    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27051d12-1535-4b30-9458-d9596c5f5444-maas-api-service-ca\") pod \"27051d12-1535-4b30-9458-d9596c5f5444\" (UID: \"27051d12-1535-4b30-9458-d9596c5f5444\") "
Jul 15 17:27:51.920683 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:51.920659    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27051d12-1535-4b30-9458-d9596c5f5444-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27051d12-1535-4b30-9458-d9596c5f5444" (UID: "27051d12-1535-4b30-9458-d9596c5f5444"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:27:52.021651 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:52.021612    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27051d12-1535-4b30-9458-d9596c5f5444-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:27:52.783607 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:52.783566    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2" event={"ID":"27051d12-1535-4b30-9458-d9596c5f5444","Type":"ContainerDied","Data":"47b96391e76034d20313b5cf657870732e3841af163e0c7fc63f359dbe52ca35"}
Jul 15 17:27:52.783801 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:52.783629    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47b96391e76034d20313b5cf657870732e3841af163e0c7fc63f359dbe52ca35"
Jul 15 17:27:52.783801 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:52.783574    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"
Jul 15 17:27:52.813560 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:52.813526    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"]
Jul 15 17:27:52.817588 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:52.817566    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-cm7n2"]
Jul 15 17:27:54.365163 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:27:54.365132    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27051d12-1535-4b30-9458-d9596c5f5444" path="/var/lib/kubelet/pods/27051d12-1535-4b30-9458-d9596c5f5444/volumes"
Jul 15 17:28:31.262400 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.262365    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l"]
Jul 15 17:28:31.262911 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.262673    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27051d12-1535-4b30-9458-d9596c5f5444" containerName="revoke-keys"
Jul 15 17:28:31.262911 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.262683    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="27051d12-1535-4b30-9458-d9596c5f5444" containerName="revoke-keys"
Jul 15 17:28:31.262911 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.262706    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27051d12-1535-4b30-9458-d9596c5f5444" containerName="revoke-keys"
Jul 15 17:28:31.262911 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.262726    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="27051d12-1535-4b30-9458-d9596c5f5444" containerName="revoke-keys"
Jul 15 17:28:31.262911 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.262778    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="27051d12-1535-4b30-9458-d9596c5f5444" containerName="revoke-keys"
Jul 15 17:28:31.262911 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.262785    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="27051d12-1535-4b30-9458-d9596c5f5444" containerName="revoke-keys"
Jul 15 17:28:31.262911 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.262793    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="27051d12-1535-4b30-9458-d9596c5f5444" containerName="revoke-keys"
Jul 15 17:28:31.265308 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.265292    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l"
Jul 15 17:28:31.267992 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.267967    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:28:31.272971 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.272944    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l"]
Jul 15 17:28:31.362495 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.362456    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfa99769-48c0-40b8-bec6-47656783d48c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l\" (UID: \"dfa99769-48c0-40b8-bec6-47656783d48c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l"
Jul 15 17:28:31.463172 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.463132    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfa99769-48c0-40b8-bec6-47656783d48c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l\" (UID: \"dfa99769-48c0-40b8-bec6-47656783d48c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l"
Jul 15 17:28:31.463804 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.463786    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfa99769-48c0-40b8-bec6-47656783d48c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l\" (UID: \"dfa99769-48c0-40b8-bec6-47656783d48c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l"
Jul 15 17:28:31.576617 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.576533    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l"
Jul 15 17:28:31.709514 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.709488    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l"]
Jul 15 17:28:31.711866 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:28:31.711841    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa99769_48c0_40b8_bec6_47656783d48c.slice/crio-c32c6f31882774dde7987f93765ada90bf13235e4717eb261aa9477fb0d079f2 WatchSource:0}: Error finding container c32c6f31882774dde7987f93765ada90bf13235e4717eb261aa9477fb0d079f2: Status 404 returned error can't find the container with id c32c6f31882774dde7987f93765ada90bf13235e4717eb261aa9477fb0d079f2
Jul 15 17:28:31.961655 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:31.961618    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l" event={"ID":"dfa99769-48c0-40b8-bec6-47656783d48c","Type":"ContainerStarted","Data":"c32c6f31882774dde7987f93765ada90bf13235e4717eb261aa9477fb0d079f2"}
Jul 15 17:28:32.968254 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:32.968217    2556 generic.go:356] "Generic (PLEG): container finished" podID="dfa99769-48c0-40b8-bec6-47656783d48c" containerID="afe426a06e90194a976acafe9df1957c4a88edf4f529b22282d627ad220d68be" exitCode=0
Jul 15 17:28:32.968656 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:32.968267    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l" event={"ID":"dfa99769-48c0-40b8-bec6-47656783d48c","Type":"ContainerDied","Data":"afe426a06e90194a976acafe9df1957c4a88edf4f529b22282d627ad220d68be"}
Jul 15 17:28:34.097444 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:34.097419    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l"
Jul 15 17:28:34.190553 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:34.190510    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfa99769-48c0-40b8-bec6-47656783d48c-maas-api-service-ca\") pod \"dfa99769-48c0-40b8-bec6-47656783d48c\" (UID: \"dfa99769-48c0-40b8-bec6-47656783d48c\") "
Jul 15 17:28:34.190952 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:34.190923    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfa99769-48c0-40b8-bec6-47656783d48c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dfa99769-48c0-40b8-bec6-47656783d48c" (UID: "dfa99769-48c0-40b8-bec6-47656783d48c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:28:34.291406 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:34.291322    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfa99769-48c0-40b8-bec6-47656783d48c-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:28:34.978423 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:34.978391    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l"
Jul 15 17:28:34.978568 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:34.978393    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l" event={"ID":"dfa99769-48c0-40b8-bec6-47656783d48c","Type":"ContainerDied","Data":"c32c6f31882774dde7987f93765ada90bf13235e4717eb261aa9477fb0d079f2"}
Jul 15 17:28:34.978568 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:28:34.978524    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c32c6f31882774dde7987f93765ada90bf13235e4717eb261aa9477fb0d079f2"
Jul 15 17:29:03.202231 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.202194    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"]
Jul 15 17:29:03.202671 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.202521    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27051d12-1535-4b30-9458-d9596c5f5444" containerName="revoke-keys"
Jul 15 17:29:03.202671 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.202531    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="27051d12-1535-4b30-9458-d9596c5f5444" containerName="revoke-keys"
Jul 15 17:29:03.202671 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.202550    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa99769-48c0-40b8-bec6-47656783d48c" containerName="revoke-keys"
Jul 15 17:29:03.202671 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.202555    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa99769-48c0-40b8-bec6-47656783d48c" containerName="revoke-keys"
Jul 15 17:29:03.202671 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.202605    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa99769-48c0-40b8-bec6-47656783d48c" containerName="revoke-keys"
Jul 15 17:29:03.205662 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.205644    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"
Jul 15 17:29:03.208772 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.208748    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:29:03.214901 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.214875    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"]
Jul 15 17:29:03.346380 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.346329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3814d5d0-26c8-4249-aaa1-498465e6995f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z\" (UID: \"3814d5d0-26c8-4249-aaa1-498465e6995f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"
Jul 15 17:29:03.447337 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.447294    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3814d5d0-26c8-4249-aaa1-498465e6995f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z\" (UID: \"3814d5d0-26c8-4249-aaa1-498465e6995f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"
Jul 15 17:29:03.448009 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.447982    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3814d5d0-26c8-4249-aaa1-498465e6995f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z\" (UID: \"3814d5d0-26c8-4249-aaa1-498465e6995f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"
Jul 15 17:29:03.517578 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.517540    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"
Jul 15 17:29:03.648855 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:03.648827    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"]
Jul 15 17:29:03.650886 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:29:03.650845    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3814d5d0_26c8_4249_aaa1_498465e6995f.slice/crio-1a083cdfe449d82bfe5babbc9d7f3be389d94af2606d7dfd324289346b1a49c5 WatchSource:0}: Error finding container 1a083cdfe449d82bfe5babbc9d7f3be389d94af2606d7dfd324289346b1a49c5: Status 404 returned error can't find the container with id 1a083cdfe449d82bfe5babbc9d7f3be389d94af2606d7dfd324289346b1a49c5
Jul 15 17:29:04.114044 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:04.114003    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z" event={"ID":"3814d5d0-26c8-4249-aaa1-498465e6995f","Type":"ContainerStarted","Data":"cc005a604325bd5d322b3b89d4ef9e6ed4a03a2a9304eb5766b44859139e84d5"}
Jul 15 17:29:04.114212 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:04.114069    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z" event={"ID":"3814d5d0-26c8-4249-aaa1-498465e6995f","Type":"ContainerStarted","Data":"1a083cdfe449d82bfe5babbc9d7f3be389d94af2606d7dfd324289346b1a49c5"}
Jul 15 17:29:04.134023 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:04.133964    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z" podStartSLOduration=1.133943653 podStartE2EDuration="1.133943653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:29:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:29:04.131207362 +0000 UTC m=+1800.288622189" watchObservedRunningTime="2026-07-15 17:29:04.133943653 +0000 UTC m=+1800.291358445"
Jul 15 17:29:04.327093 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:04.327066    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:29:04.330390 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:04.330369    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:29:05.119422 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:05.119389    2556 generic.go:356] "Generic (PLEG): container finished" podID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerID="cc005a604325bd5d322b3b89d4ef9e6ed4a03a2a9304eb5766b44859139e84d5" exitCode=7
Jul 15 17:29:05.119598 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:05.119447    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z" event={"ID":"3814d5d0-26c8-4249-aaa1-498465e6995f","Type":"ContainerDied","Data":"cc005a604325bd5d322b3b89d4ef9e6ed4a03a2a9304eb5766b44859139e84d5"}
Jul 15 17:29:05.119674 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:05.119662    2556 scope.go:117] "RemoveContainer" containerID="cc005a604325bd5d322b3b89d4ef9e6ed4a03a2a9304eb5766b44859139e84d5"
Jul 15 17:29:06.125835 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:06.125800    2556 generic.go:356] "Generic (PLEG): container finished" podID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerID="aadf7148040f9bff16c747a13f7ed6273b48a5d4374ad1dd6db0c06ca01d2415" exitCode=7
Jul 15 17:29:06.126239 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:06.125883    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z" event={"ID":"3814d5d0-26c8-4249-aaa1-498465e6995f","Type":"ContainerDied","Data":"aadf7148040f9bff16c747a13f7ed6273b48a5d4374ad1dd6db0c06ca01d2415"}
Jul 15 17:29:06.126239 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:06.125943    2556 scope.go:117] "RemoveContainer" containerID="cc005a604325bd5d322b3b89d4ef9e6ed4a03a2a9304eb5766b44859139e84d5"
Jul 15 17:29:06.126239 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:06.126138    2556 scope.go:117] "RemoveContainer" containerID="aadf7148040f9bff16c747a13f7ed6273b48a5d4374ad1dd6db0c06ca01d2415"
Jul 15 17:29:06.126373 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:29:06.126354    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z_odh-ai-gateway-infra(3814d5d0-26c8-4249-aaa1-498465e6995f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f"
Jul 15 17:29:07.132624 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:07.132597    2556 scope.go:117] "RemoveContainer" containerID="aadf7148040f9bff16c747a13f7ed6273b48a5d4374ad1dd6db0c06ca01d2415"
Jul 15 17:29:07.133029 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:29:07.132837    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z_odh-ai-gateway-infra(3814d5d0-26c8-4249-aaa1-498465e6995f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f"
Jul 15 17:29:21.359704 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:21.359672    2556 scope.go:117] "RemoveContainer" containerID="aadf7148040f9bff16c747a13f7ed6273b48a5d4374ad1dd6db0c06ca01d2415"
Jul 15 17:29:22.206333 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:22.206301    2556 generic.go:356] "Generic (PLEG): container finished" podID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerID="1f540f05829a974af02017c264caaae8f60f4399c81714d6877faf6ce7283148" exitCode=0
Jul 15 17:29:22.206511 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:22.206343    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z" event={"ID":"3814d5d0-26c8-4249-aaa1-498465e6995f","Type":"ContainerDied","Data":"1f540f05829a974af02017c264caaae8f60f4399c81714d6877faf6ce7283148"}
Jul 15 17:29:22.206511 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:22.206397    2556 scope.go:117] "RemoveContainer" containerID="aadf7148040f9bff16c747a13f7ed6273b48a5d4374ad1dd6db0c06ca01d2415"
Jul 15 17:29:23.241005 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:23.240918    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"]
Jul 15 17:29:23.347495 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:23.347463    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"
Jul 15 17:29:23.524907 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:23.524872    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3814d5d0-26c8-4249-aaa1-498465e6995f-maas-api-service-ca\") pod \"3814d5d0-26c8-4249-aaa1-498465e6995f\" (UID: \"3814d5d0-26c8-4249-aaa1-498465e6995f\") "
Jul 15 17:29:23.525250 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:23.525227    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3814d5d0-26c8-4249-aaa1-498465e6995f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3814d5d0-26c8-4249-aaa1-498465e6995f" (UID: "3814d5d0-26c8-4249-aaa1-498465e6995f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:29:23.626525 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:23.626481    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3814d5d0-26c8-4249-aaa1-498465e6995f-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:29:24.224216 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:24.224176    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z" event={"ID":"3814d5d0-26c8-4249-aaa1-498465e6995f","Type":"ContainerDied","Data":"1a083cdfe449d82bfe5babbc9d7f3be389d94af2606d7dfd324289346b1a49c5"}
Jul 15 17:29:24.224216 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:24.224207    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"
Jul 15 17:29:24.224424 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:24.224258    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a083cdfe449d82bfe5babbc9d7f3be389d94af2606d7dfd324289346b1a49c5"
Jul 15 17:29:24.254095 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:24.254013    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"]
Jul 15 17:29:24.256008 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:24.255982    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-8zb9z"]
Jul 15 17:29:24.365486 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:29:24.365451    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f" path="/var/lib/kubelet/pods/3814d5d0-26c8-4249-aaa1-498465e6995f/volumes"
Jul 15 17:30:00.144987 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.144944    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735610-tbflb"]
Jul 15 17:30:00.145585 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.145453    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerName="revoke-keys"
Jul 15 17:30:00.145585 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.145473    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerName="revoke-keys"
Jul 15 17:30:00.145585 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.145488    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerName="revoke-keys"
Jul 15 17:30:00.145585 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.145497    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerName="revoke-keys"
Jul 15 17:30:00.145585 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.145585    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerName="revoke-keys"
Jul 15 17:30:00.145891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.145598    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerName="revoke-keys"
Jul 15 17:30:00.145891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.145607    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerName="revoke-keys"
Jul 15 17:30:00.148814 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.148789    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw"]
Jul 15 17:30:00.148948 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.148906    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-tbflb"
Jul 15 17:30:00.149142 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.149126    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerName="revoke-keys"
Jul 15 17:30:00.149211 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.149146    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3814d5d0-26c8-4249-aaa1-498465e6995f" containerName="revoke-keys"
Jul 15 17:30:00.151485 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.151467    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:30:00.152016 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.152001    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw"
Jul 15 17:30:00.157729 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.157683    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735610-tbflb"]
Jul 15 17:30:00.160514 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.160491    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw"]
Jul 15 17:30:00.161561 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.161540    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-tbflb"
Jul 15 17:30:00.168953 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.168931    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw"
Jul 15 17:30:00.312491 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.312456    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw"]
Jul 15 17:30:00.316370 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:30:00.316323    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode798a982_c0a5_4743_9a59_c17ae6707430.slice/crio-97de200ebc95b3756cf0021005b64414fbbd8da2c3c6111a2d1e87c68b91a977 WatchSource:0}: Error finding container 97de200ebc95b3756cf0021005b64414fbbd8da2c3c6111a2d1e87c68b91a977: Status 404 returned error can't find the container with id 97de200ebc95b3756cf0021005b64414fbbd8da2c3c6111a2d1e87c68b91a977
Jul 15 17:30:00.337731 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.337689    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735610-tbflb"]
Jul 15 17:30:00.339293 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:30:00.339265    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ead599_5e69_4677_adb3_6e86907e274f.slice/crio-d99259be1215888b77f0c38f5f02b74dd20df11878f87847af98c9cd5057d281 WatchSource:0}: Error finding container d99259be1215888b77f0c38f5f02b74dd20df11878f87847af98c9cd5057d281: Status 404 returned error can't find the container with id d99259be1215888b77f0c38f5f02b74dd20df11878f87847af98c9cd5057d281
Jul 15 17:30:00.391271 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.391234    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw" event={"ID":"e798a982-c0a5-4743-9a59-c17ae6707430","Type":"ContainerStarted","Data":"97de200ebc95b3756cf0021005b64414fbbd8da2c3c6111a2d1e87c68b91a977"}
Jul 15 17:30:00.392343 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:00.392314    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-tbflb" event={"ID":"f8ead599-5e69-4677-adb3-6e86907e274f","Type":"ContainerStarted","Data":"d99259be1215888b77f0c38f5f02b74dd20df11878f87847af98c9cd5057d281"}
Jul 15 17:30:01.398481 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:01.398447    2556 generic.go:356] "Generic (PLEG): container finished" podID="f8ead599-5e69-4677-adb3-6e86907e274f" containerID="3fbb76526bff82b5e6ea0b09b5536abf9674571eda19343bd412f7e9a30e2c4f" exitCode=0
Jul 15 17:30:01.398905 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:01.398531    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-tbflb" event={"ID":"f8ead599-5e69-4677-adb3-6e86907e274f","Type":"ContainerDied","Data":"3fbb76526bff82b5e6ea0b09b5536abf9674571eda19343bd412f7e9a30e2c4f"}
Jul 15 17:30:01.400225 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:01.400197    2556 generic.go:356] "Generic (PLEG): container finished" podID="e798a982-c0a5-4743-9a59-c17ae6707430" containerID="e816ab1c3c681c355cf05b0d4a4cca1a6b30a55779a1b187e0568e63c9dfd6fd" exitCode=0
Jul 15 17:30:01.400349 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:01.400241    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw" event={"ID":"e798a982-c0a5-4743-9a59-c17ae6707430","Type":"ContainerDied","Data":"e816ab1c3c681c355cf05b0d4a4cca1a6b30a55779a1b187e0568e63c9dfd6fd"}
Jul 15 17:30:02.531744 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:02.531700    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-tbflb"
Jul 15 17:30:02.563085 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:02.563057    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw"
Jul 15 17:30:03.265723 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.265678    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg"]
Jul 15 17:30:03.266040 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.266026    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e798a982-c0a5-4743-9a59-c17ae6707430" containerName="cleanup"
Jul 15 17:30:03.266085 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.266041    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e798a982-c0a5-4743-9a59-c17ae6707430" containerName="cleanup"
Jul 15 17:30:03.266085 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.266058    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ead599-5e69-4677-adb3-6e86907e274f" containerName="cleanup"
Jul 15 17:30:03.266085 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.266064    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ead599-5e69-4677-adb3-6e86907e274f" containerName="cleanup"
Jul 15 17:30:03.266171 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.266113    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e798a982-c0a5-4743-9a59-c17ae6707430" containerName="cleanup"
Jul 15 17:30:03.266171 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.266121    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8ead599-5e69-4677-adb3-6e86907e274f" containerName="cleanup"
Jul 15 17:30:03.269031 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.269011    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg"
Jul 15 17:30:03.278979 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.278944    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg"]
Jul 15 17:30:03.368207 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.368166    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c13226-7c13-4018-83b3-24fe9843afbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6feb2776-7nglg\" (UID: \"f5c13226-7c13-4018-83b3-24fe9843afbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg"
Jul 15 17:30:03.411551 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.411511    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-tbflb"
Jul 15 17:30:03.411772 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.411552    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-tbflb" event={"ID":"f8ead599-5e69-4677-adb3-6e86907e274f","Type":"ContainerDied","Data":"d99259be1215888b77f0c38f5f02b74dd20df11878f87847af98c9cd5057d281"}
Jul 15 17:30:03.411772 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.411606    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d99259be1215888b77f0c38f5f02b74dd20df11878f87847af98c9cd5057d281"
Jul 15 17:30:03.412859 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.412829    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw" event={"ID":"e798a982-c0a5-4743-9a59-c17ae6707430","Type":"ContainerDied","Data":"97de200ebc95b3756cf0021005b64414fbbd8da2c3c6111a2d1e87c68b91a977"}
Jul 15 17:30:03.412971 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.412878    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97de200ebc95b3756cf0021005b64414fbbd8da2c3c6111a2d1e87c68b91a977"
Jul 15 17:30:03.412971 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.412836    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw"
Jul 15 17:30:03.468914 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.468874    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c13226-7c13-4018-83b3-24fe9843afbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6feb2776-7nglg\" (UID: \"f5c13226-7c13-4018-83b3-24fe9843afbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg"
Jul 15 17:30:03.469487 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.469470    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c13226-7c13-4018-83b3-24fe9843afbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6feb2776-7nglg\" (UID: \"f5c13226-7c13-4018-83b3-24fe9843afbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg"
Jul 15 17:30:03.579116 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.579025    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg"
Jul 15 17:30:03.711454 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:03.711421    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg"]
Jul 15 17:30:03.714538 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:30:03.714511    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c13226_7c13_4018_83b3_24fe9843afbb.slice/crio-0d75ec02e7e7ba5a8d96a9f6bdf85bddb63c404de4cc3842ce02e6d119e5bd4c WatchSource:0}: Error finding container 0d75ec02e7e7ba5a8d96a9f6bdf85bddb63c404de4cc3842ce02e6d119e5bd4c: Status 404 returned error can't find the container with id 0d75ec02e7e7ba5a8d96a9f6bdf85bddb63c404de4cc3842ce02e6d119e5bd4c
Jul 15 17:30:04.418966 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:04.418932    2556 generic.go:356] "Generic (PLEG): container finished" podID="f5c13226-7c13-4018-83b3-24fe9843afbb" containerID="8d5eb875a4ea03957db11f69ff6aa55daf940e070a4be3ef231d1cda24528744" exitCode=0
Jul 15 17:30:04.419160 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:04.419024    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg" event={"ID":"f5c13226-7c13-4018-83b3-24fe9843afbb","Type":"ContainerDied","Data":"8d5eb875a4ea03957db11f69ff6aa55daf940e070a4be3ef231d1cda24528744"}
Jul 15 17:30:04.419160 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:04.419071    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg" event={"ID":"f5c13226-7c13-4018-83b3-24fe9843afbb","Type":"ContainerStarted","Data":"0d75ec02e7e7ba5a8d96a9f6bdf85bddb63c404de4cc3842ce02e6d119e5bd4c"}
Jul 15 17:30:05.554088 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:05.554065    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg"
Jul 15 17:30:05.690205 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:05.690107    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c13226-7c13-4018-83b3-24fe9843afbb-maas-api-service-ca\") pod \"f5c13226-7c13-4018-83b3-24fe9843afbb\" (UID: \"f5c13226-7c13-4018-83b3-24fe9843afbb\") "
Jul 15 17:30:05.690548 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:05.690518    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5c13226-7c13-4018-83b3-24fe9843afbb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f5c13226-7c13-4018-83b3-24fe9843afbb" (UID: "f5c13226-7c13-4018-83b3-24fe9843afbb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:30:05.791420 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:05.791377    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c13226-7c13-4018-83b3-24fe9843afbb-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:30:06.430062 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:06.430026    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg" event={"ID":"f5c13226-7c13-4018-83b3-24fe9843afbb","Type":"ContainerDied","Data":"0d75ec02e7e7ba5a8d96a9f6bdf85bddb63c404de4cc3842ce02e6d119e5bd4c"}
Jul 15 17:30:06.430254 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:06.430085    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d75ec02e7e7ba5a8d96a9f6bdf85bddb63c404de4cc3842ce02e6d119e5bd4c"
Jul 15 17:30:06.430254 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:06.430038    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6feb2776-7nglg"
Jul 15 17:30:13.773280 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:13.773245    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw"]
Jul 15 17:30:13.776352 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:13.776330    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-6feb2776-29735610-kppjw"]
Jul 15 17:30:14.365404 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:30:14.365370    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e798a982-c0a5-4743-9a59-c17ae6707430" path="/var/lib/kubelet/pods/e798a982-c0a5-4743-9a59-c17ae6707430/volumes"
Jul 15 17:32:04.386762 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:04.386733    2556 scope.go:117] "RemoveContainer" containerID="5039750707c491f9be65f30b8a2c33a25e61306db1311564629a446d65cec8a3"
Jul 15 17:32:18.998677 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:18.998642    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld"]
Jul 15 17:32:19.000280 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:18.999662    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5c13226-7c13-4018-83b3-24fe9843afbb" containerName="revoke-keys"
Jul 15 17:32:19.000280 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:18.999695    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5c13226-7c13-4018-83b3-24fe9843afbb" containerName="revoke-keys"
Jul 15 17:32:19.000280 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:18.999904    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5c13226-7c13-4018-83b3-24fe9843afbb" containerName="revoke-keys"
Jul 15 17:32:19.006114 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:19.006089    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld"
Jul 15 17:32:19.009052 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:19.009010    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:32:19.010878 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:19.010852    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld"]
Jul 15 17:32:19.057638 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:19.057605    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2048b624-0216-4997-8069-26a02ec88163-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld\" (UID: \"2048b624-0216-4997-8069-26a02ec88163\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld"
Jul 15 17:32:19.158555 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:19.158506    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2048b624-0216-4997-8069-26a02ec88163-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld\" (UID: \"2048b624-0216-4997-8069-26a02ec88163\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld"
Jul 15 17:32:19.159172 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:19.159152    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2048b624-0216-4997-8069-26a02ec88163-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld\" (UID: \"2048b624-0216-4997-8069-26a02ec88163\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld"
Jul 15 17:32:19.319127 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:19.319037    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld"
Jul 15 17:32:19.447926 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:19.447902    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld"]
Jul 15 17:32:19.449932 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:32:19.449903    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2048b624_0216_4997_8069_26a02ec88163.slice/crio-3354f373cec208278c086a413d5e75ecbbe1f7e1199b92425a73568972baac3f WatchSource:0}: Error finding container 3354f373cec208278c086a413d5e75ecbbe1f7e1199b92425a73568972baac3f: Status 404 returned error can't find the container with id 3354f373cec208278c086a413d5e75ecbbe1f7e1199b92425a73568972baac3f
Jul 15 17:32:20.053751 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:20.053698    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld" event={"ID":"2048b624-0216-4997-8069-26a02ec88163","Type":"ContainerStarted","Data":"6fd6bdfc3fc69cf9f7c1b07ab3f0ffcdf0349fc2afa9596ebd8b925879a1d560"}
Jul 15 17:32:20.054125 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:20.053771    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld" event={"ID":"2048b624-0216-4997-8069-26a02ec88163","Type":"ContainerStarted","Data":"3354f373cec208278c086a413d5e75ecbbe1f7e1199b92425a73568972baac3f"}
Jul 15 17:32:20.069752 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:20.069685    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld" podStartSLOduration=2.069668531 podStartE2EDuration="2.069668531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:32:20.069249171 +0000 UTC m=+1996.226663987" watchObservedRunningTime="2026-07-15 17:32:20.069668531 +0000 UTC m=+1996.227083348"
Jul 15 17:32:21.059840 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:21.059805    2556 generic.go:356] "Generic (PLEG): container finished" podID="2048b624-0216-4997-8069-26a02ec88163" containerID="6fd6bdfc3fc69cf9f7c1b07ab3f0ffcdf0349fc2afa9596ebd8b925879a1d560" exitCode=0
Jul 15 17:32:21.060277 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:21.059892    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld" event={"ID":"2048b624-0216-4997-8069-26a02ec88163","Type":"ContainerDied","Data":"6fd6bdfc3fc69cf9f7c1b07ab3f0ffcdf0349fc2afa9596ebd8b925879a1d560"}
Jul 15 17:32:22.192100 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:22.192078    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld"
Jul 15 17:32:22.286495 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:22.286457    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2048b624-0216-4997-8069-26a02ec88163-maas-api-service-ca\") pod \"2048b624-0216-4997-8069-26a02ec88163\" (UID: \"2048b624-0216-4997-8069-26a02ec88163\") "
Jul 15 17:32:22.286851 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:22.286830    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2048b624-0216-4997-8069-26a02ec88163-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2048b624-0216-4997-8069-26a02ec88163" (UID: "2048b624-0216-4997-8069-26a02ec88163"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:32:22.388004 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:22.387977    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2048b624-0216-4997-8069-26a02ec88163-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:32:23.070478 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:23.070453    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld"
Jul 15 17:32:23.070640 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:23.070443    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld" event={"ID":"2048b624-0216-4997-8069-26a02ec88163","Type":"ContainerDied","Data":"3354f373cec208278c086a413d5e75ecbbe1f7e1199b92425a73568972baac3f"}
Jul 15 17:32:23.070640 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:32:23.070580    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3354f373cec208278c086a413d5e75ecbbe1f7e1199b92425a73568972baac3f"
Jul 15 17:33:04.405606 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:04.405568    2556 scope.go:117] "RemoveContainer" containerID="4cd686aaa2bdaf0dc8466e56d6a6385ebb7b82bd9056c51c374cffd20be9d30b"
Jul 15 17:33:23.146472 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.146438    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"]
Jul 15 17:33:23.146948 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.146812    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2048b624-0216-4997-8069-26a02ec88163" containerName="revoke-keys"
Jul 15 17:33:23.146948 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.146841    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2048b624-0216-4997-8069-26a02ec88163" containerName="revoke-keys"
Jul 15 17:33:23.146948 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.146898    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2048b624-0216-4997-8069-26a02ec88163" containerName="revoke-keys"
Jul 15 17:33:23.150056 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.150038    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.152997 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.152949    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6a6deab7\"/\"default-dockercfg-sp2xg\""
Jul 15 17:33:23.153237 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.153210    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6a6deab7\"/\"openshift-service-ca.crt\""
Jul 15 17:33:23.153998 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.153982    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6a6deab7\"/\"kube-root-ca.crt\""
Jul 15 17:33:23.154338 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.154323    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6a6deab7\"/\"e2e-lifecycle-model-6a6deab7-kserve-self-signed-certs\""
Jul 15 17:33:23.163404 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.163383    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"]
Jul 15 17:33:23.310936 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.310899    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6c49\" (UniqueName: \"kubernetes.io/projected/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-kube-api-access-q6c49\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.311123 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.310945    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tmp-dir\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.311123 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.310964    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tls-certs\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.311123 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.311044    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-dshm\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.311123 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.311085    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-home\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.311252 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.311150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-model-cache\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.412409 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.412327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-home\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.412409 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.412383    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-model-cache\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.412409 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.412410    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6c49\" (UniqueName: \"kubernetes.io/projected/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-kube-api-access-q6c49\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.412636 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.412521    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tmp-dir\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.412636 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.412562    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tls-certs\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.412636 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.412624    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-dshm\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.412833 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.412817    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-model-cache\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.412889 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.412851    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-home\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.412945 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.412922    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tmp-dir\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.414834 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.414810    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-dshm\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.415059 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.415038    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tls-certs\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.423389 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.423369    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6c49\" (UniqueName: \"kubernetes.io/projected/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-kube-api-access-q6c49\") pod \"e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") " pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.459357 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.459334    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:23.602159 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:23.602134    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"]
Jul 15 17:33:23.604895 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:33:23.604870    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78f9a7d6_7f30_48ff_b9bd_583b2938b8ef.slice/crio-21ee272900c2f843b6d13655931027427ec5d6f9544365df28317822e432d428 WatchSource:0}: Error finding container 21ee272900c2f843b6d13655931027427ec5d6f9544365df28317822e432d428: Status 404 returned error can't find the container with id 21ee272900c2f843b6d13655931027427ec5d6f9544365df28317822e432d428
Jul 15 17:33:24.364686 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:24.364650    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm" event={"ID":"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef","Type":"ContainerStarted","Data":"d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb"}
Jul 15 17:33:24.365072 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:24.364695    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm" event={"ID":"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef","Type":"ContainerStarted","Data":"21ee272900c2f843b6d13655931027427ec5d6f9544365df28317822e432d428"}
Jul 15 17:33:24.385533 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:24.385480    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm" podStartSLOduration=1.385465836 podStartE2EDuration="1.385465836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:33:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:33:24.384310137 +0000 UTC m=+2060.541724952" watchObservedRunningTime="2026-07-15 17:33:24.385465836 +0000 UTC m=+2060.542880649"
Jul 15 17:33:33.460528 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:33.460444    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:33.460935 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:33.460522    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:33.472816 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:33.472795    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:34.418811 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:34.418782    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:33:50.207213 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:50.207175    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7"]
Jul 15 17:33:50.210589 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:50.210569    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7"
Jul 15 17:33:50.213100 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:50.213077    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:33:50.219101 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:50.219079    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7"]
Jul 15 17:33:50.249541 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:50.249509    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32c1952c-77b3-48be-8704-242b1846f896-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7\" (UID: \"32c1952c-77b3-48be-8704-242b1846f896\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7"
Jul 15 17:33:50.350489 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:50.350449    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32c1952c-77b3-48be-8704-242b1846f896-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7\" (UID: \"32c1952c-77b3-48be-8704-242b1846f896\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7"
Jul 15 17:33:50.351142 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:50.351114    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32c1952c-77b3-48be-8704-242b1846f896-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7\" (UID: \"32c1952c-77b3-48be-8704-242b1846f896\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7"
Jul 15 17:33:50.523289 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:50.523256    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7"
Jul 15 17:33:50.648164 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:50.648140    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7"]
Jul 15 17:33:50.650165 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:33:50.650135    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c1952c_77b3_48be_8704_242b1846f896.slice/crio-c17dc162d9a283835b885ff4661dd25e5825d0215c04f508b72812f110004202 WatchSource:0}: Error finding container c17dc162d9a283835b885ff4661dd25e5825d0215c04f508b72812f110004202: Status 404 returned error can't find the container with id c17dc162d9a283835b885ff4661dd25e5825d0215c04f508b72812f110004202
Jul 15 17:33:51.490596 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:51.490561    2556 generic.go:356] "Generic (PLEG): container finished" podID="32c1952c-77b3-48be-8704-242b1846f896" containerID="dc91e2062bb5f1c1b589eeaefe8ef5d0f5636dd97eb3731a91a6dc1f23a1cfb8" exitCode=0
Jul 15 17:33:51.491018 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:51.490637    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7" event={"ID":"32c1952c-77b3-48be-8704-242b1846f896","Type":"ContainerDied","Data":"dc91e2062bb5f1c1b589eeaefe8ef5d0f5636dd97eb3731a91a6dc1f23a1cfb8"}
Jul 15 17:33:51.491018 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:51.490702    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7" event={"ID":"32c1952c-77b3-48be-8704-242b1846f896","Type":"ContainerStarted","Data":"c17dc162d9a283835b885ff4661dd25e5825d0215c04f508b72812f110004202"}
Jul 15 17:33:52.623604 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:52.623580    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7"
Jul 15 17:33:52.671886 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:52.671857    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32c1952c-77b3-48be-8704-242b1846f896-maas-api-service-ca\") pod \"32c1952c-77b3-48be-8704-242b1846f896\" (UID: \"32c1952c-77b3-48be-8704-242b1846f896\") "
Jul 15 17:33:52.672182 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:52.672156    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32c1952c-77b3-48be-8704-242b1846f896-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "32c1952c-77b3-48be-8704-242b1846f896" (UID: "32c1952c-77b3-48be-8704-242b1846f896"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:33:52.772615 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:52.772532    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32c1952c-77b3-48be-8704-242b1846f896-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:33:53.501473 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:53.501440    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7" event={"ID":"32c1952c-77b3-48be-8704-242b1846f896","Type":"ContainerDied","Data":"c17dc162d9a283835b885ff4661dd25e5825d0215c04f508b72812f110004202"}
Jul 15 17:33:53.501640 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:53.501495    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c17dc162d9a283835b885ff4661dd25e5825d0215c04f508b72812f110004202"
Jul 15 17:33:53.501640 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:33:53.501526    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7"
Jul 15 17:34:04.357498 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:04.357458    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:34:04.368565 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:04.368544    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:34:04.423771 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:04.423748    2556 scope.go:117] "RemoveContainer" containerID="0ebd08bcf7bd1709cbf5dc79527f6c429dcd2e58d1c4d1df69f74a7eeaeb0a37"
Jul 15 17:34:10.294766 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:10.294729    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"]
Jul 15 17:34:25.315759 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.315676    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm" podUID="78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" containerName="main" containerID="cri-o://d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb" gracePeriod=45
Jul 15 17:34:25.567072 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.566997    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:34:25.654627 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.654597    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tls-certs\") pod \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") "
Jul 15 17:34:25.654836 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.654697    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-model-cache\") pod \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") "
Jul 15 17:34:25.654836 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.654755    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6c49\" (UniqueName: \"kubernetes.io/projected/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-kube-api-access-q6c49\") pod \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") "
Jul 15 17:34:25.654836 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.654799    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tmp-dir\") pod \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") "
Jul 15 17:34:25.654836 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.654820    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-home\") pod \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") "
Jul 15 17:34:25.655087 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.654862    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-dshm\") pod \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\" (UID: \"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef\") "
Jul 15 17:34:25.655087 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.654964    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" (UID: "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:34:25.655195 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.655138    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-home" (OuterVolumeSpecName: "home") pod "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" (UID: "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:34:25.655195 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.655151    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-model-cache\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:34:25.655460 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.655406    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" (UID: "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:34:25.655979 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.655955    2556 generic.go:356] "Generic (PLEG): container finished" podID="78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" containerID="d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb" exitCode=0
Jul 15 17:34:25.656071 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.656016    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"
Jul 15 17:34:25.656071 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.656037    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm" event={"ID":"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef","Type":"ContainerDied","Data":"d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb"}
Jul 15 17:34:25.656163 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.656085    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm" event={"ID":"78f9a7d6-7f30-48ff-b9bd-583b2938b8ef","Type":"ContainerDied","Data":"21ee272900c2f843b6d13655931027427ec5d6f9544365df28317822e432d428"}
Jul 15 17:34:25.656163 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.656107    2556 scope.go:117] "RemoveContainer" containerID="d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb"
Jul 15 17:34:25.657231 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.657197    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" (UID: "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:34:25.657336 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.657315    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-dshm" (OuterVolumeSpecName: "dshm") pod "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" (UID: "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:34:25.657421 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.657348    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-kube-api-access-q6c49" (OuterVolumeSpecName: "kube-api-access-q6c49") pod "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" (UID: "78f9a7d6-7f30-48ff-b9bd-583b2938b8ef"). InnerVolumeSpecName "kube-api-access-q6c49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:34:25.673471 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.673448    2556 scope.go:117] "RemoveContainer" containerID="d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb"
Jul 15 17:34:25.673796 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:34:25.673777    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb\": container with ID starting with d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb not found: ID does not exist" containerID="d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb"
Jul 15 17:34:25.673868 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.673811    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb"} err="failed to get container status \"d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb\": rpc error: code = NotFound desc = could not find container \"d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb\": container with ID starting with d62bb508ff926771fd78d1ed2930ded00cf0108c59d8939f0a6a6f41c1cd40fb not found: ID does not exist"
Jul 15 17:34:25.755901 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.755863    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6c49\" (UniqueName: \"kubernetes.io/projected/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-kube-api-access-q6c49\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:34:25.755901 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.755894    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tmp-dir\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:34:25.755901 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.755906    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-home\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:34:25.755901 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.755914    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-dshm\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:34:25.756161 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.755922    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef-tls-certs\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:34:25.978452 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.978424    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"]
Jul 15 17:34:25.984450 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:25.984426    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-6a6deab7/e2e-lifecycle-model-6a6deab7-kserve-75c98dbb9f-zf6fm"]
Jul 15 17:34:26.365937 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:34:26.365903    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" path="/var/lib/kubelet/pods/78f9a7d6-7f30-48ff-b9bd-583b2938b8ef/volumes"
Jul 15 17:36:03.506462 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.506428    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"]
Jul 15 17:36:03.506930 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.506914    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" containerName="main"
Jul 15 17:36:03.506987 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.506933    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" containerName="main"
Jul 15 17:36:03.506987 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.506945    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32c1952c-77b3-48be-8704-242b1846f896" containerName="revoke-keys"
Jul 15 17:36:03.506987 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.506954    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="32c1952c-77b3-48be-8704-242b1846f896" containerName="revoke-keys"
Jul 15 17:36:03.507085 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.507060    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="32c1952c-77b3-48be-8704-242b1846f896" containerName="revoke-keys"
Jul 15 17:36:03.507085 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.507076    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="78f9a7d6-7f30-48ff-b9bd-583b2938b8ef" containerName="main"
Jul 15 17:36:03.510769 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.510749    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:03.513582 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.513562    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-97jqt\""
Jul 15 17:36:03.513868 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.513850    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-47c774-serving-cert\""
Jul 15 17:36:03.523962 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.523936    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"]
Jul 15 17:36:03.612282 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.612253    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj9r6\" (UniqueName: \"kubernetes.io/projected/a2a5d459-3962-40c2-ba95-0ab57f0f4126-kube-api-access-hj9r6\") pod \"maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:03.612417 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.612308    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2a5d459-3962-40c2-ba95-0ab57f0f4126-maas-api-tls\") pod \"maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:03.612417 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.612361    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a5d459-3962-40c2-ba95-0ab57f0f4126-openshift-service-ca\") pod \"maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:03.713454 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.713424    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2a5d459-3962-40c2-ba95-0ab57f0f4126-maas-api-tls\") pod \"maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:03.713604 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.713476    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a5d459-3962-40c2-ba95-0ab57f0f4126-openshift-service-ca\") pod \"maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:03.713604 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.713521    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj9r6\" (UniqueName: \"kubernetes.io/projected/a2a5d459-3962-40c2-ba95-0ab57f0f4126-kube-api-access-hj9r6\") pod \"maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:03.713604 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:36:03.713577    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-serving-cert: secret "maas-api-e2e-inf-b-47c774-serving-cert" not found
Jul 15 17:36:03.713770 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:36:03.713654    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a5d459-3962-40c2-ba95-0ab57f0f4126-maas-api-tls podName:a2a5d459-3962-40c2-ba95-0ab57f0f4126 nodeName:}" failed. No retries permitted until 2026-07-15 17:36:04.213634527 +0000 UTC m=+2220.371049320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a2a5d459-3962-40c2-ba95-0ab57f0f4126-maas-api-tls") pod "maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p" (UID: "a2a5d459-3962-40c2-ba95-0ab57f0f4126") : secret "maas-api-e2e-inf-b-47c774-serving-cert" not found
Jul 15 17:36:03.714207 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.714188    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a5d459-3962-40c2-ba95-0ab57f0f4126-openshift-service-ca\") pod \"maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:03.744346 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:03.744320    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj9r6\" (UniqueName: \"kubernetes.io/projected/a2a5d459-3962-40c2-ba95-0ab57f0f4126-kube-api-access-hj9r6\") pod \"maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:04.218218 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:04.218182    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2a5d459-3962-40c2-ba95-0ab57f0f4126-maas-api-tls\") pod \"maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:04.220477 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:04.220454    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2a5d459-3962-40c2-ba95-0ab57f0f4126-maas-api-tls\") pod \"maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:04.423470 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:04.423438    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-97jqt\""
Jul 15 17:36:04.431479 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:04.431457    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:04.452268 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:04.452236    2556 scope.go:117] "RemoveContainer" containerID="e816ab1c3c681c355cf05b0d4a4cca1a6b30a55779a1b187e0568e63c9dfd6fd"
Jul 15 17:36:04.461812 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:04.461788    2556 scope.go:117] "RemoveContainer" containerID="1f540f05829a974af02017c264caaae8f60f4399c81714d6877faf6ce7283148"
Jul 15 17:36:04.567413 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:04.567377    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"]
Jul 15 17:36:04.568927 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:36:04.568899    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a5d459_3962_40c2_ba95_0ab57f0f4126.slice/crio-2d6b9bd0a2b23fbca7c8cf46ba9843c37ffa2fdbe5f9e7bacfad3a53544255a3 WatchSource:0}: Error finding container 2d6b9bd0a2b23fbca7c8cf46ba9843c37ffa2fdbe5f9e7bacfad3a53544255a3: Status 404 returned error can't find the container with id 2d6b9bd0a2b23fbca7c8cf46ba9843c37ffa2fdbe5f9e7bacfad3a53544255a3
Jul 15 17:36:04.570259 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:04.570238    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 17:36:05.132390 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:05.132355    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p" event={"ID":"a2a5d459-3962-40c2-ba95-0ab57f0f4126","Type":"ContainerStarted","Data":"2d6b9bd0a2b23fbca7c8cf46ba9843c37ffa2fdbe5f9e7bacfad3a53544255a3"}
Jul 15 17:36:07.143328 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:07.143292    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p" event={"ID":"a2a5d459-3962-40c2-ba95-0ab57f0f4126","Type":"ContainerStarted","Data":"2b98592cd509d4bc90bb6d67ebc0f2cd8d41b081fa8f939a2c8520e4c9cb992e"}
Jul 15 17:36:07.143762 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:07.143448    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:07.162576 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:07.162530    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p" podStartSLOduration=1.81663161 podStartE2EDuration="4.162515899s" totalImagesPullingTime="2.345884289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:36:07.161255846 +0000 UTC m=+2223.318670672" watchObservedRunningTime="2026-07-15 17:36:07.162515899 +0000 UTC m=+2223.319930744"
Jul 15 17:36:13.154103 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:13.154074    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:36:19.126997 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.126944    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"]
Jul 15 17:36:19.130400 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.130383    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.133759 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.133724    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a6dd94\"/\"test-model-a6dd94-kserve-self-signed-certs\""
Jul 15 17:36:19.133759 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.133721    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a6dd94\"/\"openshift-service-ca.crt\""
Jul 15 17:36:19.133945 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.133882    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a6dd94\"/\"default-dockercfg-6sbvf\""
Jul 15 17:36:19.133945 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.133894    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a6dd94\"/\"kube-root-ca.crt\""
Jul 15 17:36:19.138417 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.138397    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"]
Jul 15 17:36:19.245169 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.245131    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-home\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.245333 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.245182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a9d8156-a22b-443b-b4f5-d000d6099446-tls-certs\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.245333 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.245262    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxj7z\" (UniqueName: \"kubernetes.io/projected/3a9d8156-a22b-443b-b4f5-d000d6099446-kube-api-access-jxj7z\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.245333 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.245300    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-tmp-dir\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.245469 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.245340    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-dshm\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.245469 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.245374    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-model-cache\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.346265 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.346219    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxj7z\" (UniqueName: \"kubernetes.io/projected/3a9d8156-a22b-443b-b4f5-d000d6099446-kube-api-access-jxj7z\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.346435 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.346273    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-tmp-dir\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.346435 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.346308    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-dshm\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.346435 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.346325    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-model-cache\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.346435 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.346363    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-home\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.346435 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.346388    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a9d8156-a22b-443b-b4f5-d000d6099446-tls-certs\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.346793 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.346770    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-tmp-dir\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.346867 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.346802    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-model-cache\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.346915 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.346859    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-home\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.348761 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.348741    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-dshm\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.348921 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.348905    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a9d8156-a22b-443b-b4f5-d000d6099446-tls-certs\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.355673 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.355647    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxj7z\" (UniqueName: \"kubernetes.io/projected/3a9d8156-a22b-443b-b4f5-d000d6099446-kube-api-access-jxj7z\") pod \"test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") " pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.440743 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.440627    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:19.574192 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:19.574166    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"]
Jul 15 17:36:19.576316 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:36:19.576289    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a9d8156_a22b_443b_b4f5_d000d6099446.slice/crio-dd5d39825929fcd1075591dc717a000bf39d6537a378e43cedc20429bdbba0ae WatchSource:0}: Error finding container dd5d39825929fcd1075591dc717a000bf39d6537a378e43cedc20429bdbba0ae: Status 404 returned error can't find the container with id dd5d39825929fcd1075591dc717a000bf39d6537a378e43cedc20429bdbba0ae
Jul 15 17:36:20.204768 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:20.204727    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q" event={"ID":"3a9d8156-a22b-443b-b4f5-d000d6099446","Type":"ContainerStarted","Data":"c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89"}
Jul 15 17:36:20.204768 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:20.204775    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q" event={"ID":"3a9d8156-a22b-443b-b4f5-d000d6099446","Type":"ContainerStarted","Data":"dd5d39825929fcd1075591dc717a000bf39d6537a378e43cedc20429bdbba0ae"}
Jul 15 17:36:20.225730 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:20.225670    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q" podStartSLOduration=1.225655166 podStartE2EDuration="1.225655166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:36:20.224855562 +0000 UTC m=+2236.382270376" watchObservedRunningTime="2026-07-15 17:36:20.225655166 +0000 UTC m=+2236.383069979"
Jul 15 17:36:29.440947 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:29.440850    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:29.440947 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:29.440916    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:29.453455 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:29.453422    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:30.268551 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:30.268520    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:36:44.303475 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.303442    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"]
Jul 15 17:36:44.312312 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.312267    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.314929 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.314902    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"]
Jul 15 17:36:44.315247 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.315231    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-47c774\"/\"test-model-47c774-kserve-self-signed-certs\""
Jul 15 17:36:44.315407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.315383    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-47c774\"/\"kube-root-ca.crt\""
Jul 15 17:36:44.316223 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.316207    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-47c774\"/\"openshift-service-ca.crt\""
Jul 15 17:36:44.316535 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.316517    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-47c774\"/\"default-dockercfg-6t6w8\""
Jul 15 17:36:44.472974 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.472936    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tls-certs\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.472974 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.472980    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-home\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.473188 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.473001    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzb5m\" (UniqueName: \"kubernetes.io/projected/f0aa3873-58d5-43f5-af7b-16e740af8cbb-kube-api-access-wzb5m\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.473188 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.473065    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-model-cache\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.473188 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.473108    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tmp-dir\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.473188 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.473156    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-dshm\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.574544 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.574446    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tls-certs\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.574544 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.574491    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-home\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.574544 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.574509    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzb5m\" (UniqueName: \"kubernetes.io/projected/f0aa3873-58d5-43f5-af7b-16e740af8cbb-kube-api-access-wzb5m\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.574544 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.574531    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-model-cache\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.574904 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.574554    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tmp-dir\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.574904 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.574608    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-dshm\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.575014 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.574920    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-home\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.575014 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.574959    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-model-cache\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.575088 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.575034    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tmp-dir\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.576878 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.576855    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-dshm\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.577082 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.577062    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tls-certs\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.583562 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.583541    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzb5m\" (UniqueName: \"kubernetes.io/projected/f0aa3873-58d5-43f5-af7b-16e740af8cbb-kube-api-access-wzb5m\") pod \"test-model-47c774-kserve-59c4df7c7c-gqgnx\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") " pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.623835 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.623792    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:44.781949 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:44.781925    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"]
Jul 15 17:36:44.783854 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:36:44.783831    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0aa3873_58d5_43f5_af7b_16e740af8cbb.slice/crio-ce3f1dbaabca7b4338005136d44a8e45de0e91136a5350d7b373ea61e7653189 WatchSource:0}: Error finding container ce3f1dbaabca7b4338005136d44a8e45de0e91136a5350d7b373ea61e7653189: Status 404 returned error can't find the container with id ce3f1dbaabca7b4338005136d44a8e45de0e91136a5350d7b373ea61e7653189
Jul 15 17:36:45.334414 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:45.334368    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx" event={"ID":"f0aa3873-58d5-43f5-af7b-16e740af8cbb","Type":"ContainerStarted","Data":"fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8"}
Jul 15 17:36:45.334891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:45.334428    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx" event={"ID":"f0aa3873-58d5-43f5-af7b-16e740af8cbb","Type":"ContainerStarted","Data":"ce3f1dbaabca7b4338005136d44a8e45de0e91136a5350d7b373ea61e7653189"}
Jul 15 17:36:45.352320 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:45.352268    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx" podStartSLOduration=1.352253301 podStartE2EDuration="1.352253301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:36:45.351475616 +0000 UTC m=+2261.508890429" watchObservedRunningTime="2026-07-15 17:36:45.352253301 +0000 UTC m=+2261.509668114"
Jul 15 17:36:54.624810 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:54.624777    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:54.625239 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:54.624824    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:54.637065 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:54.637044    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:36:55.392533 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:36:55.392501    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:37:16.714877 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:16.714845    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"]
Jul 15 17:37:17.605075 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:17.605044    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"]
Jul 15 17:37:17.756681 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:17.756649    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw"]
Jul 15 17:37:17.760398 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:17.760378    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw"
Jul 15 17:37:17.762891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:17.762870    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:37:17.768581 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:17.768557    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw"]
Jul 15 17:37:17.872002 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:17.871908    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13d09a39-40ed-44af-ae42-0fcc7c7542ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw\" (UID: \"13d09a39-40ed-44af-ae42-0fcc7c7542ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw"
Jul 15 17:37:17.973389 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:17.973362    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13d09a39-40ed-44af-ae42-0fcc7c7542ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw\" (UID: \"13d09a39-40ed-44af-ae42-0fcc7c7542ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw"
Jul 15 17:37:17.973958 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:17.973940    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13d09a39-40ed-44af-ae42-0fcc7c7542ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw\" (UID: \"13d09a39-40ed-44af-ae42-0fcc7c7542ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw"
Jul 15 17:37:18.072069 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:18.072020    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw"
Jul 15 17:37:18.201157 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:18.201130    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw"]
Jul 15 17:37:18.203453 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:37:18.203417    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d09a39_40ed_44af_ae42_0fcc7c7542ea.slice/crio-47a78f44c89785e453782b47ac4fef3bec43b0b0f2849ec352b6cd9ac11fea5a WatchSource:0}: Error finding container 47a78f44c89785e453782b47ac4fef3bec43b0b0f2849ec352b6cd9ac11fea5a: Status 404 returned error can't find the container with id 47a78f44c89785e453782b47ac4fef3bec43b0b0f2849ec352b6cd9ac11fea5a
Jul 15 17:37:18.502372 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:18.502343    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw" event={"ID":"13d09a39-40ed-44af-ae42-0fcc7c7542ea","Type":"ContainerStarted","Data":"727736310e9c066ff8f93da4522404a07e900b6d222d7860500640c98b362ff3"}
Jul 15 17:37:18.502516 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:18.502395    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw" event={"ID":"13d09a39-40ed-44af-ae42-0fcc7c7542ea","Type":"ContainerStarted","Data":"47a78f44c89785e453782b47ac4fef3bec43b0b0f2849ec352b6cd9ac11fea5a"}
Jul 15 17:37:18.517961 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:18.517917    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw" podStartSLOduration=1.517901818 podStartE2EDuration="1.517901818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:37:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:37:18.516852985 +0000 UTC m=+2294.674267798" watchObservedRunningTime="2026-07-15 17:37:18.517901818 +0000 UTC m=+2294.675316669"
Jul 15 17:37:19.508293 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:19.508259    2556 generic.go:356] "Generic (PLEG): container finished" podID="13d09a39-40ed-44af-ae42-0fcc7c7542ea" containerID="727736310e9c066ff8f93da4522404a07e900b6d222d7860500640c98b362ff3" exitCode=0
Jul 15 17:37:19.508663 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:19.508349    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw" event={"ID":"13d09a39-40ed-44af-ae42-0fcc7c7542ea","Type":"ContainerDied","Data":"727736310e9c066ff8f93da4522404a07e900b6d222d7860500640c98b362ff3"}
Jul 15 17:37:20.643129 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:20.643105    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw"
Jul 15 17:37:20.700860 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:20.700825    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13d09a39-40ed-44af-ae42-0fcc7c7542ea-maas-api-service-ca\") pod \"13d09a39-40ed-44af-ae42-0fcc7c7542ea\" (UID: \"13d09a39-40ed-44af-ae42-0fcc7c7542ea\") "
Jul 15 17:37:20.701179 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:20.701155    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13d09a39-40ed-44af-ae42-0fcc7c7542ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "13d09a39-40ed-44af-ae42-0fcc7c7542ea" (UID: "13d09a39-40ed-44af-ae42-0fcc7c7542ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:37:20.802011 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:20.801930    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13d09a39-40ed-44af-ae42-0fcc7c7542ea-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:21.518404 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:21.518371    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw"
Jul 15 17:37:21.518570 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:21.518394    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw" event={"ID":"13d09a39-40ed-44af-ae42-0fcc7c7542ea","Type":"ContainerDied","Data":"47a78f44c89785e453782b47ac4fef3bec43b0b0f2849ec352b6cd9ac11fea5a"}
Jul 15 17:37:21.518570 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:21.518448    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47a78f44c89785e453782b47ac4fef3bec43b0b0f2849ec352b6cd9ac11fea5a"
Jul 15 17:37:31.734693 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:31.734647    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q" podUID="3a9d8156-a22b-443b-b4f5-d000d6099446" containerName="main" containerID="cri-o://c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89" gracePeriod=45
Jul 15 17:37:31.986610 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:31.986554    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:37:32.104984 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.104951    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-home\") pod \"3a9d8156-a22b-443b-b4f5-d000d6099446\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") "
Jul 15 17:37:32.105168 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.105014    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-model-cache\") pod \"3a9d8156-a22b-443b-b4f5-d000d6099446\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") "
Jul 15 17:37:32.105168 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.105037    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxj7z\" (UniqueName: \"kubernetes.io/projected/3a9d8156-a22b-443b-b4f5-d000d6099446-kube-api-access-jxj7z\") pod \"3a9d8156-a22b-443b-b4f5-d000d6099446\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") "
Jul 15 17:37:32.105168 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.105069    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-dshm\") pod \"3a9d8156-a22b-443b-b4f5-d000d6099446\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") "
Jul 15 17:37:32.105168 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.105108    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a9d8156-a22b-443b-b4f5-d000d6099446-tls-certs\") pod \"3a9d8156-a22b-443b-b4f5-d000d6099446\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") "
Jul 15 17:37:32.105168 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.105140    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-tmp-dir\") pod \"3a9d8156-a22b-443b-b4f5-d000d6099446\" (UID: \"3a9d8156-a22b-443b-b4f5-d000d6099446\") "
Jul 15 17:37:32.105429 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.105232    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-home" (OuterVolumeSpecName: "home") pod "3a9d8156-a22b-443b-b4f5-d000d6099446" (UID: "3a9d8156-a22b-443b-b4f5-d000d6099446"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:37:32.105429 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.105327    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-model-cache" (OuterVolumeSpecName: "model-cache") pod "3a9d8156-a22b-443b-b4f5-d000d6099446" (UID: "3a9d8156-a22b-443b-b4f5-d000d6099446"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:37:32.105530 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.105470    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-home\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:32.105530 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.105491    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-model-cache\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:32.105530 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.105470    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a9d8156-a22b-443b-b4f5-d000d6099446" (UID: "3a9d8156-a22b-443b-b4f5-d000d6099446"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:37:32.107382 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.107348    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-dshm" (OuterVolumeSpecName: "dshm") pod "3a9d8156-a22b-443b-b4f5-d000d6099446" (UID: "3a9d8156-a22b-443b-b4f5-d000d6099446"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:37:32.107496 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.107384    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a9d8156-a22b-443b-b4f5-d000d6099446-kube-api-access-jxj7z" (OuterVolumeSpecName: "kube-api-access-jxj7z") pod "3a9d8156-a22b-443b-b4f5-d000d6099446" (UID: "3a9d8156-a22b-443b-b4f5-d000d6099446"). InnerVolumeSpecName "kube-api-access-jxj7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:37:32.107496 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.107394    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a9d8156-a22b-443b-b4f5-d000d6099446-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3a9d8156-a22b-443b-b4f5-d000d6099446" (UID: "3a9d8156-a22b-443b-b4f5-d000d6099446"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:37:32.206250 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.206214    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a9d8156-a22b-443b-b4f5-d000d6099446-tls-certs\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:32.206250 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.206245    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-tmp-dir\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:32.206250 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.206255    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxj7z\" (UniqueName: \"kubernetes.io/projected/3a9d8156-a22b-443b-b4f5-d000d6099446-kube-api-access-jxj7z\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:32.206467 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.206263    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a9d8156-a22b-443b-b4f5-d000d6099446-dshm\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:32.571275 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.571240    2556 generic.go:356] "Generic (PLEG): container finished" podID="3a9d8156-a22b-443b-b4f5-d000d6099446" containerID="c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89" exitCode=0
Jul 15 17:37:32.571458 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.571286    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"
Jul 15 17:37:32.571458 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.571294    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q" event={"ID":"3a9d8156-a22b-443b-b4f5-d000d6099446","Type":"ContainerDied","Data":"c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89"}
Jul 15 17:37:32.571458 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.571335    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q" event={"ID":"3a9d8156-a22b-443b-b4f5-d000d6099446","Type":"ContainerDied","Data":"dd5d39825929fcd1075591dc717a000bf39d6537a378e43cedc20429bdbba0ae"}
Jul 15 17:37:32.571458 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.571356    2556 scope.go:117] "RemoveContainer" containerID="c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89"
Jul 15 17:37:32.579641 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.579620    2556 scope.go:117] "RemoveContainer" containerID="c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89"
Jul 15 17:37:32.579906 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:37:32.579889    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89\": container with ID starting with c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89 not found: ID does not exist" containerID="c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89"
Jul 15 17:37:32.579982 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.579914    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89"} err="failed to get container status \"c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89\": rpc error: code = NotFound desc = could not find container \"c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89\": container with ID starting with c6ed53ee99868d34a9a6d74f4207431619250f6e74a5850177b33fa3d80ebd89 not found: ID does not exist"
Jul 15 17:37:32.590008 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.589988    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"]
Jul 15 17:37:32.594038 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.594019    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-a6dd94/test-model-a6dd94-kserve-5bbfb7d7b5-pmg9q"]
Jul 15 17:37:32.624628 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.624565    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx" podUID="f0aa3873-58d5-43f5-af7b-16e740af8cbb" containerName="main" containerID="cri-o://fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8" gracePeriod=45
Jul 15 17:37:32.866126 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:32.866101    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:37:33.013645 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.013616    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-dshm\") pod \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") "
Jul 15 17:37:33.013859 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.013658    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tmp-dir\") pod \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") "
Jul 15 17:37:33.013859 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.013693    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-model-cache\") pod \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") "
Jul 15 17:37:33.013859 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.013746    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzb5m\" (UniqueName: \"kubernetes.io/projected/f0aa3873-58d5-43f5-af7b-16e740af8cbb-kube-api-access-wzb5m\") pod \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") "
Jul 15 17:37:33.013859 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.013808    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-home\") pod \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") "
Jul 15 17:37:33.013859 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.013854    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tls-certs\") pod \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\" (UID: \"f0aa3873-58d5-43f5-af7b-16e740af8cbb\") "
Jul 15 17:37:33.014106 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.013954    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0aa3873-58d5-43f5-af7b-16e740af8cbb" (UID: "f0aa3873-58d5-43f5-af7b-16e740af8cbb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:37:33.014106 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.013968    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0aa3873-58d5-43f5-af7b-16e740af8cbb" (UID: "f0aa3873-58d5-43f5-af7b-16e740af8cbb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:37:33.014106 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.014058    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-home" (OuterVolumeSpecName: "home") pod "f0aa3873-58d5-43f5-af7b-16e740af8cbb" (UID: "f0aa3873-58d5-43f5-af7b-16e740af8cbb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:37:33.014210 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.014123    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-home\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:33.014210 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.014136    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tmp-dir\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:33.014210 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.014146    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-model-cache\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:33.016004 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.015980    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-dshm" (OuterVolumeSpecName: "dshm") pod "f0aa3873-58d5-43f5-af7b-16e740af8cbb" (UID: "f0aa3873-58d5-43f5-af7b-16e740af8cbb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:37:33.016085 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.016047    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0aa3873-58d5-43f5-af7b-16e740af8cbb-kube-api-access-wzb5m" (OuterVolumeSpecName: "kube-api-access-wzb5m") pod "f0aa3873-58d5-43f5-af7b-16e740af8cbb" (UID: "f0aa3873-58d5-43f5-af7b-16e740af8cbb"). InnerVolumeSpecName "kube-api-access-wzb5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:37:33.016122 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.016096    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0aa3873-58d5-43f5-af7b-16e740af8cbb" (UID: "f0aa3873-58d5-43f5-af7b-16e740af8cbb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:37:33.115351 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.115314    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0aa3873-58d5-43f5-af7b-16e740af8cbb-tls-certs\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:33.115351 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.115344    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0aa3873-58d5-43f5-af7b-16e740af8cbb-dshm\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:33.115351 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.115353    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzb5m\" (UniqueName: \"kubernetes.io/projected/f0aa3873-58d5-43f5-af7b-16e740af8cbb-kube-api-access-wzb5m\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:33.578356 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.578319    2556 generic.go:356] "Generic (PLEG): container finished" podID="f0aa3873-58d5-43f5-af7b-16e740af8cbb" containerID="fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8" exitCode=0
Jul 15 17:37:33.578529 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.578366    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"
Jul 15 17:37:33.578529 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.578408    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx" event={"ID":"f0aa3873-58d5-43f5-af7b-16e740af8cbb","Type":"ContainerDied","Data":"fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8"}
Jul 15 17:37:33.578529 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.578452    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx" event={"ID":"f0aa3873-58d5-43f5-af7b-16e740af8cbb","Type":"ContainerDied","Data":"ce3f1dbaabca7b4338005136d44a8e45de0e91136a5350d7b373ea61e7653189"}
Jul 15 17:37:33.578529 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.578472    2556 scope.go:117] "RemoveContainer" containerID="fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8"
Jul 15 17:37:33.587146 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.587131    2556 scope.go:117] "RemoveContainer" containerID="fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8"
Jul 15 17:37:33.587373 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:37:33.587357    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8\": container with ID starting with fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8 not found: ID does not exist" containerID="fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8"
Jul 15 17:37:33.587415 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.587380    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8"} err="failed to get container status \"fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8\": rpc error: code = NotFound desc = could not find container \"fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8\": container with ID starting with fee7854d43cd1e1dc9dbf7704f19478076886598e214ca130529f6fc3a0e98c8 not found: ID does not exist"
Jul 15 17:37:33.599898 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.599872    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"]
Jul 15 17:37:33.603466 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:33.603438    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-47c774/test-model-47c774-kserve-59c4df7c7c-gqgnx"]
Jul 15 17:37:34.365642 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:34.365605    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a9d8156-a22b-443b-b4f5-d000d6099446" path="/var/lib/kubelet/pods/3a9d8156-a22b-443b-b4f5-d000d6099446/volumes"
Jul 15 17:37:34.366032 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:34.366008    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0aa3873-58d5-43f5-af7b-16e740af8cbb" path="/var/lib/kubelet/pods/f0aa3873-58d5-43f5-af7b-16e740af8cbb/volumes"
Jul 15 17:37:43.930340 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.930303    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s"]
Jul 15 17:37:43.930698 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.930624    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d09a39-40ed-44af-ae42-0fcc7c7542ea" containerName="revoke-keys"
Jul 15 17:37:43.930698 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.930634    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d09a39-40ed-44af-ae42-0fcc7c7542ea" containerName="revoke-keys"
Jul 15 17:37:43.930698 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.930652    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a9d8156-a22b-443b-b4f5-d000d6099446" containerName="main"
Jul 15 17:37:43.930698 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.930658    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a9d8156-a22b-443b-b4f5-d000d6099446" containerName="main"
Jul 15 17:37:43.930698 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.930668    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0aa3873-58d5-43f5-af7b-16e740af8cbb" containerName="main"
Jul 15 17:37:43.930698 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.930674    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0aa3873-58d5-43f5-af7b-16e740af8cbb" containerName="main"
Jul 15 17:37:43.930912 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.930749    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d09a39-40ed-44af-ae42-0fcc7c7542ea" containerName="revoke-keys"
Jul 15 17:37:43.930912 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.930759    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a9d8156-a22b-443b-b4f5-d000d6099446" containerName="main"
Jul 15 17:37:43.930912 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.930765    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0aa3873-58d5-43f5-af7b-16e740af8cbb" containerName="main"
Jul 15 17:37:43.933667 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.933650    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s"
Jul 15 17:37:43.936200 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.936178    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:37:43.942008 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:43.941982    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s"]
Jul 15 17:37:44.006482 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:44.006449    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f7db8b-46be-4230-971d-3bc86bbd903e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s\" (UID: \"79f7db8b-46be-4230-971d-3bc86bbd903e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s"
Jul 15 17:37:44.107340 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:44.107308    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f7db8b-46be-4230-971d-3bc86bbd903e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s\" (UID: \"79f7db8b-46be-4230-971d-3bc86bbd903e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s"
Jul 15 17:37:44.107903 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:44.107883    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f7db8b-46be-4230-971d-3bc86bbd903e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s\" (UID: \"79f7db8b-46be-4230-971d-3bc86bbd903e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s"
Jul 15 17:37:44.244753 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:44.244707    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s"
Jul 15 17:37:44.370695 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:44.370673    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s"]
Jul 15 17:37:44.372834 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:37:44.372809    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f7db8b_46be_4230_971d_3bc86bbd903e.slice/crio-9ff686adf2d8bfc78009d5c65f20b13ae97f7e4c9ba0c04041e1e9ab22a72bb4 WatchSource:0}: Error finding container 9ff686adf2d8bfc78009d5c65f20b13ae97f7e4c9ba0c04041e1e9ab22a72bb4: Status 404 returned error can't find the container with id 9ff686adf2d8bfc78009d5c65f20b13ae97f7e4c9ba0c04041e1e9ab22a72bb4
Jul 15 17:37:44.633637 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:44.633612    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s" event={"ID":"79f7db8b-46be-4230-971d-3bc86bbd903e","Type":"ContainerStarted","Data":"9dfc0eb7c983987d9e7fa18eec1f1a86fda8ecdd715d9932a46acb4ef4463e7b"}
Jul 15 17:37:44.633743 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:44.633660    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s" event={"ID":"79f7db8b-46be-4230-971d-3bc86bbd903e","Type":"ContainerStarted","Data":"9ff686adf2d8bfc78009d5c65f20b13ae97f7e4c9ba0c04041e1e9ab22a72bb4"}
Jul 15 17:37:44.655216 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:44.655165    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s" podStartSLOduration=1.655150331 podStartE2EDuration="1.655150331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:37:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:37:44.652643535 +0000 UTC m=+2320.810058348" watchObservedRunningTime="2026-07-15 17:37:44.655150331 +0000 UTC m=+2320.812565145"
Jul 15 17:37:45.640680 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:45.640636    2556 generic.go:356] "Generic (PLEG): container finished" podID="79f7db8b-46be-4230-971d-3bc86bbd903e" containerID="9dfc0eb7c983987d9e7fa18eec1f1a86fda8ecdd715d9932a46acb4ef4463e7b" exitCode=0
Jul 15 17:37:45.641096 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:45.640736    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s" event={"ID":"79f7db8b-46be-4230-971d-3bc86bbd903e","Type":"ContainerDied","Data":"9dfc0eb7c983987d9e7fa18eec1f1a86fda8ecdd715d9932a46acb4ef4463e7b"}
Jul 15 17:37:46.775151 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:46.775127    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s"
Jul 15 17:37:46.831487 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:46.831456    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f7db8b-46be-4230-971d-3bc86bbd903e-maas-api-service-ca\") pod \"79f7db8b-46be-4230-971d-3bc86bbd903e\" (UID: \"79f7db8b-46be-4230-971d-3bc86bbd903e\") "
Jul 15 17:37:46.831838 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:46.831815    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79f7db8b-46be-4230-971d-3bc86bbd903e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79f7db8b-46be-4230-971d-3bc86bbd903e" (UID: "79f7db8b-46be-4230-971d-3bc86bbd903e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:37:46.932559 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:46.932491    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79f7db8b-46be-4230-971d-3bc86bbd903e-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:47.658125 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:47.658089    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s" event={"ID":"79f7db8b-46be-4230-971d-3bc86bbd903e","Type":"ContainerDied","Data":"9ff686adf2d8bfc78009d5c65f20b13ae97f7e4c9ba0c04041e1e9ab22a72bb4"}
Jul 15 17:37:47.658125 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:47.658090    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s"
Jul 15 17:37:47.658332 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:47.658161    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ff686adf2d8bfc78009d5c65f20b13ae97f7e4c9ba0c04041e1e9ab22a72bb4"
Jul 15 17:37:54.559618 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:54.559575    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"]
Jul 15 17:37:54.560160 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:54.559903    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p" podUID="a2a5d459-3962-40c2-ba95-0ab57f0f4126" containerName="maas-api" containerID="cri-o://2b98592cd509d4bc90bb6d67ebc0f2cd8d41b081fa8f939a2c8520e4c9cb992e" gracePeriod=30
Jul 15 17:37:54.695388 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:54.695343    2556 generic.go:356] "Generic (PLEG): container finished" podID="a2a5d459-3962-40c2-ba95-0ab57f0f4126" containerID="2b98592cd509d4bc90bb6d67ebc0f2cd8d41b081fa8f939a2c8520e4c9cb992e" exitCode=0
Jul 15 17:37:54.695590 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:54.695398    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p" event={"ID":"a2a5d459-3962-40c2-ba95-0ab57f0f4126","Type":"ContainerDied","Data":"2b98592cd509d4bc90bb6d67ebc0f2cd8d41b081fa8f939a2c8520e4c9cb992e"}
Jul 15 17:37:54.808424 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:54.808395    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:37:54.901171 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:54.901080    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj9r6\" (UniqueName: \"kubernetes.io/projected/a2a5d459-3962-40c2-ba95-0ab57f0f4126-kube-api-access-hj9r6\") pod \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") "
Jul 15 17:37:54.901171 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:54.901164    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2a5d459-3962-40c2-ba95-0ab57f0f4126-maas-api-tls\") pod \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") "
Jul 15 17:37:54.901391 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:54.901212    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a5d459-3962-40c2-ba95-0ab57f0f4126-openshift-service-ca\") pod \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\" (UID: \"a2a5d459-3962-40c2-ba95-0ab57f0f4126\") "
Jul 15 17:37:54.901616 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:54.901589    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a5d459-3962-40c2-ba95-0ab57f0f4126-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a2a5d459-3962-40c2-ba95-0ab57f0f4126" (UID: "a2a5d459-3962-40c2-ba95-0ab57f0f4126"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:37:54.903358 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:54.903329    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a5d459-3962-40c2-ba95-0ab57f0f4126-kube-api-access-hj9r6" (OuterVolumeSpecName: "kube-api-access-hj9r6") pod "a2a5d459-3962-40c2-ba95-0ab57f0f4126" (UID: "a2a5d459-3962-40c2-ba95-0ab57f0f4126"). InnerVolumeSpecName "kube-api-access-hj9r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:37:54.903455 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:54.903373    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a5d459-3962-40c2-ba95-0ab57f0f4126-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a2a5d459-3962-40c2-ba95-0ab57f0f4126" (UID: "a2a5d459-3962-40c2-ba95-0ab57f0f4126"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:37:55.001957 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:55.001918    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj9r6\" (UniqueName: \"kubernetes.io/projected/a2a5d459-3962-40c2-ba95-0ab57f0f4126-kube-api-access-hj9r6\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:55.001957 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:55.001952    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2a5d459-3962-40c2-ba95-0ab57f0f4126-maas-api-tls\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:55.001957 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:55.001962    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2a5d459-3962-40c2-ba95-0ab57f0f4126-openshift-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:37:55.701891 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:55.701858    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p" event={"ID":"a2a5d459-3962-40c2-ba95-0ab57f0f4126","Type":"ContainerDied","Data":"2d6b9bd0a2b23fbca7c8cf46ba9843c37ffa2fdbe5f9e7bacfad3a53544255a3"}
Jul 15 17:37:55.702316 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:55.701916    2556 scope.go:117] "RemoveContainer" containerID="2b98592cd509d4bc90bb6d67ebc0f2cd8d41b081fa8f939a2c8520e4c9cb992e"
Jul 15 17:37:55.702316 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:55.701871    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"
Jul 15 17:37:55.723238 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:55.723205    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"]
Jul 15 17:37:55.728952 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:55.728925    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-47c774-5657fbfc99-5m76p"]
Jul 15 17:37:56.365531 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:37:56.365440    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2a5d459-3962-40c2-ba95-0ab57f0f4126" path="/var/lib/kubelet/pods/a2a5d459-3962-40c2-ba95-0ab57f0f4126/volumes"
Jul 15 17:38:14.284060 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.284027    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"]
Jul 15 17:38:14.284507 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.284359    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f7db8b-46be-4230-971d-3bc86bbd903e" containerName="revoke-keys"
Jul 15 17:38:14.284507 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.284370    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f7db8b-46be-4230-971d-3bc86bbd903e" containerName="revoke-keys"
Jul 15 17:38:14.284507 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.284384    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a5d459-3962-40c2-ba95-0ab57f0f4126" containerName="maas-api"
Jul 15 17:38:14.284507 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.284391    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a5d459-3962-40c2-ba95-0ab57f0f4126" containerName="maas-api"
Jul 15 17:38:14.284507 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.284448    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="79f7db8b-46be-4230-971d-3bc86bbd903e" containerName="revoke-keys"
Jul 15 17:38:14.284507 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.284457    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a5d459-3962-40c2-ba95-0ab57f0f4126" containerName="maas-api"
Jul 15 17:38:14.287062 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.287043    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:14.289445 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.289425    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-4dfdb7-serving-cert\""
Jul 15 17:38:14.289618 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.289592    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-97jqt\""
Jul 15 17:38:14.298642 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.298617    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"]
Jul 15 17:38:14.377761 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.377704    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl4cx\" (UniqueName: \"kubernetes.io/projected/5c6b271a-298b-4b18-8abc-3df96794ac0a-kube-api-access-sl4cx\") pod \"maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:14.377914 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.377839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6b271a-298b-4b18-8abc-3df96794ac0a-maas-api-tls\") pod \"maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:14.377914 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.377892    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6b271a-298b-4b18-8abc-3df96794ac0a-openshift-service-ca\") pod \"maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:14.478583 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.478557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6b271a-298b-4b18-8abc-3df96794ac0a-maas-api-tls\") pod \"maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:14.478757 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.478609    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6b271a-298b-4b18-8abc-3df96794ac0a-openshift-service-ca\") pod \"maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:14.478757 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.478656    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl4cx\" (UniqueName: \"kubernetes.io/projected/5c6b271a-298b-4b18-8abc-3df96794ac0a-kube-api-access-sl4cx\") pod \"maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:14.478757 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:38:14.478698    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-serving-cert: secret "maas-api-e2e-api-a-4dfdb7-serving-cert" not found
Jul 15 17:38:14.478933 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:38:14.478798    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c6b271a-298b-4b18-8abc-3df96794ac0a-maas-api-tls podName:5c6b271a-298b-4b18-8abc-3df96794ac0a nodeName:}" failed. No retries permitted until 2026-07-15 17:38:14.978779969 +0000 UTC m=+2351.136194760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5c6b271a-298b-4b18-8abc-3df96794ac0a-maas-api-tls") pod "maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt" (UID: "5c6b271a-298b-4b18-8abc-3df96794ac0a") : secret "maas-api-e2e-api-a-4dfdb7-serving-cert" not found
Jul 15 17:38:14.479274 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.479254    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6b271a-298b-4b18-8abc-3df96794ac0a-openshift-service-ca\") pod \"maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:14.487456 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.487439    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl4cx\" (UniqueName: \"kubernetes.io/projected/5c6b271a-298b-4b18-8abc-3df96794ac0a-kube-api-access-sl4cx\") pod \"maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:14.982954 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.982924    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6b271a-298b-4b18-8abc-3df96794ac0a-maas-api-tls\") pod \"maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:14.985410 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:14.985379    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6b271a-298b-4b18-8abc-3df96794ac0a-maas-api-tls\") pod \"maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:15.197117 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:15.197084    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:15.337637 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:15.337611    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"]
Jul 15 17:38:15.339423 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:38:15.339394    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6b271a_298b_4b18_8abc_3df96794ac0a.slice/crio-58eb5197dc89c3f4af65e35b897f14dc745198a08bfdefb3e4791337eed128d7 WatchSource:0}: Error finding container 58eb5197dc89c3f4af65e35b897f14dc745198a08bfdefb3e4791337eed128d7: Status 404 returned error can't find the container with id 58eb5197dc89c3f4af65e35b897f14dc745198a08bfdefb3e4791337eed128d7
Jul 15 17:38:15.793108 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:15.793073    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt" event={"ID":"5c6b271a-298b-4b18-8abc-3df96794ac0a","Type":"ContainerStarted","Data":"58eb5197dc89c3f4af65e35b897f14dc745198a08bfdefb3e4791337eed128d7"}
Jul 15 17:38:16.800139 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:16.800086    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt" event={"ID":"5c6b271a-298b-4b18-8abc-3df96794ac0a","Type":"ContainerStarted","Data":"06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5"}
Jul 15 17:38:16.800622 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:16.800159    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:16.819962 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:16.819915    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt" podStartSLOduration=2.00075374 podStartE2EDuration="2.819900516s" totalImagesPullingTime="819.146776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:38:16.817934569 +0000 UTC m=+2352.975349423" watchObservedRunningTime="2026-07-15 17:38:16.819900516 +0000 UTC m=+2352.977315330"
Jul 15 17:38:22.146919 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.146887    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"]
Jul 15 17:38:22.150586 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.150561    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:22.153048 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.153022    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-feaa2b-serving-cert\""
Jul 15 17:38:22.169632 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.169607    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"]
Jul 15 17:38:22.250322 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.250286    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wnrj\" (UniqueName: \"kubernetes.io/projected/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-kube-api-access-8wnrj\") pod \"maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:22.250515 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.250352    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:22.250515 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.250379    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-maas-api-tls\") pod \"maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:22.351120 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.351087    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:22.351333 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.351140    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-maas-api-tls\") pod \"maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:22.351333 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.351205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wnrj\" (UniqueName: \"kubernetes.io/projected/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-kube-api-access-8wnrj\") pod \"maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:22.351333 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:38:22.351305    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-serving-cert: secret "maas-api-e2e-api-b-feaa2b-serving-cert" not found
Jul 15 17:38:22.351528 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:38:22.351373    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-maas-api-tls podName:fe6d6e57-ed35-4b90-9e2a-0043a1b204d8 nodeName:}" failed. No retries permitted until 2026-07-15 17:38:22.8513546 +0000 UTC m=+2359.008769393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-maas-api-tls") pod "maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr" (UID: "fe6d6e57-ed35-4b90-9e2a-0043a1b204d8") : secret "maas-api-e2e-api-b-feaa2b-serving-cert" not found
Jul 15 17:38:22.351802 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.351784    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-openshift-service-ca\") pod \"maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:22.360509 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.360478    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wnrj\" (UniqueName: \"kubernetes.io/projected/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-kube-api-access-8wnrj\") pod \"maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:22.810436 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.810407    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:22.854910 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.854877    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-maas-api-tls\") pod \"maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:22.857318 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:22.857292    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-maas-api-tls\") pod \"maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:23.060990 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:23.060900    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:23.190628 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:23.190601    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"]
Jul 15 17:38:23.192864 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:38:23.192838    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6d6e57_ed35_4b90_9e2a_0043a1b204d8.slice/crio-008712bd0051e185b4d4e1fad9eabb43f4c5fcfdb307538c403bc4a1a09905b8 WatchSource:0}: Error finding container 008712bd0051e185b4d4e1fad9eabb43f4c5fcfdb307538c403bc4a1a09905b8: Status 404 returned error can't find the container with id 008712bd0051e185b4d4e1fad9eabb43f4c5fcfdb307538c403bc4a1a09905b8
Jul 15 17:38:23.832600 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:23.832558    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr" event={"ID":"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8","Type":"ContainerStarted","Data":"008712bd0051e185b4d4e1fad9eabb43f4c5fcfdb307538c403bc4a1a09905b8"}
Jul 15 17:38:24.839299 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:24.839262    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr" event={"ID":"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8","Type":"ContainerStarted","Data":"23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0"}
Jul 15 17:38:24.839700 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:24.839333    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:24.861252 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:24.861202    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr" podStartSLOduration=1.858324662 podStartE2EDuration="2.861185228s" totalImagesPullingTime="1.002860566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:38:24.860223987 +0000 UTC m=+2361.017638814" watchObservedRunningTime="2026-07-15 17:38:24.861185228 +0000 UTC m=+2361.018600042"
Jul 15 17:38:30.854940 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:30.854907    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:38:34.765198 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:34.765157    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94"]
Jul 15 17:38:34.768758 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:34.768741    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94"
Jul 15 17:38:34.771405 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:34.771385    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:38:34.777048 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:34.777027    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94"]
Jul 15 17:38:34.856523 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:34.856490    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7dbae10-8c8f-4682-80cd-c87fd90c9fdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94\" (UID: \"b7dbae10-8c8f-4682-80cd-c87fd90c9fdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94"
Jul 15 17:38:34.957377 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:34.957337    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7dbae10-8c8f-4682-80cd-c87fd90c9fdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94\" (UID: \"b7dbae10-8c8f-4682-80cd-c87fd90c9fdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94"
Jul 15 17:38:34.957998 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:34.957976    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7dbae10-8c8f-4682-80cd-c87fd90c9fdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94\" (UID: \"b7dbae10-8c8f-4682-80cd-c87fd90c9fdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94"
Jul 15 17:38:35.080338 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:35.080235    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94"
Jul 15 17:38:35.215201 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:35.215166    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94"]
Jul 15 17:38:35.217011 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:38:35.216983    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7dbae10_8c8f_4682_80cd_c87fd90c9fdd.slice/crio-f8959c59bcde3ed1315908a66184ec5461ee31ad39cb6fe32266a94252d60122 WatchSource:0}: Error finding container f8959c59bcde3ed1315908a66184ec5461ee31ad39cb6fe32266a94252d60122: Status 404 returned error can't find the container with id f8959c59bcde3ed1315908a66184ec5461ee31ad39cb6fe32266a94252d60122
Jul 15 17:38:35.896198 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:35.896173    2556 generic.go:356] "Generic (PLEG): container finished" podID="b7dbae10-8c8f-4682-80cd-c87fd90c9fdd" containerID="c161c1955e659b7a87e4251b55ff5161c88f34b797384b222d4161305dd3af6c" exitCode=0
Jul 15 17:38:35.896509 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:35.896253    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94" event={"ID":"b7dbae10-8c8f-4682-80cd-c87fd90c9fdd","Type":"ContainerDied","Data":"c161c1955e659b7a87e4251b55ff5161c88f34b797384b222d4161305dd3af6c"}
Jul 15 17:38:35.896509 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:35.896307    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94" event={"ID":"b7dbae10-8c8f-4682-80cd-c87fd90c9fdd","Type":"ContainerStarted","Data":"f8959c59bcde3ed1315908a66184ec5461ee31ad39cb6fe32266a94252d60122"}
Jul 15 17:38:37.028627 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:37.028597    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94"
Jul 15 17:38:37.075860 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:37.075821    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7dbae10-8c8f-4682-80cd-c87fd90c9fdd-maas-api-service-ca\") pod \"b7dbae10-8c8f-4682-80cd-c87fd90c9fdd\" (UID: \"b7dbae10-8c8f-4682-80cd-c87fd90c9fdd\") "
Jul 15 17:38:37.076191 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:37.076166    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7dbae10-8c8f-4682-80cd-c87fd90c9fdd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b7dbae10-8c8f-4682-80cd-c87fd90c9fdd" (UID: "b7dbae10-8c8f-4682-80cd-c87fd90c9fdd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:38:37.176923 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:37.176828    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7dbae10-8c8f-4682-80cd-c87fd90c9fdd-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:38:37.913100 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:37.913063    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94"
Jul 15 17:38:37.913100 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:37.913092    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94" event={"ID":"b7dbae10-8c8f-4682-80cd-c87fd90c9fdd","Type":"ContainerDied","Data":"f8959c59bcde3ed1315908a66184ec5461ee31ad39cb6fe32266a94252d60122"}
Jul 15 17:38:37.913356 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:37.913163    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8959c59bcde3ed1315908a66184ec5461ee31ad39cb6fe32266a94252d60122"
Jul 15 17:38:45.639526 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.639491    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"]
Jul 15 17:38:45.640010 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.639760    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt" podUID="5c6b271a-298b-4b18-8abc-3df96794ac0a" containerName="maas-api" containerID="cri-o://06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5" gracePeriod=30
Jul 15 17:38:45.887811 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.887786    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:45.953761 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.953656    2556 generic.go:356] "Generic (PLEG): container finished" podID="5c6b271a-298b-4b18-8abc-3df96794ac0a" containerID="06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5" exitCode=0
Jul 15 17:38:45.953761 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.953698    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"
Jul 15 17:38:45.953761 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.953742    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt" event={"ID":"5c6b271a-298b-4b18-8abc-3df96794ac0a","Type":"ContainerDied","Data":"06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5"}
Jul 15 17:38:45.953967 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.953837    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt" event={"ID":"5c6b271a-298b-4b18-8abc-3df96794ac0a","Type":"ContainerDied","Data":"58eb5197dc89c3f4af65e35b897f14dc745198a08bfdefb3e4791337eed128d7"}
Jul 15 17:38:45.953967 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.953865    2556 scope.go:117] "RemoveContainer" containerID="06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5"
Jul 15 17:38:45.953967 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.953937    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl4cx\" (UniqueName: \"kubernetes.io/projected/5c6b271a-298b-4b18-8abc-3df96794ac0a-kube-api-access-sl4cx\") pod \"5c6b271a-298b-4b18-8abc-3df96794ac0a\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") "
Jul 15 17:38:45.954119 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.953990    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6b271a-298b-4b18-8abc-3df96794ac0a-maas-api-tls\") pod \"5c6b271a-298b-4b18-8abc-3df96794ac0a\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") "
Jul 15 17:38:45.954119 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.954020    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6b271a-298b-4b18-8abc-3df96794ac0a-openshift-service-ca\") pod \"5c6b271a-298b-4b18-8abc-3df96794ac0a\" (UID: \"5c6b271a-298b-4b18-8abc-3df96794ac0a\") "
Jul 15 17:38:45.954555 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.954527    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c6b271a-298b-4b18-8abc-3df96794ac0a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5c6b271a-298b-4b18-8abc-3df96794ac0a" (UID: "5c6b271a-298b-4b18-8abc-3df96794ac0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:38:45.956220 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.956190    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c6b271a-298b-4b18-8abc-3df96794ac0a-kube-api-access-sl4cx" (OuterVolumeSpecName: "kube-api-access-sl4cx") pod "5c6b271a-298b-4b18-8abc-3df96794ac0a" (UID: "5c6b271a-298b-4b18-8abc-3df96794ac0a"). InnerVolumeSpecName "kube-api-access-sl4cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:38:45.956334 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.956254    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6b271a-298b-4b18-8abc-3df96794ac0a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5c6b271a-298b-4b18-8abc-3df96794ac0a" (UID: "5c6b271a-298b-4b18-8abc-3df96794ac0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:38:45.973701 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.973678    2556 scope.go:117] "RemoveContainer" containerID="06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5"
Jul 15 17:38:45.974116 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:38:45.974093    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5\": container with ID starting with 06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5 not found: ID does not exist" containerID="06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5"
Jul 15 17:38:45.974185 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:45.974125    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5"} err="failed to get container status \"06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5\": rpc error: code = NotFound desc = could not find container \"06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5\": container with ID starting with 06254f10215c52146653709fa7dcd5ece8a25b1d5a8d430eb2837dcedcb724e5 not found: ID does not exist"
Jul 15 17:38:46.055589 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:46.055553    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl4cx\" (UniqueName: \"kubernetes.io/projected/5c6b271a-298b-4b18-8abc-3df96794ac0a-kube-api-access-sl4cx\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:38:46.055589 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:46.055584    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c6b271a-298b-4b18-8abc-3df96794ac0a-maas-api-tls\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:38:46.055589 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:46.055595    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c6b271a-298b-4b18-8abc-3df96794ac0a-openshift-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:38:46.276287 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:46.276256    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"]
Jul 15 17:38:46.280646 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:46.280621    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4dfdb7-5c5f547f6d-dmddt"]
Jul 15 17:38:46.365306 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:38:46.365274    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c6b271a-298b-4b18-8abc-3df96794ac0a" path="/var/lib/kubelet/pods/5c6b271a-298b-4b18-8abc-3df96794ac0a/volumes"
Jul 15 17:39:00.924901 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:00.924865    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs"]
Jul 15 17:39:00.925335 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:00.925190    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7dbae10-8c8f-4682-80cd-c87fd90c9fdd" containerName="revoke-keys"
Jul 15 17:39:00.925335 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:00.925201    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7dbae10-8c8f-4682-80cd-c87fd90c9fdd" containerName="revoke-keys"
Jul 15 17:39:00.925335 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:00.925216    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6b271a-298b-4b18-8abc-3df96794ac0a" containerName="maas-api"
Jul 15 17:39:00.925335 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:00.925222    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6b271a-298b-4b18-8abc-3df96794ac0a" containerName="maas-api"
Jul 15 17:39:00.925335 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:00.925277    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6b271a-298b-4b18-8abc-3df96794ac0a" containerName="maas-api"
Jul 15 17:39:00.925335 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:00.925285    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7dbae10-8c8f-4682-80cd-c87fd90c9fdd" containerName="revoke-keys"
Jul 15 17:39:00.929886 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:00.929866    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs"
Jul 15 17:39:00.932634 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:00.932605    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:39:00.936231 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:00.936202    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs"]
Jul 15 17:39:01.088567 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:01.088529    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2777e359-16ff-47b4-8f30-2cd76b2fd25a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs\" (UID: \"2777e359-16ff-47b4-8f30-2cd76b2fd25a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs"
Jul 15 17:39:01.189528 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:01.189437    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2777e359-16ff-47b4-8f30-2cd76b2fd25a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs\" (UID: \"2777e359-16ff-47b4-8f30-2cd76b2fd25a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs"
Jul 15 17:39:01.190101 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:01.190080    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2777e359-16ff-47b4-8f30-2cd76b2fd25a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs\" (UID: \"2777e359-16ff-47b4-8f30-2cd76b2fd25a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs"
Jul 15 17:39:01.241536 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:01.241501    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs"
Jul 15 17:39:01.377825 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:01.377800    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs"]
Jul 15 17:39:01.379668 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:39:01.379641    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2777e359_16ff_47b4_8f30_2cd76b2fd25a.slice/crio-31c01d2ff840a244bb88d5c4df1f15786d6f7714a37d0de5c9c1fd776f6ea889 WatchSource:0}: Error finding container 31c01d2ff840a244bb88d5c4df1f15786d6f7714a37d0de5c9c1fd776f6ea889: Status 404 returned error can't find the container with id 31c01d2ff840a244bb88d5c4df1f15786d6f7714a37d0de5c9c1fd776f6ea889
Jul 15 17:39:02.038603 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:02.038566    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs" event={"ID":"2777e359-16ff-47b4-8f30-2cd76b2fd25a","Type":"ContainerStarted","Data":"8271c3a3cc88576c876b7d5966048419f000e549f2e4a80247f6b8df93c53aa5"}
Jul 15 17:39:02.039205 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:02.038619    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs" event={"ID":"2777e359-16ff-47b4-8f30-2cd76b2fd25a","Type":"ContainerStarted","Data":"31c01d2ff840a244bb88d5c4df1f15786d6f7714a37d0de5c9c1fd776f6ea889"}
Jul 15 17:39:02.055212 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:02.055155    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs" podStartSLOduration=2.055138484 podStartE2EDuration="2.055138484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:39:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:39:02.05349835 +0000 UTC m=+2398.210913180" watchObservedRunningTime="2026-07-15 17:39:02.055138484 +0000 UTC m=+2398.212553374"
Jul 15 17:39:03.045165 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:03.045128    2556 generic.go:356] "Generic (PLEG): container finished" podID="2777e359-16ff-47b4-8f30-2cd76b2fd25a" containerID="8271c3a3cc88576c876b7d5966048419f000e549f2e4a80247f6b8df93c53aa5" exitCode=0
Jul 15 17:39:03.045578 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:03.045206    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs" event={"ID":"2777e359-16ff-47b4-8f30-2cd76b2fd25a","Type":"ContainerDied","Data":"8271c3a3cc88576c876b7d5966048419f000e549f2e4a80247f6b8df93c53aa5"}
Jul 15 17:39:04.184905 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:04.184878    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs"
Jul 15 17:39:04.314594 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:04.314491    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2777e359-16ff-47b4-8f30-2cd76b2fd25a-maas-api-service-ca\") pod \"2777e359-16ff-47b4-8f30-2cd76b2fd25a\" (UID: \"2777e359-16ff-47b4-8f30-2cd76b2fd25a\") "
Jul 15 17:39:04.314920 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:04.314895    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2777e359-16ff-47b4-8f30-2cd76b2fd25a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2777e359-16ff-47b4-8f30-2cd76b2fd25a" (UID: "2777e359-16ff-47b4-8f30-2cd76b2fd25a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:39:04.387544 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:04.387517    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:39:04.397191 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:04.397167    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:39:04.415785 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:04.415752    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2777e359-16ff-47b4-8f30-2cd76b2fd25a-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:39:05.056404 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:05.056372    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs"
Jul 15 17:39:05.056593 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:05.056398    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs" event={"ID":"2777e359-16ff-47b4-8f30-2cd76b2fd25a","Type":"ContainerDied","Data":"31c01d2ff840a244bb88d5c4df1f15786d6f7714a37d0de5c9c1fd776f6ea889"}
Jul 15 17:39:05.056593 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:05.056447    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31c01d2ff840a244bb88d5c4df1f15786d6f7714a37d0de5c9c1fd776f6ea889"
Jul 15 17:39:11.580130 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:11.580097    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"]
Jul 15 17:39:11.580728 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:11.580352    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr" podUID="fe6d6e57-ed35-4b90-9e2a-0043a1b204d8" containerName="maas-api" containerID="cri-o://23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0" gracePeriod=30
Jul 15 17:39:11.832865 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:11.832784    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:39:11.981511 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:11.981475    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-openshift-service-ca\") pod \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") "
Jul 15 17:39:11.981706 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:11.981542    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wnrj\" (UniqueName: \"kubernetes.io/projected/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-kube-api-access-8wnrj\") pod \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") "
Jul 15 17:39:11.981706 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:11.981595    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-maas-api-tls\") pod \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\" (UID: \"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8\") "
Jul 15 17:39:11.981907 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:11.981882    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe6d6e57-ed35-4b90-9e2a-0043a1b204d8" (UID: "fe6d6e57-ed35-4b90-9e2a-0043a1b204d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:39:11.983795 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:11.983756    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-kube-api-access-8wnrj" (OuterVolumeSpecName: "kube-api-access-8wnrj") pod "fe6d6e57-ed35-4b90-9e2a-0043a1b204d8" (UID: "fe6d6e57-ed35-4b90-9e2a-0043a1b204d8"). InnerVolumeSpecName "kube-api-access-8wnrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:39:11.983795 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:11.983761    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe6d6e57-ed35-4b90-9e2a-0043a1b204d8" (UID: "fe6d6e57-ed35-4b90-9e2a-0043a1b204d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:39:12.082511 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.082472    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-openshift-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:39:12.082511 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.082506    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wnrj\" (UniqueName: \"kubernetes.io/projected/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-kube-api-access-8wnrj\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:39:12.082511 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.082516    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8-maas-api-tls\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:39:12.093396 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.093318    2556 generic.go:356] "Generic (PLEG): container finished" podID="fe6d6e57-ed35-4b90-9e2a-0043a1b204d8" containerID="23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0" exitCode=0
Jul 15 17:39:12.093396 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.093366    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"
Jul 15 17:39:12.093552 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.093403    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr" event={"ID":"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8","Type":"ContainerDied","Data":"23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0"}
Jul 15 17:39:12.093552 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.093450    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr" event={"ID":"fe6d6e57-ed35-4b90-9e2a-0043a1b204d8","Type":"ContainerDied","Data":"008712bd0051e185b4d4e1fad9eabb43f4c5fcfdb307538c403bc4a1a09905b8"}
Jul 15 17:39:12.093552 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.093471    2556 scope.go:117] "RemoveContainer" containerID="23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0"
Jul 15 17:39:12.102674 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.102653    2556 scope.go:117] "RemoveContainer" containerID="23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0"
Jul 15 17:39:12.103008 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:39:12.102988    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0\": container with ID starting with 23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0 not found: ID does not exist" containerID="23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0"
Jul 15 17:39:12.103062 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.103016    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0"} err="failed to get container status \"23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0\": rpc error: code = NotFound desc = could not find container \"23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0\": container with ID starting with 23b7f589f59b0423605baeb811d42de950653e41934f43a9a104e8a775ef17b0 not found: ID does not exist"
Jul 15 17:39:12.116207 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.116165    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"]
Jul 15 17:39:12.118584 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.118560    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-feaa2b-5bcc5dd5cc-4gdvr"]
Jul 15 17:39:12.365836 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:12.365752    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe6d6e57-ed35-4b90-9e2a-0043a1b204d8" path="/var/lib/kubelet/pods/fe6d6e57-ed35-4b90-9e2a-0043a1b204d8/volumes"
Jul 15 17:39:30.521445 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.521359    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"]
Jul 15 17:39:30.522030 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.521819    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe6d6e57-ed35-4b90-9e2a-0043a1b204d8" containerName="maas-api"
Jul 15 17:39:30.522030 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.521837    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe6d6e57-ed35-4b90-9e2a-0043a1b204d8" containerName="maas-api"
Jul 15 17:39:30.522030 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.521858    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2777e359-16ff-47b4-8f30-2cd76b2fd25a" containerName="revoke-keys"
Jul 15 17:39:30.522030 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.521866    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2777e359-16ff-47b4-8f30-2cd76b2fd25a" containerName="revoke-keys"
Jul 15 17:39:30.522030 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.521955    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe6d6e57-ed35-4b90-9e2a-0043a1b204d8" containerName="maas-api"
Jul 15 17:39:30.522030 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.521969    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2777e359-16ff-47b4-8f30-2cd76b2fd25a" containerName="revoke-keys"
Jul 15 17:39:30.525866 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.525847    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:30.528375 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.528350    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-0bc296-serving-cert\""
Jul 15 17:39:30.528478 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.528406    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-97jqt\""
Jul 15 17:39:30.539436 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.539398    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"]
Jul 15 17:39:30.645850 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.645806    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:30.645850 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.645853    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt5fn\" (UniqueName: \"kubernetes.io/projected/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-kube-api-access-tt5fn\") pod \"maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:30.646087 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.645933    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-maas-api-tls\") pod \"maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:30.747437 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.747393    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:30.747437 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.747445    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt5fn\" (UniqueName: \"kubernetes.io/projected/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-kube-api-access-tt5fn\") pod \"maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:30.747657 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.747500    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-maas-api-tls\") pod \"maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:30.748113 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.748085    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:30.750036 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.750011    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-maas-api-tls\") pod \"maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:30.756898 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.756870    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt5fn\" (UniqueName: \"kubernetes.io/projected/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-kube-api-access-tt5fn\") pod \"maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:30.839509 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.839413    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:30.970157 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:30.970132    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"]
Jul 15 17:39:30.971981 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:39:30.971953    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a4e6ce_bfe4_40b3_a2fd_cad8c9b4e90b.slice/crio-2e045706242e13762b98bf1dc8726e2c96d1d05474a09dbfd0c7a41b8aae6aca WatchSource:0}: Error finding container 2e045706242e13762b98bf1dc8726e2c96d1d05474a09dbfd0c7a41b8aae6aca: Status 404 returned error can't find the container with id 2e045706242e13762b98bf1dc8726e2c96d1d05474a09dbfd0c7a41b8aae6aca
Jul 15 17:39:31.195189 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:31.195087    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf" event={"ID":"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b","Type":"ContainerStarted","Data":"2e045706242e13762b98bf1dc8726e2c96d1d05474a09dbfd0c7a41b8aae6aca"}
Jul 15 17:39:32.201672 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:32.201624    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf" event={"ID":"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b","Type":"ContainerStarted","Data":"62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317"}
Jul 15 17:39:32.202182 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:32.201745    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:32.224099 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:32.224049    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf" podStartSLOduration=1.2433820070000001 podStartE2EDuration="2.22403353s" totalImagesPullingTime="980.651523ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:39:32.222195806 +0000 UTC m=+2428.379610624" watchObservedRunningTime="2026-07-15 17:39:32.22403353 +0000 UTC m=+2428.381448372"
Jul 15 17:39:38.212090 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.212061    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:39:38.594628 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.594595    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"]
Jul 15 17:39:38.598192 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.598174    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:38.600918 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.600891    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-fadd3e-serving-cert\""
Jul 15 17:39:38.619532 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.619501    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"]
Jul 15 17:39:38.718309 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.718273    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-maas-api-tls\") pod \"maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:38.718484 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.718352    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8mg9\" (UniqueName: \"kubernetes.io/projected/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-kube-api-access-r8mg9\") pod \"maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:38.718484 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.718411    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:38.819506 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.819465    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:38.819506 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.819511    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-maas-api-tls\") pod \"maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:38.819776 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.819557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8mg9\" (UniqueName: \"kubernetes.io/projected/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-kube-api-access-r8mg9\") pod \"maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:38.819776 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:39:38.819689    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-serving-cert: secret "maas-api-e2e-shared-b-fadd3e-serving-cert" not found
Jul 15 17:39:38.819776 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:39:38.819772    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-maas-api-tls podName:f2e922ff-9b3d-4f1a-bfd7-d01c30b78843 nodeName:}" failed. No retries permitted until 2026-07-15 17:39:39.319755203 +0000 UTC m=+2435.477169998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-maas-api-tls") pod "maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb" (UID: "f2e922ff-9b3d-4f1a-bfd7-d01c30b78843") : secret "maas-api-e2e-shared-b-fadd3e-serving-cert" not found
Jul 15 17:39:38.820128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.820107    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:38.832142 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:38.832109    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8mg9\" (UniqueName: \"kubernetes.io/projected/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-kube-api-access-r8mg9\") pod \"maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:39.325135 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:39.325089    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-maas-api-tls\") pod \"maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:39.327535 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:39.327510    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-maas-api-tls\") pod \"maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:39.508357 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:39.508317    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:39.644833 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:39.644805    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"]
Jul 15 17:39:39.646615 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:39:39.646588    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e922ff_9b3d_4f1a_bfd7_d01c30b78843.slice/crio-05ab048dd6c1df32c5ee6c75e6ffb5f6234150a67c920cfae5b7ce2b18a30ac9 WatchSource:0}: Error finding container 05ab048dd6c1df32c5ee6c75e6ffb5f6234150a67c920cfae5b7ce2b18a30ac9: Status 404 returned error can't find the container with id 05ab048dd6c1df32c5ee6c75e6ffb5f6234150a67c920cfae5b7ce2b18a30ac9
Jul 15 17:39:40.240472 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:40.240435    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb" event={"ID":"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843","Type":"ContainerStarted","Data":"e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a"}
Jul 15 17:39:40.240655 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:40.240489    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb" event={"ID":"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843","Type":"ContainerStarted","Data":"05ab048dd6c1df32c5ee6c75e6ffb5f6234150a67c920cfae5b7ce2b18a30ac9"}
Jul 15 17:39:40.240655 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:40.240517    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:40.260893 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:40.260843    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb" podStartSLOduration=1.9875159949999999 podStartE2EDuration="2.260825226s" totalImagesPullingTime="273.309231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:39:40.258560606 +0000 UTC m=+2436.415975447" watchObservedRunningTime="2026-07-15 17:39:40.260825226 +0000 UTC m=+2436.418240100"
Jul 15 17:39:46.250863 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:46.250829    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:39:53.018956 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.018923    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"]
Jul 15 17:39:53.022473 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.022457    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.026067 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.026036    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0bc296\"/\"kube-root-ca.crt\""
Jul 15 17:39:53.026067 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.026048    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0bc296\"/\"default-dockercfg-tds97\""
Jul 15 17:39:53.026304 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.026094    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0bc296\"/\"openshift-service-ca.crt\""
Jul 15 17:39:53.026304 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.026102    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0bc296\"/\"auth-test-model-0bc296-kserve-self-signed-certs\""
Jul 15 17:39:53.032656 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.032632    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"]
Jul 15 17:39:53.156765 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.156691    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dnc8\" (UniqueName: \"kubernetes.io/projected/3aa194ae-0783-4310-84e9-cb5a083a047c-kube-api-access-2dnc8\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.156991 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.156808    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-tmp-dir\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.156991 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.156894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa194ae-0783-4310-84e9-cb5a083a047c-tls-certs\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.156991 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.156957    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-model-cache\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.157141 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.156996    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-dshm\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.157141 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.157022    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-home\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.257810 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.257773    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dnc8\" (UniqueName: \"kubernetes.io/projected/3aa194ae-0783-4310-84e9-cb5a083a047c-kube-api-access-2dnc8\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.257996 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.257828    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-tmp-dir\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.257996 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.257855    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa194ae-0783-4310-84e9-cb5a083a047c-tls-certs\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.257996 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.257880    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-model-cache\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.257996 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.257904    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-dshm\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.257996 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.257922    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-home\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.258289 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.258270    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-tmp-dir\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.258348 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.258295    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-model-cache\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.258412 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.258388    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-home\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.260285 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.260266    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-dshm\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.260459 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.260442    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa194ae-0783-4310-84e9-cb5a083a047c-tls-certs\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.265996 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.265974    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dnc8\" (UniqueName: \"kubernetes.io/projected/3aa194ae-0783-4310-84e9-cb5a083a047c-kube-api-access-2dnc8\") pod \"auth-test-model-0bc296-kserve-65b8dffc9-q49n2\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") " pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.331970 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.331880    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:39:53.466785 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:53.466752    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"]
Jul 15 17:39:53.468883 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:39:53.468857    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3aa194ae_0783_4310_84e9_cb5a083a047c.slice/crio-1b3b947d5d184650146ec8d5a17dc40c376aab403dfcefb09faac62cccd924cb WatchSource:0}: Error finding container 1b3b947d5d184650146ec8d5a17dc40c376aab403dfcefb09faac62cccd924cb: Status 404 returned error can't find the container with id 1b3b947d5d184650146ec8d5a17dc40c376aab403dfcefb09faac62cccd924cb
Jul 15 17:39:54.309088 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:54.309045    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2" event={"ID":"3aa194ae-0783-4310-84e9-cb5a083a047c","Type":"ContainerStarted","Data":"9b9e76ec6434be5033aea89541dbd1a3e9a99c06ce1aa2945e9a370a7651d71d"}
Jul 15 17:39:54.309088 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:54.309093    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2" event={"ID":"3aa194ae-0783-4310-84e9-cb5a083a047c","Type":"ContainerStarted","Data":"1b3b947d5d184650146ec8d5a17dc40c376aab403dfcefb09faac62cccd924cb"}
Jul 15 17:39:54.341050 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:39:54.340994    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2" podStartSLOduration=2.340978253 podStartE2EDuration="2.340978253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:39:54.338284432 +0000 UTC m=+2450.495699242" watchObservedRunningTime="2026-07-15 17:39:54.340978253 +0000 UTC m=+2450.498393116"
Jul 15 17:40:03.332884 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:40:03.332835    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:40:03.333332 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:40:03.332901    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:40:03.345613 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:40:03.345580    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:40:03.365633 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:40:03.365603    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:42:09.849653 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:09.849620    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"]
Jul 15 17:42:24.869475 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:24.869424    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2" podUID="3aa194ae-0783-4310-84e9-cb5a083a047c" containerName="main" containerID="cri-o://9b9e76ec6434be5033aea89541dbd1a3e9a99c06ce1aa2945e9a370a7651d71d" gracePeriod=45
Jul 15 17:42:25.056146 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.056117    2556 generic.go:356] "Generic (PLEG): container finished" podID="3aa194ae-0783-4310-84e9-cb5a083a047c" containerID="9b9e76ec6434be5033aea89541dbd1a3e9a99c06ce1aa2945e9a370a7651d71d" exitCode=0
Jul 15 17:42:25.056304 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.056163    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2" event={"ID":"3aa194ae-0783-4310-84e9-cb5a083a047c","Type":"ContainerDied","Data":"9b9e76ec6434be5033aea89541dbd1a3e9a99c06ce1aa2945e9a370a7651d71d"}
Jul 15 17:42:25.114206 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.114181    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:42:25.206149 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.206057    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa194ae-0783-4310-84e9-cb5a083a047c-tls-certs\") pod \"3aa194ae-0783-4310-84e9-cb5a083a047c\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") "
Jul 15 17:42:25.206149 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.206099    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-tmp-dir\") pod \"3aa194ae-0783-4310-84e9-cb5a083a047c\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") "
Jul 15 17:42:25.206149 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.206130    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-home\") pod \"3aa194ae-0783-4310-84e9-cb5a083a047c\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") "
Jul 15 17:42:25.206149 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.206152    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-dshm\") pod \"3aa194ae-0783-4310-84e9-cb5a083a047c\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") "
Jul 15 17:42:25.206490 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.206285    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dnc8\" (UniqueName: \"kubernetes.io/projected/3aa194ae-0783-4310-84e9-cb5a083a047c-kube-api-access-2dnc8\") pod \"3aa194ae-0783-4310-84e9-cb5a083a047c\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") "
Jul 15 17:42:25.206490 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.206337    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-model-cache\") pod \"3aa194ae-0783-4310-84e9-cb5a083a047c\" (UID: \"3aa194ae-0783-4310-84e9-cb5a083a047c\") "
Jul 15 17:42:25.206490 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.206401    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-home" (OuterVolumeSpecName: "home") pod "3aa194ae-0783-4310-84e9-cb5a083a047c" (UID: "3aa194ae-0783-4310-84e9-cb5a083a047c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:42:25.206490 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.206418    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3aa194ae-0783-4310-84e9-cb5a083a047c" (UID: "3aa194ae-0783-4310-84e9-cb5a083a047c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:42:25.206681 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.206661    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-tmp-dir\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:42:25.206760 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.206686    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-home\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:42:25.206760 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.206705    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-model-cache" (OuterVolumeSpecName: "model-cache") pod "3aa194ae-0783-4310-84e9-cb5a083a047c" (UID: "3aa194ae-0783-4310-84e9-cb5a083a047c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:42:25.208402 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.208377    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-dshm" (OuterVolumeSpecName: "dshm") pod "3aa194ae-0783-4310-84e9-cb5a083a047c" (UID: "3aa194ae-0783-4310-84e9-cb5a083a047c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:42:25.208527 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.208507    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aa194ae-0783-4310-84e9-cb5a083a047c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3aa194ae-0783-4310-84e9-cb5a083a047c" (UID: "3aa194ae-0783-4310-84e9-cb5a083a047c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:42:25.208588 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.208531    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aa194ae-0783-4310-84e9-cb5a083a047c-kube-api-access-2dnc8" (OuterVolumeSpecName: "kube-api-access-2dnc8") pod "3aa194ae-0783-4310-84e9-cb5a083a047c" (UID: "3aa194ae-0783-4310-84e9-cb5a083a047c"). InnerVolumeSpecName "kube-api-access-2dnc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:42:25.307783 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.307744    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa194ae-0783-4310-84e9-cb5a083a047c-tls-certs\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:42:25.307783 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.307775    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-dshm\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:42:25.307783 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.307784    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dnc8\" (UniqueName: \"kubernetes.io/projected/3aa194ae-0783-4310-84e9-cb5a083a047c-kube-api-access-2dnc8\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:42:25.307783 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:25.307794    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3aa194ae-0783-4310-84e9-cb5a083a047c-model-cache\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:42:26.062765 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:26.062734    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"
Jul 15 17:42:26.062765 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:26.062749    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2" event={"ID":"3aa194ae-0783-4310-84e9-cb5a083a047c","Type":"ContainerDied","Data":"1b3b947d5d184650146ec8d5a17dc40c376aab403dfcefb09faac62cccd924cb"}
Jul 15 17:42:26.063286 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:26.062804    2556 scope.go:117] "RemoveContainer" containerID="9b9e76ec6434be5033aea89541dbd1a3e9a99c06ce1aa2945e9a370a7651d71d"
Jul 15 17:42:26.085496 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:26.085468    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"]
Jul 15 17:42:26.096593 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:26.096549    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0bc296/auth-test-model-0bc296-kserve-65b8dffc9-q49n2"]
Jul 15 17:42:26.366128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:26.366022    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aa194ae-0783-4310-84e9-cb5a083a047c" path="/var/lib/kubelet/pods/3aa194ae-0783-4310-84e9-cb5a083a047c/volumes"
Jul 15 17:42:46.720609 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.720577    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"]
Jul 15 17:42:46.721078 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.720959    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aa194ae-0783-4310-84e9-cb5a083a047c" containerName="main"
Jul 15 17:42:46.721078 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.720970    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aa194ae-0783-4310-84e9-cb5a083a047c" containerName="main"
Jul 15 17:42:46.721078 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.721023    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3aa194ae-0783-4310-84e9-cb5a083a047c" containerName="main"
Jul 15 17:42:46.724006 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.723990    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.726777 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.726760    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fadd3e\"/\"kube-root-ca.crt\""
Jul 15 17:42:46.727768 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.727748    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fadd3e\"/\"default-dockercfg-xtz49\""
Jul 15 17:42:46.727768 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.727750    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fadd3e\"/\"sub-test-model-fadd3e-kserve-self-signed-certs\""
Jul 15 17:42:46.727907 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.727800    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fadd3e\"/\"openshift-service-ca.crt\""
Jul 15 17:42:46.732929 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.732907    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"]
Jul 15 17:42:46.797067 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.797029    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87ab375e-fff8-4082-bc2c-bf451d9f3617-tls-certs\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.797247 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.797098    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c4pt\" (UniqueName: \"kubernetes.io/projected/87ab375e-fff8-4082-bc2c-bf451d9f3617-kube-api-access-2c4pt\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.797247 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.797133    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-model-cache\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.797247 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.797158    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-dshm\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.797247 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.797208    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-tmp-dir\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.797387 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.797250    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-home\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.898150 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.898117    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c4pt\" (UniqueName: \"kubernetes.io/projected/87ab375e-fff8-4082-bc2c-bf451d9f3617-kube-api-access-2c4pt\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.898150 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.898151    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-model-cache\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.898409 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.898170    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-dshm\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.898409 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.898191    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-tmp-dir\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.898409 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.898212    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-home\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.898409 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.898268    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87ab375e-fff8-4082-bc2c-bf451d9f3617-tls-certs\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.898635 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.898596    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-model-cache\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.898700 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.898649    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-tmp-dir\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.898800 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.898731    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-home\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.900582 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.900562    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-dshm\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.900943 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.900926    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87ab375e-fff8-4082-bc2c-bf451d9f3617-tls-certs\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:46.907427 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:46.907404    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c4pt\" (UniqueName: \"kubernetes.io/projected/87ab375e-fff8-4082-bc2c-bf451d9f3617-kube-api-access-2c4pt\") pod \"sub-test-model-fadd3e-kserve-6746cd9-8625s\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") " pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:47.034026 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:47.033922    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:47.167679 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:47.167657    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"]
Jul 15 17:42:47.169588 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:42:47.169553    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87ab375e_fff8_4082_bc2c_bf451d9f3617.slice/crio-a4a088f99dc862575cad11a517ffb40ce5ad2143b8963c67ff46c78cf59647d0 WatchSource:0}: Error finding container a4a088f99dc862575cad11a517ffb40ce5ad2143b8963c67ff46c78cf59647d0: Status 404 returned error can't find the container with id a4a088f99dc862575cad11a517ffb40ce5ad2143b8963c67ff46c78cf59647d0
Jul 15 17:42:48.176503 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:48.176463    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s" event={"ID":"87ab375e-fff8-4082-bc2c-bf451d9f3617","Type":"ContainerStarted","Data":"a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4"}
Jul 15 17:42:48.176921 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:48.176511    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s" event={"ID":"87ab375e-fff8-4082-bc2c-bf451d9f3617","Type":"ContainerStarted","Data":"a4a088f99dc862575cad11a517ffb40ce5ad2143b8963c67ff46c78cf59647d0"}
Jul 15 17:42:48.194903 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:48.194848    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s" podStartSLOduration=2.194832122 podStartE2EDuration="2.194832122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:42:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:42:48.193116434 +0000 UTC m=+2624.350531266" watchObservedRunningTime="2026-07-15 17:42:48.194832122 +0000 UTC m=+2624.352246936"
Jul 15 17:42:57.034158 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:57.034118    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:57.034639 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:57.034180    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:57.046585 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:57.046556    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:42:57.240339 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:42:57.240307    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:43:30.834770 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:30.834732    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"]
Jul 15 17:43:45.855019 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:45.854945    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s" podUID="87ab375e-fff8-4082-bc2c-bf451d9f3617" containerName="main" containerID="cri-o://a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4" gracePeriod=45
Jul 15 17:43:46.103756 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.103702    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:43:46.125398 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.125295    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87ab375e-fff8-4082-bc2c-bf451d9f3617-tls-certs\") pod \"87ab375e-fff8-4082-bc2c-bf451d9f3617\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") "
Jul 15 17:43:46.125398 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.125351    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2c4pt\" (UniqueName: \"kubernetes.io/projected/87ab375e-fff8-4082-bc2c-bf451d9f3617-kube-api-access-2c4pt\") pod \"87ab375e-fff8-4082-bc2c-bf451d9f3617\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") "
Jul 15 17:43:46.125632 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.125433    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-home\") pod \"87ab375e-fff8-4082-bc2c-bf451d9f3617\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") "
Jul 15 17:43:46.125632 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.125466    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-dshm\") pod \"87ab375e-fff8-4082-bc2c-bf451d9f3617\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") "
Jul 15 17:43:46.125632 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.125494    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-model-cache\") pod \"87ab375e-fff8-4082-bc2c-bf451d9f3617\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") "
Jul 15 17:43:46.125632 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.125514    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-tmp-dir\") pod \"87ab375e-fff8-4082-bc2c-bf451d9f3617\" (UID: \"87ab375e-fff8-4082-bc2c-bf451d9f3617\") "
Jul 15 17:43:46.126016 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.125980    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-home" (OuterVolumeSpecName: "home") pod "87ab375e-fff8-4082-bc2c-bf451d9f3617" (UID: "87ab375e-fff8-4082-bc2c-bf451d9f3617"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:43:46.126324 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.126300    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "87ab375e-fff8-4082-bc2c-bf451d9f3617" (UID: "87ab375e-fff8-4082-bc2c-bf451d9f3617"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:43:46.126458 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.126420    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-model-cache" (OuterVolumeSpecName: "model-cache") pod "87ab375e-fff8-4082-bc2c-bf451d9f3617" (UID: "87ab375e-fff8-4082-bc2c-bf451d9f3617"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:43:46.128048 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.128010    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87ab375e-fff8-4082-bc2c-bf451d9f3617-kube-api-access-2c4pt" (OuterVolumeSpecName: "kube-api-access-2c4pt") pod "87ab375e-fff8-4082-bc2c-bf451d9f3617" (UID: "87ab375e-fff8-4082-bc2c-bf451d9f3617"). InnerVolumeSpecName "kube-api-access-2c4pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:43:46.128550 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.128510    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87ab375e-fff8-4082-bc2c-bf451d9f3617-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "87ab375e-fff8-4082-bc2c-bf451d9f3617" (UID: "87ab375e-fff8-4082-bc2c-bf451d9f3617"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:43:46.128644 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.128555    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-dshm" (OuterVolumeSpecName: "dshm") pod "87ab375e-fff8-4082-bc2c-bf451d9f3617" (UID: "87ab375e-fff8-4082-bc2c-bf451d9f3617"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:43:46.226451 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.226415    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87ab375e-fff8-4082-bc2c-bf451d9f3617-tls-certs\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:43:46.226451 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.226441    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2c4pt\" (UniqueName: \"kubernetes.io/projected/87ab375e-fff8-4082-bc2c-bf451d9f3617-kube-api-access-2c4pt\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:43:46.226451 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.226450    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-home\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:43:46.226451 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.226459    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-dshm\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:43:46.226773 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.226467    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-model-cache\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:43:46.226773 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.226498    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87ab375e-fff8-4082-bc2c-bf451d9f3617-tmp-dir\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:43:46.473398 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.473367    2556 generic.go:356] "Generic (PLEG): container finished" podID="87ab375e-fff8-4082-bc2c-bf451d9f3617" containerID="a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4" exitCode=0
Jul 15 17:43:46.473583 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.473413    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"
Jul 15 17:43:46.473583 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.473430    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s" event={"ID":"87ab375e-fff8-4082-bc2c-bf451d9f3617","Type":"ContainerDied","Data":"a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4"}
Jul 15 17:43:46.473583 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.473462    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s" event={"ID":"87ab375e-fff8-4082-bc2c-bf451d9f3617","Type":"ContainerDied","Data":"a4a088f99dc862575cad11a517ffb40ce5ad2143b8963c67ff46c78cf59647d0"}
Jul 15 17:43:46.473583 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.473478    2556 scope.go:117] "RemoveContainer" containerID="a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4"
Jul 15 17:43:46.481993 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.481957    2556 scope.go:117] "RemoveContainer" containerID="a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4"
Jul 15 17:43:46.482264 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:43:46.482246    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4\": container with ID starting with a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4 not found: ID does not exist" containerID="a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4"
Jul 15 17:43:46.482320 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.482273    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4"} err="failed to get container status \"a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4\": rpc error: code = NotFound desc = could not find container \"a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4\": container with ID starting with a33109c1c2d5a42938cf321fc54928a689a0c5805aeb2db8b8a1de5e0c1317a4 not found: ID does not exist"
Jul 15 17:43:46.490526 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.490502    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"]
Jul 15 17:43:46.494297 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:46.494276    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/sub-test-model-fadd3e-kserve-6746cd9-8625s"]
Jul 15 17:43:48.365343 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:43:48.365300    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87ab375e-fff8-4082-bc2c-bf451d9f3617" path="/var/lib/kubelet/pods/87ab375e-fff8-4082-bc2c-bf451d9f3617/volumes"
Jul 15 17:44:04.421242 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:04.421208    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:44:04.432054 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:04.432032    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptpxl_e9cd766e-023b-4016-a8a8-018d2e7e5ab4/ovn-acl-logging/0.log"
Jul 15 17:44:29.625091 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.625056    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"]
Jul 15 17:44:29.625508 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.625389    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ab375e-fff8-4082-bc2c-bf451d9f3617" containerName="main"
Jul 15 17:44:29.625508 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.625399    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ab375e-fff8-4082-bc2c-bf451d9f3617" containerName="main"
Jul 15 17:44:29.625508 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.625474    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ab375e-fff8-4082-bc2c-bf451d9f3617" containerName="main"
Jul 15 17:44:29.628521 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.628504    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.630914 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.630879    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fadd3e\"/\"openshift-service-ca.crt\""
Jul 15 17:44:29.630914 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.630913    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fadd3e\"/\"default-dockercfg-xtz49\""
Jul 15 17:44:29.631950 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.631930    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fadd3e\"/\"kube-root-ca.crt\""
Jul 15 17:44:29.632153 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.632132    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fadd3e\"/\"rate-test-model-fadd3e-kserve-self-signed-certs\""
Jul 15 17:44:29.639436 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.639418    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"]
Jul 15 17:44:29.715759 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.715702    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tmp-dir\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.715945 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.715793    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-home\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.715945 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.715817    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tls-certs\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.715945 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.715876    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-model-cache\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.715945 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.715903    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-dshm\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.715945 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.715921    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqhgj\" (UniqueName: \"kubernetes.io/projected/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-kube-api-access-bqhgj\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.816820 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.816789    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-model-cache\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.817028 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.816827    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-dshm\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.817028 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.816845    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqhgj\" (UniqueName: \"kubernetes.io/projected/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-kube-api-access-bqhgj\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.817028 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.816890    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tmp-dir\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.817028 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.816929    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-home\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.817028 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.816953    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tls-certs\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.817339 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.817315    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-model-cache\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.817403 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.817366    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tmp-dir\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.817403 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.817380    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-home\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.819049 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.819024    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-dshm\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.819315 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.819297    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tls-certs\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.825267 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.825243    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqhgj\" (UniqueName: \"kubernetes.io/projected/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-kube-api-access-bqhgj\") pod \"rate-test-model-fadd3e-kserve-669db7655-6mtf5\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") " pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:29.938100 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:29.938008    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:30.066296 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:30.066269    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"]
Jul 15 17:44:30.068348 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:44:30.068322    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ca3577f_08ec_4ca3_81f7_2ae528b1d752.slice/crio-0e5ba7f7ae7eb10a717805b73dfa687d9a3b5c52180877bba17787dd9a4025ad WatchSource:0}: Error finding container 0e5ba7f7ae7eb10a717805b73dfa687d9a3b5c52180877bba17787dd9a4025ad: Status 404 returned error can't find the container with id 0e5ba7f7ae7eb10a717805b73dfa687d9a3b5c52180877bba17787dd9a4025ad
Jul 15 17:44:30.690207 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:30.690167    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5" event={"ID":"3ca3577f-08ec-4ca3-81f7-2ae528b1d752","Type":"ContainerStarted","Data":"9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed"}
Jul 15 17:44:30.690606 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:30.690221    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5" event={"ID":"3ca3577f-08ec-4ca3-81f7-2ae528b1d752","Type":"ContainerStarted","Data":"0e5ba7f7ae7eb10a717805b73dfa687d9a3b5c52180877bba17787dd9a4025ad"}
Jul 15 17:44:30.709668 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:30.709615    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5" podStartSLOduration=1.709599305 podStartE2EDuration="1.709599305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:44:30.707982275 +0000 UTC m=+2726.865397115" watchObservedRunningTime="2026-07-15 17:44:30.709599305 +0000 UTC m=+2726.867014119"
Jul 15 17:44:39.938450 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:39.938407    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:39.938450 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:39.938463    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:39.950765 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:39.950739    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:44:40.752383 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:44:40.752350    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:45:00.134189 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.134149    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6"]
Jul 15 17:45:00.138201 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.138176    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p"]
Jul 15 17:45:00.138362 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.138297    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6"
Jul 15 17:45:00.140870 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.140846    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:45:00.141435 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.141417    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q"]
Jul 15 17:45:00.141545 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.141527    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p"
Jul 15 17:45:00.144856 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.144834    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q"
Jul 15 17:45:00.147482 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.147366    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6"]
Jul 15 17:45:00.151358 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.151337    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p"]
Jul 15 17:45:00.153857 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.153834    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6"
Jul 15 17:45:00.154593 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.154566    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q"]
Jul 15 17:45:00.160813 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.160792    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p"
Jul 15 17:45:00.189660 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.189633    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q"
Jul 15 17:45:00.313288 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.313263    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6"]
Jul 15 17:45:00.317534 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:45:00.317489    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9c38e34_a5f7_414f_8330_5ff6f3a8bb55.slice/crio-f0c98f6e61b8ce503185540d7e60240fe4fbebe40af3d9f12d829a6b69cb6b21 WatchSource:0}: Error finding container f0c98f6e61b8ce503185540d7e60240fe4fbebe40af3d9f12d829a6b69cb6b21: Status 404 returned error can't find the container with id f0c98f6e61b8ce503185540d7e60240fe4fbebe40af3d9f12d829a6b69cb6b21
Jul 15 17:45:00.341315 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.341285    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p"]
Jul 15 17:45:00.354958 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:45:00.354931    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef71c25a_3ac9_41f2_b00d_e7e4f920492a.slice/crio-fdc4d11157260561bc3cdc165062a3444318f31c225553d72256c1dfd6f88308 WatchSource:0}: Error finding container fdc4d11157260561bc3cdc165062a3444318f31c225553d72256c1dfd6f88308: Status 404 returned error can't find the container with id fdc4d11157260561bc3cdc165062a3444318f31c225553d72256c1dfd6f88308
Jul 15 17:45:00.375087 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.375061    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q"]
Jul 15 17:45:00.376654 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:45:00.376630    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8bd138_1017_4e2b_9f15_aed662e25654.slice/crio-343d0434ff3dbb1ae0e58dfb70deb361924cce172cf67876a8bd50759fe8dd3f WatchSource:0}: Error finding container 343d0434ff3dbb1ae0e58dfb70deb361924cce172cf67876a8bd50759fe8dd3f: Status 404 returned error can't find the container with id 343d0434ff3dbb1ae0e58dfb70deb361924cce172cf67876a8bd50759fe8dd3f
Jul 15 17:45:00.841655 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.841617    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p" event={"ID":"ef71c25a-3ac9-41f2-b00d-e7e4f920492a","Type":"ContainerStarted","Data":"8727d5622c2b0f84fed7d7a0a9789931a4d3a78da7be18de66e7caed268e671e"}
Jul 15 17:45:00.841874 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.841729    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p" event={"ID":"ef71c25a-3ac9-41f2-b00d-e7e4f920492a","Type":"ContainerStarted","Data":"fdc4d11157260561bc3cdc165062a3444318f31c225553d72256c1dfd6f88308"}
Jul 15 17:45:00.843147 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.843122    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q" event={"ID":"fc8bd138-1017-4e2b-9f15-aed662e25654","Type":"ContainerStarted","Data":"4cdad75df19b970636dfa95d206a86df8dfa5e86d93411bc273a62519b4d87ec"}
Jul 15 17:45:00.843278 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.843167    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q" event={"ID":"fc8bd138-1017-4e2b-9f15-aed662e25654","Type":"ContainerStarted","Data":"343d0434ff3dbb1ae0e58dfb70deb361924cce172cf67876a8bd50759fe8dd3f"}
Jul 15 17:45:00.844670 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.844639    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6" event={"ID":"e9c38e34-a5f7-414f-8330-5ff6f3a8bb55","Type":"ContainerStarted","Data":"9e88d722b2511197a6d4e73a21206433d3b740d5851403c0b17e6d1a0907c1ad"}
Jul 15 17:45:00.844827 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.844692    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6" event={"ID":"e9c38e34-a5f7-414f-8330-5ff6f3a8bb55","Type":"ContainerStarted","Data":"f0c98f6e61b8ce503185540d7e60240fe4fbebe40af3d9f12d829a6b69cb6b21"}
Jul 15 17:45:00.855328 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.855277    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p" podStartSLOduration=0.855260051 podStartE2EDuration="855.260051ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:45:00.855086289 +0000 UTC m=+2757.012501104" watchObservedRunningTime="2026-07-15 17:45:00.855260051 +0000 UTC m=+2757.012674866"
Jul 15 17:45:00.870377 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.870324    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q" podStartSLOduration=0.87030961 podStartE2EDuration="870.30961ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:45:00.868446724 +0000 UTC m=+2757.025861540" watchObservedRunningTime="2026-07-15 17:45:00.87030961 +0000 UTC m=+2757.027724423"
Jul 15 17:45:00.883409 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:00.883360    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6" podStartSLOduration=0.883343958 podStartE2EDuration="883.343958ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:45:00.881482924 +0000 UTC m=+2757.038897741" watchObservedRunningTime="2026-07-15 17:45:00.883343958 +0000 UTC m=+2757.040758772"
Jul 15 17:45:01.852577 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:01.852543    2556 generic.go:356] "Generic (PLEG): container finished" podID="ef71c25a-3ac9-41f2-b00d-e7e4f920492a" containerID="8727d5622c2b0f84fed7d7a0a9789931a4d3a78da7be18de66e7caed268e671e" exitCode=0
Jul 15 17:45:01.853033 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:01.852628    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p" event={"ID":"ef71c25a-3ac9-41f2-b00d-e7e4f920492a","Type":"ContainerDied","Data":"8727d5622c2b0f84fed7d7a0a9789931a4d3a78da7be18de66e7caed268e671e"}
Jul 15 17:45:01.854245 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:01.854226    2556 generic.go:356] "Generic (PLEG): container finished" podID="fc8bd138-1017-4e2b-9f15-aed662e25654" containerID="4cdad75df19b970636dfa95d206a86df8dfa5e86d93411bc273a62519b4d87ec" exitCode=0
Jul 15 17:45:01.854331 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:01.854306    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q" event={"ID":"fc8bd138-1017-4e2b-9f15-aed662e25654","Type":"ContainerDied","Data":"4cdad75df19b970636dfa95d206a86df8dfa5e86d93411bc273a62519b4d87ec"}
Jul 15 17:45:01.855605 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:01.855583    2556 generic.go:356] "Generic (PLEG): container finished" podID="e9c38e34-a5f7-414f-8330-5ff6f3a8bb55" containerID="9e88d722b2511197a6d4e73a21206433d3b740d5851403c0b17e6d1a0907c1ad" exitCode=0
Jul 15 17:45:01.855707 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:01.855607    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6" event={"ID":"e9c38e34-a5f7-414f-8330-5ff6f3a8bb55","Type":"ContainerDied","Data":"9e88d722b2511197a6d4e73a21206433d3b740d5851403c0b17e6d1a0907c1ad"}
Jul 15 17:45:03.010861 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.010831    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q"
Jul 15 17:45:03.038220 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.038193    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6"
Jul 15 17:45:03.042531 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.042506    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p"
Jul 15 17:45:03.869247 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.869221    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q"
Jul 15 17:45:03.869247 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.869237    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q" event={"ID":"fc8bd138-1017-4e2b-9f15-aed662e25654","Type":"ContainerDied","Data":"343d0434ff3dbb1ae0e58dfb70deb361924cce172cf67876a8bd50759fe8dd3f"}
Jul 15 17:45:03.869471 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.869285    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="343d0434ff3dbb1ae0e58dfb70deb361924cce172cf67876a8bd50759fe8dd3f"
Jul 15 17:45:03.870557 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.870540    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6"
Jul 15 17:45:03.870649 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.870603    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735625-qwqv6" event={"ID":"e9c38e34-a5f7-414f-8330-5ff6f3a8bb55","Type":"ContainerDied","Data":"f0c98f6e61b8ce503185540d7e60240fe4fbebe40af3d9f12d829a6b69cb6b21"}
Jul 15 17:45:03.870649 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.870638    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0c98f6e61b8ce503185540d7e60240fe4fbebe40af3d9f12d829a6b69cb6b21"
Jul 15 17:45:03.871795 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.871774    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p" event={"ID":"ef71c25a-3ac9-41f2-b00d-e7e4f920492a","Type":"ContainerDied","Data":"fdc4d11157260561bc3cdc165062a3444318f31c225553d72256c1dfd6f88308"}
Jul 15 17:45:03.871894 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.871809    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdc4d11157260561bc3cdc165062a3444318f31c225553d72256c1dfd6f88308"
Jul 15 17:45:03.871894 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:03.871822    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p"
Jul 15 17:45:15.600388 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:15.600352    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"]
Jul 15 17:45:19.617323 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.617284    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7471-140678538158896"]
Jul 15 17:45:19.617697 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.617628    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc8bd138-1017-4e2b-9f15-aed662e25654" containerName="cleanup"
Jul 15 17:45:19.617697 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.617638    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc8bd138-1017-4e2b-9f15-aed662e25654" containerName="cleanup"
Jul 15 17:45:19.617697 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.617651    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9c38e34-a5f7-414f-8330-5ff6f3a8bb55" containerName="cleanup"
Jul 15 17:45:19.617697 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.617658    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9c38e34-a5f7-414f-8330-5ff6f3a8bb55" containerName="cleanup"
Jul 15 17:45:19.617697 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.617665    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef71c25a-3ac9-41f2-b00d-e7e4f920492a" containerName="cleanup"
Jul 15 17:45:19.617697 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.617670    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef71c25a-3ac9-41f2-b00d-e7e4f920492a" containerName="cleanup"
Jul 15 17:45:19.617916 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.617737    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc8bd138-1017-4e2b-9f15-aed662e25654" containerName="cleanup"
Jul 15 17:45:19.617916 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.617747    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9c38e34-a5f7-414f-8330-5ff6f3a8bb55" containerName="cleanup"
Jul 15 17:45:19.617916 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.617755    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef71c25a-3ac9-41f2-b00d-e7e4f920492a" containerName="cleanup"
Jul 15 17:45:19.620358 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.620342    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7471-140678538158896"
Jul 15 17:45:19.623029 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.623012    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9h7r7\""
Jul 15 17:45:19.629788 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.629765    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7471-140678538158896"]
Jul 15 17:45:19.662632 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.662599    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbkgc\" (UniqueName: \"kubernetes.io/projected/b1813acd-b6ed-47d7-9982-fa4bb96bef08-kube-api-access-gbkgc\") pod \"test-curl-7471-140678538158896\" (UID: \"b1813acd-b6ed-47d7-9982-fa4bb96bef08\") " pod="opendatahub/test-curl-7471-140678538158896"
Jul 15 17:45:19.763548 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.763507    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbkgc\" (UniqueName: \"kubernetes.io/projected/b1813acd-b6ed-47d7-9982-fa4bb96bef08-kube-api-access-gbkgc\") pod \"test-curl-7471-140678538158896\" (UID: \"b1813acd-b6ed-47d7-9982-fa4bb96bef08\") " pod="opendatahub/test-curl-7471-140678538158896"
Jul 15 17:45:19.773500 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.773477    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbkgc\" (UniqueName: \"kubernetes.io/projected/b1813acd-b6ed-47d7-9982-fa4bb96bef08-kube-api-access-gbkgc\") pod \"test-curl-7471-140678538158896\" (UID: \"b1813acd-b6ed-47d7-9982-fa4bb96bef08\") " pod="opendatahub/test-curl-7471-140678538158896"
Jul 15 17:45:19.929589 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:19.929498    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7471-140678538158896"
Jul 15 17:45:20.071478 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:20.071453    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7471-140678538158896"]
Jul 15 17:45:20.073496 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:45:20.073473    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1813acd_b6ed_47d7_9982_fa4bb96bef08.slice/crio-1b95d1112b5c54f4ad77c37a13893e518e8e39149de9c9c433b28b0484cdd9ee WatchSource:0}: Error finding container 1b95d1112b5c54f4ad77c37a13893e518e8e39149de9c9c433b28b0484cdd9ee: Status 404 returned error can't find the container with id 1b95d1112b5c54f4ad77c37a13893e518e8e39149de9c9c433b28b0484cdd9ee
Jul 15 17:45:20.075044 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:20.075026    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 17:45:20.956895 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:20.956860    2556 generic.go:356] "Generic (PLEG): container finished" podID="b1813acd-b6ed-47d7-9982-fa4bb96bef08" containerID="88c69ef099d00ee8d3ad88ec355a02fed7a8ea12bcf4a7da619c380f972b4edf" exitCode=0
Jul 15 17:45:20.957348 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:20.956940    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7471-140678538158896" event={"ID":"b1813acd-b6ed-47d7-9982-fa4bb96bef08","Type":"ContainerDied","Data":"88c69ef099d00ee8d3ad88ec355a02fed7a8ea12bcf4a7da619c380f972b4edf"}
Jul 15 17:45:20.957348 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:20.956986    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7471-140678538158896" event={"ID":"b1813acd-b6ed-47d7-9982-fa4bb96bef08","Type":"ContainerStarted","Data":"1b95d1112b5c54f4ad77c37a13893e518e8e39149de9c9c433b28b0484cdd9ee"}
Jul 15 17:45:22.094113 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:22.094087    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7471-140678538158896"
Jul 15 17:45:22.132426 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:22.132399    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7471-140678538158896_b1813acd-b6ed-47d7-9982-fa4bb96bef08/test-curl-7471-140678538158896/0.log"
Jul 15 17:45:22.165241 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:22.165211    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7471-140678538158896"]
Jul 15 17:45:22.174308 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:22.174285    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7471-140678538158896"]
Jul 15 17:45:22.185360 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:22.185340    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbkgc\" (UniqueName: \"kubernetes.io/projected/b1813acd-b6ed-47d7-9982-fa4bb96bef08-kube-api-access-gbkgc\") pod \"b1813acd-b6ed-47d7-9982-fa4bb96bef08\" (UID: \"b1813acd-b6ed-47d7-9982-fa4bb96bef08\") "
Jul 15 17:45:22.187437 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:22.187410    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1813acd-b6ed-47d7-9982-fa4bb96bef08-kube-api-access-gbkgc" (OuterVolumeSpecName: "kube-api-access-gbkgc") pod "b1813acd-b6ed-47d7-9982-fa4bb96bef08" (UID: "b1813acd-b6ed-47d7-9982-fa4bb96bef08"). InnerVolumeSpecName "kube-api-access-gbkgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:45:22.286081 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:22.286034    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbkgc\" (UniqueName: \"kubernetes.io/projected/b1813acd-b6ed-47d7-9982-fa4bb96bef08-kube-api-access-gbkgc\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:45:22.371893 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:22.371864    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1813acd-b6ed-47d7-9982-fa4bb96bef08" path="/var/lib/kubelet/pods/b1813acd-b6ed-47d7-9982-fa4bb96bef08/volumes"
Jul 15 17:45:22.967861 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:22.967836    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7471-140678538158896"
Jul 15 17:45:22.968064 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:22.967894    2556 scope.go:117] "RemoveContainer" containerID="88c69ef099d00ee8d3ad88ec355a02fed7a8ea12bcf4a7da619c380f972b4edf"
Jul 15 17:45:30.619734 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.619607    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5" podUID="3ca3577f-08ec-4ca3-81f7-2ae528b1d752" containerName="main" containerID="cri-o://9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed" gracePeriod=45
Jul 15 17:45:30.741741 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.741683    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5" podUID="3ca3577f-08ec-4ca3-81f7-2ae528b1d752" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": dial tcp 10.133.0.57:8000: connect: connection refused"
Jul 15 17:45:30.872867 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.872800    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:45:30.958695 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.958657    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-home\") pod \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") "
Jul 15 17:45:30.958859 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.958763    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-model-cache\") pod \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") "
Jul 15 17:45:30.958859 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.958789    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-dshm\") pod \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") "
Jul 15 17:45:30.958859 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.958831    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tmp-dir\") pod \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") "
Jul 15 17:45:30.959052 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.958864    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqhgj\" (UniqueName: \"kubernetes.io/projected/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-kube-api-access-bqhgj\") pod \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") "
Jul 15 17:45:30.959052 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.958910    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tls-certs\") pod \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\" (UID: \"3ca3577f-08ec-4ca3-81f7-2ae528b1d752\") "
Jul 15 17:45:30.959052 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.958957    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-home" (OuterVolumeSpecName: "home") pod "3ca3577f-08ec-4ca3-81f7-2ae528b1d752" (UID: "3ca3577f-08ec-4ca3-81f7-2ae528b1d752"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:45:30.959220 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.959055    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ca3577f-08ec-4ca3-81f7-2ae528b1d752" (UID: "3ca3577f-08ec-4ca3-81f7-2ae528b1d752"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:45:30.959220 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.959130    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3ca3577f-08ec-4ca3-81f7-2ae528b1d752" (UID: "3ca3577f-08ec-4ca3-81f7-2ae528b1d752"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:45:30.959324 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.959220    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-home\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:45:30.959324 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.959236    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-model-cache\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:45:30.959324 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.959250    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tmp-dir\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:45:30.961000 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.960970    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-dshm" (OuterVolumeSpecName: "dshm") pod "3ca3577f-08ec-4ca3-81f7-2ae528b1d752" (UID: "3ca3577f-08ec-4ca3-81f7-2ae528b1d752"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:45:30.961213 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.961187    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-kube-api-access-bqhgj" (OuterVolumeSpecName: "kube-api-access-bqhgj") pod "3ca3577f-08ec-4ca3-81f7-2ae528b1d752" (UID: "3ca3577f-08ec-4ca3-81f7-2ae528b1d752"). InnerVolumeSpecName "kube-api-access-bqhgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:45:30.961322 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:30.961304    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3ca3577f-08ec-4ca3-81f7-2ae528b1d752" (UID: "3ca3577f-08ec-4ca3-81f7-2ae528b1d752"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:45:31.010344 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.010314    2556 generic.go:356] "Generic (PLEG): container finished" podID="3ca3577f-08ec-4ca3-81f7-2ae528b1d752" containerID="9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed" exitCode=0
Jul 15 17:45:31.010522 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.010374    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"
Jul 15 17:45:31.010522 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.010400    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5" event={"ID":"3ca3577f-08ec-4ca3-81f7-2ae528b1d752","Type":"ContainerDied","Data":"9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed"}
Jul 15 17:45:31.010522 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.010440    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5" event={"ID":"3ca3577f-08ec-4ca3-81f7-2ae528b1d752","Type":"ContainerDied","Data":"0e5ba7f7ae7eb10a717805b73dfa687d9a3b5c52180877bba17787dd9a4025ad"}
Jul 15 17:45:31.010522 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.010456    2556 scope.go:117] "RemoveContainer" containerID="9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed"
Jul 15 17:45:31.019892 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.019872    2556 scope.go:117] "RemoveContainer" containerID="9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed"
Jul 15 17:45:31.020165 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:45:31.020147    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed\": container with ID starting with 9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed not found: ID does not exist" containerID="9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed"
Jul 15 17:45:31.020214 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.020175    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed"} err="failed to get container status \"9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed\": rpc error: code = NotFound desc = could not find container \"9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed\": container with ID starting with 9893889253e55fcd198e1e004ccc17e650b5b21b2863141bb1f4f5e2e8f971ed not found: ID does not exist"
Jul 15 17:45:31.031910 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.031883    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"]
Jul 15 17:45:31.036766 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.036744    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fadd3e/rate-test-model-fadd3e-kserve-669db7655-6mtf5"]
Jul 15 17:45:31.060133 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.060106    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqhgj\" (UniqueName: \"kubernetes.io/projected/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-kube-api-access-bqhgj\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:45:31.060237 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.060138    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-tls-certs\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:45:31.060237 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:31.060151    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca3577f-08ec-4ca3-81f7-2ae528b1d752-dshm\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:45:32.365783 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:32.365748    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ca3577f-08ec-4ca3-81f7-2ae528b1d752" path="/var/lib/kubelet/pods/3ca3577f-08ec-4ca3-81f7-2ae528b1d752/volumes"
Jul 15 17:45:33.827514 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.827473    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn"]
Jul 15 17:45:33.828026 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.827985    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1813acd-b6ed-47d7-9982-fa4bb96bef08" containerName="test-curl-7471-140678538158896"
Jul 15 17:45:33.828026 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.828005    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1813acd-b6ed-47d7-9982-fa4bb96bef08" containerName="test-curl-7471-140678538158896"
Jul 15 17:45:33.828026 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.828024    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ca3577f-08ec-4ca3-81f7-2ae528b1d752" containerName="main"
Jul 15 17:45:33.828191 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.828033    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ca3577f-08ec-4ca3-81f7-2ae528b1d752" containerName="main"
Jul 15 17:45:33.828191 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.828114    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1813acd-b6ed-47d7-9982-fa4bb96bef08" containerName="test-curl-7471-140678538158896"
Jul 15 17:45:33.828191 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.828129    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ca3577f-08ec-4ca3-81f7-2ae528b1d752" containerName="main"
Jul 15 17:45:33.832787 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.832765    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn"
Jul 15 17:45:33.835345 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.835320    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:45:33.843222 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.843192    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn"]
Jul 15 17:45:33.886196 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.886157    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76e3b92-4fc1-40b0-be8a-254b0edbd214-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn\" (UID: \"c76e3b92-4fc1-40b0-be8a-254b0edbd214\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn"
Jul 15 17:45:33.987207 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.987171    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76e3b92-4fc1-40b0-be8a-254b0edbd214-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn\" (UID: \"c76e3b92-4fc1-40b0-be8a-254b0edbd214\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn"
Jul 15 17:45:33.987835 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:33.987816    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76e3b92-4fc1-40b0-be8a-254b0edbd214-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn\" (UID: \"c76e3b92-4fc1-40b0-be8a-254b0edbd214\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn"
Jul 15 17:45:34.143602 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:34.143495    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn"
Jul 15 17:45:34.275894 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:34.275858    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn"]
Jul 15 17:45:34.278851 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:45:34.278822    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76e3b92_4fc1_40b0_be8a_254b0edbd214.slice/crio-2e6223fbd634197d07e0a19034d08f7a5937c55bbe96e31b36edd53abf932082 WatchSource:0}: Error finding container 2e6223fbd634197d07e0a19034d08f7a5937c55bbe96e31b36edd53abf932082: Status 404 returned error can't find the container with id 2e6223fbd634197d07e0a19034d08f7a5937c55bbe96e31b36edd53abf932082
Jul 15 17:45:35.034667 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:35.034632    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn" event={"ID":"c76e3b92-4fc1-40b0-be8a-254b0edbd214","Type":"ContainerStarted","Data":"6aef25edab1e0529df0d0a53e0dbda08d973edba6ecb179640a3af6e21ca680e"}
Jul 15 17:45:35.035095 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:35.034741    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn" event={"ID":"c76e3b92-4fc1-40b0-be8a-254b0edbd214","Type":"ContainerStarted","Data":"2e6223fbd634197d07e0a19034d08f7a5937c55bbe96e31b36edd53abf932082"}
Jul 15 17:45:35.053277 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:35.053212    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn" podStartSLOduration=2.053190811 podStartE2EDuration="2.053190811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:45:35.05218828 +0000 UTC m=+2791.209603095" watchObservedRunningTime="2026-07-15 17:45:35.053190811 +0000 UTC m=+2791.210605626"
Jul 15 17:45:36.041279 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:36.041243    2556 generic.go:356] "Generic (PLEG): container finished" podID="c76e3b92-4fc1-40b0-be8a-254b0edbd214" containerID="6aef25edab1e0529df0d0a53e0dbda08d973edba6ecb179640a3af6e21ca680e" exitCode=0
Jul 15 17:45:36.041759 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:36.041316    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn" event={"ID":"c76e3b92-4fc1-40b0-be8a-254b0edbd214","Type":"ContainerDied","Data":"6aef25edab1e0529df0d0a53e0dbda08d973edba6ecb179640a3af6e21ca680e"}
Jul 15 17:45:37.194193 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:37.194162    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn"
Jul 15 17:45:37.318605 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:37.318509    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76e3b92-4fc1-40b0-be8a-254b0edbd214-maas-api-service-ca\") pod \"c76e3b92-4fc1-40b0-be8a-254b0edbd214\" (UID: \"c76e3b92-4fc1-40b0-be8a-254b0edbd214\") "
Jul 15 17:45:37.318931 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:37.318907    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76e3b92-4fc1-40b0-be8a-254b0edbd214-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c76e3b92-4fc1-40b0-be8a-254b0edbd214" (UID: "c76e3b92-4fc1-40b0-be8a-254b0edbd214"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:45:37.419332 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:37.419298    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76e3b92-4fc1-40b0-be8a-254b0edbd214-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:45:38.053483 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:38.053450    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn" event={"ID":"c76e3b92-4fc1-40b0-be8a-254b0edbd214","Type":"ContainerDied","Data":"2e6223fbd634197d07e0a19034d08f7a5937c55bbe96e31b36edd53abf932082"}
Jul 15 17:45:38.053483 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:38.053475    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn"
Jul 15 17:45:38.053707 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:38.053502    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e6223fbd634197d07e0a19034d08f7a5937c55bbe96e31b36edd53abf932082"
Jul 15 17:45:44.294094 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.294062    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"]
Jul 15 17:45:44.294579 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.294269    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf" podUID="10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b" containerName="maas-api" containerID="cri-o://62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317" gracePeriod=30
Jul 15 17:45:44.323415 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.323383    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q"]
Jul 15 17:45:44.326165 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.326141    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0bc296-29735625-b6d7q"]
Jul 15 17:45:44.365761 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.365727    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc8bd138-1017-4e2b-9f15-aed662e25654" path="/var/lib/kubelet/pods/fc8bd138-1017-4e2b-9f15-aed662e25654/volumes"
Jul 15 17:45:44.541349 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.541322    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:45:44.687746 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.687621    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-maas-api-tls\") pod \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") "
Jul 15 17:45:44.687746 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.687690    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt5fn\" (UniqueName: \"kubernetes.io/projected/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-kube-api-access-tt5fn\") pod \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") "
Jul 15 17:45:44.688009 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.687751    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-openshift-service-ca\") pod \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\" (UID: \"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b\") "
Jul 15 17:45:44.688129 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.688097    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b" (UID: "10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:45:44.689840 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.689808    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b" (UID: "10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:45:44.689925 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.689863    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-kube-api-access-tt5fn" (OuterVolumeSpecName: "kube-api-access-tt5fn") pod "10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b" (UID: "10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b"). InnerVolumeSpecName "kube-api-access-tt5fn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:45:44.789231 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.789189    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-openshift-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:45:44.789231 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.789225    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-maas-api-tls\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:45:44.789231 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:44.789234    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt5fn\" (UniqueName: \"kubernetes.io/projected/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b-kube-api-access-tt5fn\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:45:45.090323 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:45.090285    2556 generic.go:356] "Generic (PLEG): container finished" podID="10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b" containerID="62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317" exitCode=0
Jul 15 17:45:45.090504 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:45.090331    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"
Jul 15 17:45:45.090504 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:45.090368    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf" event={"ID":"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b","Type":"ContainerDied","Data":"62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317"}
Jul 15 17:45:45.090504 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:45.090422    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf" event={"ID":"10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b","Type":"ContainerDied","Data":"2e045706242e13762b98bf1dc8726e2c96d1d05474a09dbfd0c7a41b8aae6aca"}
Jul 15 17:45:45.090504 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:45.090446    2556 scope.go:117] "RemoveContainer" containerID="62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317"
Jul 15 17:45:45.100128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:45.100111    2556 scope.go:117] "RemoveContainer" containerID="62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317"
Jul 15 17:45:45.100415 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:45:45.100394    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317\": container with ID starting with 62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317 not found: ID does not exist" containerID="62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317"
Jul 15 17:45:45.100452 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:45.100425    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317"} err="failed to get container status \"62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317\": rpc error: code = NotFound desc = could not find container \"62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317\": container with ID starting with 62fb94afd4628d39a5113144360dbaf933f0f4a12e7172c08a64366a3e690317 not found: ID does not exist"
Jul 15 17:45:45.113601 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:45.113576    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"]
Jul 15 17:45:45.117414 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:45.117390    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0bc296-7bdb848db-fkkjf"]
Jul 15 17:45:46.366425 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:45:46.366384    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b" path="/var/lib/kubelet/pods/10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b/volumes"
Jul 15 17:46:00.093131 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.093094    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5"]
Jul 15 17:46:00.093611 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.093430    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76e3b92-4fc1-40b0-be8a-254b0edbd214" containerName="revoke-keys"
Jul 15 17:46:00.093611 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.093440    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76e3b92-4fc1-40b0-be8a-254b0edbd214" containerName="revoke-keys"
Jul 15 17:46:00.093611 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.093452    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b" containerName="maas-api"
Jul 15 17:46:00.093611 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.093458    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b" containerName="maas-api"
Jul 15 17:46:00.093611 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.093517    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c76e3b92-4fc1-40b0-be8a-254b0edbd214" containerName="revoke-keys"
Jul 15 17:46:00.093611 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.093525    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="10a4e6ce-bfe4-40b3-a2fd-cad8c9b4e90b" containerName="maas-api"
Jul 15 17:46:00.099290 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.099268    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5"
Jul 15 17:46:00.102147 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.102125    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kbknl\""
Jul 15 17:46:00.106732 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.106682    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5"]
Jul 15 17:46:00.225141 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.225097    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a20653-7474-4a78-a5ee-b7e4e19be967-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5\" (UID: \"15a20653-7474-4a78-a5ee-b7e4e19be967\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5"
Jul 15 17:46:00.326243 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.326193    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a20653-7474-4a78-a5ee-b7e4e19be967-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5\" (UID: \"15a20653-7474-4a78-a5ee-b7e4e19be967\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5"
Jul 15 17:46:00.326924 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.326902    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a20653-7474-4a78-a5ee-b7e4e19be967-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5\" (UID: \"15a20653-7474-4a78-a5ee-b7e4e19be967\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5"
Jul 15 17:46:00.411284 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.411196    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5"
Jul 15 17:46:00.544573 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:00.544550    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5"]
Jul 15 17:46:00.546611 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:46:00.546585    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541 WatchSource:0}: Error finding container 93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541: Status 404 returned error can't find the container with id 93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541
Jul 15 17:46:01.175725 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:01.175616    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5" event={"ID":"15a20653-7474-4a78-a5ee-b7e4e19be967","Type":"ContainerStarted","Data":"81d6985faccc94841401616eca183940f8b19f02a6c25e0ee86316ffe31b14b2"}
Jul 15 17:46:01.175725 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:01.175671    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5" event={"ID":"15a20653-7474-4a78-a5ee-b7e4e19be967","Type":"ContainerStarted","Data":"93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541"}
Jul 15 17:46:01.191943 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:01.191893    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5" podStartSLOduration=1.191873488 podStartE2EDuration="1.191873488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:46:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:46:01.19120397 +0000 UTC m=+2817.348618778" watchObservedRunningTime="2026-07-15 17:46:01.191873488 +0000 UTC m=+2817.349288316"
Jul 15 17:46:02.182192 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:02.182145    2556 generic.go:356] "Generic (PLEG): container finished" podID="15a20653-7474-4a78-a5ee-b7e4e19be967" containerID="81d6985faccc94841401616eca183940f8b19f02a6c25e0ee86316ffe31b14b2" exitCode=0
Jul 15 17:46:02.182621 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:02.182235    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5" event={"ID":"15a20653-7474-4a78-a5ee-b7e4e19be967","Type":"ContainerDied","Data":"81d6985faccc94841401616eca183940f8b19f02a6c25e0ee86316ffe31b14b2"}
Jul 15 17:46:03.310158 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:03.310130    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5"
Jul 15 17:46:03.457069 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:03.456965    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a20653-7474-4a78-a5ee-b7e4e19be967-maas-api-service-ca\") pod \"15a20653-7474-4a78-a5ee-b7e4e19be967\" (UID: \"15a20653-7474-4a78-a5ee-b7e4e19be967\") "
Jul 15 17:46:03.457354 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:03.457329    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15a20653-7474-4a78-a5ee-b7e4e19be967-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "15a20653-7474-4a78-a5ee-b7e4e19be967" (UID: "15a20653-7474-4a78-a5ee-b7e4e19be967"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:46:03.558437 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:03.558386    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15a20653-7474-4a78-a5ee-b7e4e19be967-maas-api-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:46:04.193612 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:04.193572    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5" event={"ID":"15a20653-7474-4a78-a5ee-b7e4e19be967","Type":"ContainerDied","Data":"93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541"}
Jul 15 17:46:04.193802 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:04.193639    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541"
Jul 15 17:46:04.193802 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:04.193593    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5"
Jul 15 17:46:10.224730 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:10.224685    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache]"
Jul 15 17:46:10.581869 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:10.581766    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"]
Jul 15 17:46:10.582039 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:10.581963    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb" podUID="f2e922ff-9b3d-4f1a-bfd7-d01c30b78843" containerName="maas-api" containerID="cri-o://e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a" gracePeriod=30
Jul 15 17:46:10.655997 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:10.655952    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p"]
Jul 15 17:46:10.667599 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:10.667560    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fadd3e-29735625-8sb9p"]
Jul 15 17:46:10.830878 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:10.830846    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:46:10.914954 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:10.914856    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-openshift-service-ca\") pod \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") "
Jul 15 17:46:10.914954 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:10.914910    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-maas-api-tls\") pod \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") "
Jul 15 17:46:10.914954 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:10.914938    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8mg9\" (UniqueName: \"kubernetes.io/projected/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-kube-api-access-r8mg9\") pod \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\" (UID: \"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843\") "
Jul 15 17:46:10.915313 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:10.915286    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f2e922ff-9b3d-4f1a-bfd7-d01c30b78843" (UID: "f2e922ff-9b3d-4f1a-bfd7-d01c30b78843"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:46:10.917022 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:10.916996    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f2e922ff-9b3d-4f1a-bfd7-d01c30b78843" (UID: "f2e922ff-9b3d-4f1a-bfd7-d01c30b78843"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:46:10.917123 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:10.917033    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-kube-api-access-r8mg9" (OuterVolumeSpecName: "kube-api-access-r8mg9") pod "f2e922ff-9b3d-4f1a-bfd7-d01c30b78843" (UID: "f2e922ff-9b3d-4f1a-bfd7-d01c30b78843"). InnerVolumeSpecName "kube-api-access-r8mg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:46:11.015705 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.015667    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-openshift-service-ca\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:46:11.015705 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.015702    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-maas-api-tls\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:46:11.015705 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.015724    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8mg9\" (UniqueName: \"kubernetes.io/projected/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843-kube-api-access-r8mg9\") on node \"ip-10-0-135-100.ec2.internal\" DevicePath \"\""
Jul 15 17:46:11.055333 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:11.055297    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache]"
Jul 15 17:46:11.229109 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.229068    2556 generic.go:356] "Generic (PLEG): container finished" podID="f2e922ff-9b3d-4f1a-bfd7-d01c30b78843" containerID="e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a" exitCode=0
Jul 15 17:46:11.229547 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.229138    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"
Jul 15 17:46:11.229547 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.229168    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb" event={"ID":"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843","Type":"ContainerDied","Data":"e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a"}
Jul 15 17:46:11.229547 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.229258    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb" event={"ID":"f2e922ff-9b3d-4f1a-bfd7-d01c30b78843","Type":"ContainerDied","Data":"05ab048dd6c1df32c5ee6c75e6ffb5f6234150a67c920cfae5b7ce2b18a30ac9"}
Jul 15 17:46:11.229547 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.229281    2556 scope.go:117] "RemoveContainer" containerID="e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a"
Jul 15 17:46:11.240061 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.240033    2556 scope.go:117] "RemoveContainer" containerID="e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a"
Jul 15 17:46:11.240393 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:11.240372    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a\": container with ID starting with e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a not found: ID does not exist" containerID="e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a"
Jul 15 17:46:11.240498 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.240405    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a"} err="failed to get container status \"e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a\": rpc error: code = NotFound desc = could not find container \"e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a\": container with ID starting with e4e26ee514bf3d91d89febea6da8ee5bae00d6c523892eb7557b775c62af421a not found: ID does not exist"
Jul 15 17:46:11.253561 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.253524    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"]
Jul 15 17:46:11.260407 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:11.260379    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fadd3e-55557df97b-xrmtb"]
Jul 15 17:46:12.365259 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:12.365227    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef71c25a-3ac9-41f2-b00d-e7e4f920492a" path="/var/lib/kubelet/pods/ef71c25a-3ac9-41f2-b00d-e7e4f920492a/volumes"
Jul 15 17:46:12.365651 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:12.365587    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2e922ff-9b3d-4f1a-bfd7-d01c30b78843" path="/var/lib/kubelet/pods/f2e922ff-9b3d-4f1a-bfd7-d01c30b78843/volumes"
Jul 15 17:46:21.093595 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:21.093551    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache]"
Jul 15 17:46:25.208344 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:25.208308    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache]"
Jul 15 17:46:26.644121 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:26.644088    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d7db9f7dc-kn44h_bfb2c94e-53e4-4f8d-879d-3accc092ecbf/authorino/0.log"
Jul 15 17:46:31.131720 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:31.131671    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache]"
Jul 15 17:46:32.372929 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:32.372901    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-85d47_a9d82f3e-69c2-4ecc-8222-885c1b7fcc63/manager/0.log"
Jul 15 17:46:33.298087 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:33.298054    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdf764586-wc7nf_b9639d4d-d94c-450c-9aed-adabb937d9ee/copy-manifests/0.log"
Jul 15 17:46:33.304815 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:33.304795    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdf764586-wc7nf_b9639d4d-d94c-450c-9aed-adabb937d9ee/manager/0.log"
Jul 15 17:46:33.797875 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:33.797840    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735595-ng7mt_df1b09d4-6df7-4f88-aec9-b19de1768c9f/cleanup/0.log"
Jul 15 17:46:33.922936 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:33.922906    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735610-tbflb_f8ead599-5e69-4677-adb3-6e86907e274f/cleanup/0.log"
Jul 15 17:46:34.036128 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:34.036100    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735625-qwqv6_e9c38e34-a5f7-414f-8330-5ff6f3a8bb55/cleanup/0.log"
Jul 15 17:46:34.157674 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:34.157600    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-297e6a4a-6cp5l_dfa99769-48c0-40b8-bec6-47656783d48c/revoke-keys/0.log"
Jul 15 17:46:34.278535 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:34.278501    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-554abb3e-sjnl8_c3f77b63-83ef-47ab-8e3f-b03aa1fc8618/revoke-keys/0.log"
Jul 15 17:46:34.394101 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:34.394076    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-4dfdb7-mwn94_b7dbae10-8c8f-4682-80cd-c87fd90c9fdd/revoke-keys/0.log"
Jul 15 17:46:34.503227 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:34.503201    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-feaa2b-vftrs_2777e359-16ff-47b4-8f30-2cd76b2fd25a/revoke-keys/0.log"
Jul 15 17:46:34.620036 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:34.620007    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-6feb2776-7nglg_f5c13226-7c13-4018-83b3-24fe9843afbb/revoke-keys/0.log"
Jul 15 17:46:34.739091 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:34.739066    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-a6dd94-lkljw_13d09a39-40ed-44af-ae42-0fcc7c7542ea/revoke-keys/0.log"
Jul 15 17:46:34.852840 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:34.852772    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-47c774-xhd6s_79f7db8b-46be-4230-971d-3bc86bbd903e/revoke-keys/0.log"
Jul 15 17:46:34.968057 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:34.968033    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-a2500ffb-bhlng_c086b591-d96e-4883-b9cb-87558fd9173d/revoke-keys/0.log"
Jul 15 17:46:35.084653 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:35.084624    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-4fc374e6-5ftld_2048b624-0216-4997-8069-26a02ec88163/revoke-keys/0.log"
Jul 15 17:46:35.194264 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:35.194190    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-6a6deab7-kvls7_32c1952c-77b3-48be-8704-242b1846f896/revoke-keys/0.log"
Jul 15 17:46:35.313424 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:35.313388    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-0bc296-mg6vn_c76e3b92-4fc1-40b0-be8a-254b0edbd214/revoke-keys/0.log"
Jul 15 17:46:35.423203 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:35.423174    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-fadd3e-z9cx5_15a20653-7474-4a78-a5ee-b7e4e19be967/revoke-keys/0.log"
Jul 15 17:46:35.530780 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:35.530757    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-pgpnw_88ed18a9-d506-472a-95aa-b17721f01854/postgres/0.log"
Jul 15 17:46:36.864857 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:36.864826    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d7db9f7dc-kn44h_bfb2c94e-53e4-4f8d-879d-3accc092ecbf/authorino/0.log"
Jul 15 17:46:37.116110 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:37.116032    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rj228_4e7a3d57-4b36-44a9-94fb-6a55a39faf6e/manager/0.log"
Jul 15 17:46:38.323893 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:38.323865    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-667d575688-7swgk_772f8699-bfcb-43b9-a90c-6ec4ebc38f8f/kube-auth-proxy/0.log"
Jul 15 17:46:39.319284 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:39.319252    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-87rpx_3dc332f4-7cff-4564-82d5-ef3fa61f820b/main/0.log"
Jul 15 17:46:39.546386 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:39.546357    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bzr6w_57fe77ef-b781-4e58-b8bb-4f7dd4333f94/main/0.log"
Jul 15 17:46:40.238546 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:40.236949    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache]"
Jul 15 17:46:41.140450 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:41.140410    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache]"
Jul 15 17:46:45.534309 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.534231    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kwr2v/must-gather-kn6nz"]
Jul 15 17:46:45.534731 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.534657    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15a20653-7474-4a78-a5ee-b7e4e19be967" containerName="revoke-keys"
Jul 15 17:46:45.534731 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.534677    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="15a20653-7474-4a78-a5ee-b7e4e19be967" containerName="revoke-keys"
Jul 15 17:46:45.534731 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.534702    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2e922ff-9b3d-4f1a-bfd7-d01c30b78843" containerName="maas-api"
Jul 15 17:46:45.534731 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.534725    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2e922ff-9b3d-4f1a-bfd7-d01c30b78843" containerName="maas-api"
Jul 15 17:46:45.535061 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.534819    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="15a20653-7474-4a78-a5ee-b7e4e19be967" containerName="revoke-keys"
Jul 15 17:46:45.535061 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.534833    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2e922ff-9b3d-4f1a-bfd7-d01c30b78843" containerName="maas-api"
Jul 15 17:46:45.537581 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.537566    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwr2v/must-gather-kn6nz"
Jul 15 17:46:45.540207 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.540177    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kwr2v\"/\"openshift-service-ca.crt\""
Jul 15 17:46:45.541183 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.541163    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kwr2v\"/\"default-dockercfg-kt2q7\""
Jul 15 17:46:45.541285 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.541176    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kwr2v\"/\"kube-root-ca.crt\""
Jul 15 17:46:45.546963 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.546942    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwr2v/must-gather-kn6nz"]
Jul 15 17:46:45.617188 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.617155    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c70f8e3e-7a60-4bd4-9c23-d03905e148a4-must-gather-output\") pod \"must-gather-kn6nz\" (UID: \"c70f8e3e-7a60-4bd4-9c23-d03905e148a4\") " pod="openshift-must-gather-kwr2v/must-gather-kn6nz"
Jul 15 17:46:45.617364 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.617221    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnt6k\" (UniqueName: \"kubernetes.io/projected/c70f8e3e-7a60-4bd4-9c23-d03905e148a4-kube-api-access-vnt6k\") pod \"must-gather-kn6nz\" (UID: \"c70f8e3e-7a60-4bd4-9c23-d03905e148a4\") " pod="openshift-must-gather-kwr2v/must-gather-kn6nz"
Jul 15 17:46:45.718153 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.718106    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c70f8e3e-7a60-4bd4-9c23-d03905e148a4-must-gather-output\") pod \"must-gather-kn6nz\" (UID: \"c70f8e3e-7a60-4bd4-9c23-d03905e148a4\") " pod="openshift-must-gather-kwr2v/must-gather-kn6nz"
Jul 15 17:46:45.718272 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.718204    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnt6k\" (UniqueName: \"kubernetes.io/projected/c70f8e3e-7a60-4bd4-9c23-d03905e148a4-kube-api-access-vnt6k\") pod \"must-gather-kn6nz\" (UID: \"c70f8e3e-7a60-4bd4-9c23-d03905e148a4\") " pod="openshift-must-gather-kwr2v/must-gather-kn6nz"
Jul 15 17:46:45.718461 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.718441    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c70f8e3e-7a60-4bd4-9c23-d03905e148a4-must-gather-output\") pod \"must-gather-kn6nz\" (UID: \"c70f8e3e-7a60-4bd4-9c23-d03905e148a4\") " pod="openshift-must-gather-kwr2v/must-gather-kn6nz"
Jul 15 17:46:45.729609 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.729585    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnt6k\" (UniqueName: \"kubernetes.io/projected/c70f8e3e-7a60-4bd4-9c23-d03905e148a4-kube-api-access-vnt6k\") pod \"must-gather-kn6nz\" (UID: \"c70f8e3e-7a60-4bd4-9c23-d03905e148a4\") " pod="openshift-must-gather-kwr2v/must-gather-kn6nz"
Jul 15 17:46:45.847572 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:45.847487    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwr2v/must-gather-kn6nz"
Jul 15 17:46:46.010935 ip-10-0-135-100 kubenswrapper[2556]: W0715 17:46:46.010901    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc70f8e3e_7a60_4bd4_9c23_d03905e148a4.slice/crio-791dfca938a715595125bf95cbf7af53fbe64363f500c10bca8d242f4ccced4a WatchSource:0}: Error finding container 791dfca938a715595125bf95cbf7af53fbe64363f500c10bca8d242f4ccced4a: Status 404 returned error can't find the container with id 791dfca938a715595125bf95cbf7af53fbe64363f500c10bca8d242f4ccced4a
Jul 15 17:46:46.023656 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:46.023627    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwr2v/must-gather-kn6nz"]
Jul 15 17:46:46.413630 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:46.413596    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwr2v/must-gather-kn6nz" event={"ID":"c70f8e3e-7a60-4bd4-9c23-d03905e148a4","Type":"ContainerStarted","Data":"791dfca938a715595125bf95cbf7af53fbe64363f500c10bca8d242f4ccced4a"}
Jul 15 17:46:47.423502 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:47.423456    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwr2v/must-gather-kn6nz" event={"ID":"c70f8e3e-7a60-4bd4-9c23-d03905e148a4","Type":"ContainerStarted","Data":"f84c11235151518c5c2ecfe2573c8fce11a6e5a4e811084d20c95270d4f0c14c"}
Jul 15 17:46:47.424005 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:47.423515    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwr2v/must-gather-kn6nz" event={"ID":"c70f8e3e-7a60-4bd4-9c23-d03905e148a4","Type":"ContainerStarted","Data":"3303d1dcc37bf26bae1aec4f7f9cdc991c81be43330a9a05ba7b4fadab1ff9aa"}
Jul 15 17:46:47.442041 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:47.441992    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kwr2v/must-gather-kn6nz" podStartSLOduration=1.562370545 podStartE2EDuration="2.441976801s" totalImagesPullingTime="879.606256ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:46:47.441650651 +0000 UTC m=+2863.599065466" watchObservedRunningTime="2026-07-15 17:46:47.441976801 +0000 UTC m=+2863.599391615"
Jul 15 17:46:48.575154 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:48.575117    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n8p6c_838ecadb-25ac-4b24-850d-2755447e4d46/global-pull-secret-syncer/0.log"
Jul 15 17:46:48.722936 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:48.722908    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ktspg_06995ee8-bd63-4309-ad6c-e7365185af99/konnectivity-agent/0.log"
Jul 15 17:46:48.793302 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:48.793271    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-100.ec2.internal_24fdbde66c62e7d855b5c05ac038501c/haproxy/0.log"
Jul 15 17:46:51.226481 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:51.226431    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache]"
Jul 15 17:46:54.305528 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:54.305444    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d7db9f7dc-kn44h_bfb2c94e-53e4-4f8d-879d-3accc092ecbf/authorino/0.log"
Jul 15 17:46:54.387840 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:54.387776    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rj228_4e7a3d57-4b36-44a9-94fb-6a55a39faf6e/manager/0.log"
Jul 15 17:46:55.189432 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:55.189386    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache]"
Jul 15 17:46:56.594740 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:56.594691    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b65767697-f8qcz_aa9e7099-7097-415e-b1f7-3f686383b6a7/metrics-server/0.log"
Jul 15 17:46:56.726995 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:56.726945    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcxc9_bf2a3932-666a-49fc-b8b6-484b0855e9c2/node-exporter/0.log"
Jul 15 17:46:56.746377 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:56.746345    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcxc9_bf2a3932-666a-49fc-b8b6-484b0855e9c2/kube-rbac-proxy/0.log"
Jul 15 17:46:56.771507 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:56.771422    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcxc9_bf2a3932-666a-49fc-b8b6-484b0855e9c2/init-textfile/0.log"
Jul 15 17:46:56.948158 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:56.948076    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23b5588a-2f50-40dc-8e7f-fd0ece6aa207/prometheus/0.log"
Jul 15 17:46:56.973851 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:56.973824    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23b5588a-2f50-40dc-8e7f-fd0ece6aa207/config-reloader/0.log"
Jul 15 17:46:56.996014 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:56.995971    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23b5588a-2f50-40dc-8e7f-fd0ece6aa207/thanos-sidecar/0.log"
Jul 15 17:46:57.025912 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:57.025818    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23b5588a-2f50-40dc-8e7f-fd0ece6aa207/kube-rbac-proxy-web/0.log"
Jul 15 17:46:57.052414 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:57.052384    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23b5588a-2f50-40dc-8e7f-fd0ece6aa207/kube-rbac-proxy/0.log"
Jul 15 17:46:57.075973 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:57.075934    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23b5588a-2f50-40dc-8e7f-fd0ece6aa207/kube-rbac-proxy-thanos/0.log"
Jul 15 17:46:57.098746 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:57.098690    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23b5588a-2f50-40dc-8e7f-fd0ece6aa207/init-config-reloader/0.log"
Jul 15 17:46:57.138404 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:57.138370    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-cgldp_7ae189ad-cfe7-4a05-96a2-c02a564f3299/prometheus-operator/0.log"
Jul 15 17:46:57.159048 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:57.159019    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-cgldp_7ae189ad-cfe7-4a05-96a2-c02a564f3299/kube-rbac-proxy/0.log"
Jul 15 17:46:57.181617 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:57.181586    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-qfdbk_233a36b3-b7e6-46f7-b24f-5e52e8bf39f7/prometheus-operator-admission-webhook/0.log"
Jul 15 17:46:58.819566 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:58.819524    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"]
Jul 15 17:46:58.825397 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:58.825368    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:58.834658 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:58.834630    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"]
Jul 15 17:46:58.956755 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:58.956693    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq446\" (UniqueName: \"kubernetes.io/projected/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-kube-api-access-qq446\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:58.956943 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:58.956771    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-sys\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:58.956943 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:58.956834    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-podres\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:58.956943 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:58.956886    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-lib-modules\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:58.957125 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:58.956975    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-proc\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.057761 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.057703    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-proc\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.057967 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.057794    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq446\" (UniqueName: \"kubernetes.io/projected/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-kube-api-access-qq446\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.057967 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.057814    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-proc\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.057967 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.057826    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-sys\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.057967 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.057872    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-sys\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.058176 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.057961    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-podres\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.058176 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.058121    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-podres\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.058279 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.058219    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-lib-modules\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.058390 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.058366    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-lib-modules\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.068420 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.068394    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq446\" (UniqueName: \"kubernetes.io/projected/414c24fe-a9b4-4ccc-8f57-b762fe4a8687-kube-api-access-qq446\") pod \"perf-node-gather-daemonset-lzhdd\" (UID: \"414c24fe-a9b4-4ccc-8f57-b762fe4a8687\") " pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.138958 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.138878    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.197131 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:59.197067    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache]"
Jul 15 17:46:59.197306 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:46:59.197153    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache]"
Jul 15 17:46:59.315283 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.315203    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"]
Jul 15 17:46:59.515525 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.515493    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd" event={"ID":"414c24fe-a9b4-4ccc-8f57-b762fe4a8687","Type":"ContainerStarted","Data":"c5214bfa4eb5d5ff4e894239b03fcd217e64c9c3fa50cb73b827d4c70e1cddad"}
Jul 15 17:46:59.515701 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.515542    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd" event={"ID":"414c24fe-a9b4-4ccc-8f57-b762fe4a8687","Type":"ContainerStarted","Data":"29ce3411b6d3fe1c06abe2822854bcd84632a951ca47b763e1fbcf5d5eb0f34f"}
Jul 15 17:46:59.515701 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.515685    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:46:59.534947 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.534893    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd" podStartSLOduration=1.534876321 podStartE2EDuration="1.534876321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:46:59.531907033 +0000 UTC m=+2875.689321847" watchObservedRunningTime="2026-07-15 17:46:59.534876321 +0000 UTC m=+2875.692291134"
Jul 15 17:46:59.691277 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:46:59.691196    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-746bb5bb5b-kwztl_192befe7-3999-491e-a903-2bb7c5e6b3e3/console/0.log"
Jul 15 17:47:01.238583 ip-10-0-135-100 kubenswrapper[2556]: E0715 17:47:01.238540    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice/crio-93bda20e00842f63474fadac52d796d72a7cf6b50a0dac5565a23cb8b1490541\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a20653_7474_4a78_a5ee_b7e4e19be967.slice\": RecentStats: unable to find data in memory cache]"
Jul 15 17:47:01.415025 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:01.414987    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sc5dw_4a246308-2ef7-4138-9a07-ceace42eb3ff/dns/0.log"
Jul 15 17:47:01.436415 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:01.436391    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sc5dw_4a246308-2ef7-4138-9a07-ceace42eb3ff/kube-rbac-proxy/0.log"
Jul 15 17:47:01.515012 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:01.514936    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6rcnp_814f06f1-1241-4b8f-982a-c65a7f5f3c1b/dns-node-resolver/0.log"
Jul 15 17:47:02.075852 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:02.075814    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d5dc4c6b5-b4pvz_9a3d39dc-edb9-4ee9-bae2-ad30294d152c/registry/0.log"
Jul 15 17:47:02.117764 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:02.117694    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5h7m5_5955d780-7eac-4662-9014-54b2386eda46/node-ca/0.log"
Jul 15 17:47:03.199837 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:03.199807    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-667d575688-7swgk_772f8699-bfcb-43b9-a90c-6ec4ebc38f8f/kube-auth-proxy/0.log"
Jul 15 17:47:04.088749 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:04.088706    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4rfjp_84554a28-9f3b-4e49-bb06-8e877331ed77/serve-healthcheck-canary/0.log"
Jul 15 17:47:04.788207 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:04.788174    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cwk6g_b7c7d5ec-f372-475c-8271-c58d505fb309/kube-rbac-proxy/0.log"
Jul 15 17:47:04.807405 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:04.807378    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cwk6g_b7c7d5ec-f372-475c-8271-c58d505fb309/exporter/0.log"
Jul 15 17:47:04.828341 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:04.828312    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cwk6g_b7c7d5ec-f372-475c-8271-c58d505fb309/extractor/0.log"
Jul 15 17:47:05.534585 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:05.534553    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kwr2v/perf-node-gather-daemonset-lzhdd"
Jul 15 17:47:07.006589 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:07.006558    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-85d47_a9d82f3e-69c2-4ecc-8222-885c1b7fcc63/manager/0.log"
Jul 15 17:47:07.638165 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:07.638081    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdf764586-wc7nf_b9639d4d-d94c-450c-9aed-adabb937d9ee/manager/0.log"
Jul 15 17:47:07.662198 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:07.662101    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdf764586-wc7nf_b9639d4d-d94c-450c-9aed-adabb937d9ee/copy-manifests/0.log"
Jul 15 17:47:09.070566 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:09.070528    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6744c79bb-vxpww_8656292b-e3f3-4a82-96f6-414702dddf57/manager/0.log"
Jul 15 17:47:09.178808 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:09.178730    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-667d575688-7swgk_772f8699-bfcb-43b9-a90c-6ec4ebc38f8f/kube-auth-proxy/0.log"
Jul 15 17:47:10.709297 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:10.709218    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-667d575688-7swgk_772f8699-bfcb-43b9-a90c-6ec4ebc38f8f/kube-auth-proxy/0.log"
Jul 15 17:47:15.333807 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:15.333767    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-44vpb_7ca65c67-c657-4c56-ae9d-db5bb4bee2bc/kube-multus/0.log"
Jul 15 17:47:15.355274 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:15.355242    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cqdbp_8e8933d2-0b56-4b1f-bd19-11f72e66ee1e/kube-multus-additional-cni-plugins/0.log"
Jul 15 17:47:15.375054 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:15.375028    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cqdbp_8e8933d2-0b56-4b1f-bd19-11f72e66ee1e/egress-router-binary-copy/0.log"
Jul 15 17:47:15.397013 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:15.396991    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cqdbp_8e8933d2-0b56-4b1f-bd19-11f72e66ee1e/cni-plugins/0.log"
Jul 15 17:47:15.420648 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:15.420622    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cqdbp_8e8933d2-0b56-4b1f-bd19-11f72e66ee1e/bond-cni-plugin/0.log"
Jul 15 17:47:15.449423 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:15.449396    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cqdbp_8e8933d2-0b56-4b1f-bd19-11f72e66ee1e/routeoverride-cni/0.log"
Jul 15 17:47:15.472917 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:15.472889    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cqdbp_8e8933d2-0b56-4b1f-bd19-11f72e66ee1e/whereabouts-cni-bincopy/0.log"
Jul 15 17:47:15.494696 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:15.494671    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cqdbp_8e8933d2-0b56-4b1f-bd19-11f72e66ee1e/whereabouts-cni/0.log"
Jul 15 17:47:16.018935 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:16.018896    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w9xrc_d0593108-e3b3-4780-9f27-52ac2affd909/network-metrics-daemon/0.log"
Jul 15 17:47:16.036899 ip-10-0-135-100 kubenswrapper[2556]: I0715 17:47:16.036872    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w9xrc_d0593108-e3b3-4780-9f27-52ac2affd909/kube-rbac-proxy/0.log"