Jul 17 07:10:07.278850 ip-10-0-135-5 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 07:10:07.278860 ip-10-0-135-5 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 07:10:07.278867 ip-10-0-135-5 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 07:10:07.279085 ip-10-0-135-5 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 07:10:18.773319 ip-10-0-135-5 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 17 07:10:18.773332 ip-10-0-135-5 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 67318cc60b824a829debe8e27616a134 --
Jul 17 07:12:17.063028 ip-10-0-135-5 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.548277    2546 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555132    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555149    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555157    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555161    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555168    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555172    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555177    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 07:12:17.598264 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555182    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555186    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555191    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555195    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555199    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555204    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555208    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555212    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555217    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555228    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555233    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555237    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555241    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555246    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555250    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555253    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555257    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555262    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555266    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555270    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 07:12:17.602660 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555274    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555278    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555282    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555287    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555291    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555295    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555299    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555303    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555307    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555311    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555316    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555322    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555327    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555332    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555336    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555340    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555344    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555349    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555356    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 07:12:17.603589 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555362    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555366    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555370    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555374    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555378    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555382    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555386    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555391    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555396    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555400    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555405    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555410    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555413    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555417    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555421    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555427    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555432    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555436    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555440    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555444    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 07:12:17.606250 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555448    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555452    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555458    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555462    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555466    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555471    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555476    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555481    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555484    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555488    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555492    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555496    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555500    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555504    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555508    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555512    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555516    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555522    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555527    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 07:12:17.607206 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555532    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555536    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555540    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555544    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555550    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555555    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555560    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555564    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555568    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555573    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555577    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555581    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555585    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.555589    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556675    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556684    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556688    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556694    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556698    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 07:12:17.609585 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556703    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556708    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556712    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556716    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556720    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556727    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556732    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556737    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556757    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556763    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556767    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556772    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556776    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556781    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556786    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556791    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556803    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556808    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556813    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 07:12:17.610573 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556817    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556822    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556826    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556831    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556837    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556844    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556849    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556855    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556859    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556863    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556867    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556871    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556875    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556879    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556884    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556889    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556893    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556897    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556901    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 07:12:17.613506 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556905    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556910    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556914    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556918    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556922    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556927    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556931    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556935    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556939    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556942    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556947    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556951    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556955    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556959    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556963    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556969    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556972    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556978    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556982    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 07:12:17.614488 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556987    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556991    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.556999    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557003    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557007    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557011    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557016    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557020    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557024    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557029    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557033    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557037    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557041    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557045    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557049    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557055    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557060    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557065    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557069    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557073    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 07:12:17.618592 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557078    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557083    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557087    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557090    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557094    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557099    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557103    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557107    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557111    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557115    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557119    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557123    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557126    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557130    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557137    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557140    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557144    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557697    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557704    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557709    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 07:12:17.619555 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557713    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557719    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557723    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557726    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557731    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557735    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557755    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557760    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557764    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557769    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557773    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557777    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557781    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557784    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557788    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557792    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557796    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557801    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557805    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557809    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 07:12:17.620536 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557813    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557817    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557821    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557825    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557829    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557833    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557840    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557844    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557847    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557851    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557856    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557860    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557864    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557868    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557873    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557877    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557881    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557885    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557889    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557894    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 07:12:17.624342 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557897    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557902    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557906    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557910    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557914    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557918    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557922    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557926    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557930    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557933    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557941    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557946    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557950    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557955    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557959    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557964    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557970    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557976    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557983    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 07:12:17.625287 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557988    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557992    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.557996    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558000    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558003    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558008    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558012    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558015    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558020    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558024    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558028    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558032    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558036    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558040    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558045    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558049    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558054    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558057    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558063    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558067    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 07:12:17.626256 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558070    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558074    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558078    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558082    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558086    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558090    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558096    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558101    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558107    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558111    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558115    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558122    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558125    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558129    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558133    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558137    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.558141    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558235    2546 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558245    2546 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558256    2546 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 07:12:17.628400 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558262    2546 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558269    2546 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558274    2546 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558281    2546 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558288    2546 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558293    2546 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558298    2546 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558303    2546 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558310    2546 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558315    2546 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558321    2546 flags.go:64] FLAG: --cgroup-root=""
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558325    2546 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558330    2546 flags.go:64] FLAG: --client-ca-file=""
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558334    2546 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558339    2546 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558346    2546 flags.go:64] FLAG: --cluster-domain=""
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558350    2546 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558356    2546 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558360    2546 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558367    2546 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558372    2546 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558377    2546 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558382    2546 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 07:12:17.629346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558389    2546 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558394    2546 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558398    2546 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558403    2546 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558408    2546 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558413    2546 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558419    2546 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558424    2546 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558428    2546 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558433    2546 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558437    2546 flags.go:64] FLAG: --enable-server="true"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558443    2546 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558450    2546 flags.go:64] FLAG: --event-burst="100"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558454    2546 flags.go:64] FLAG: --event-qps="50"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558459    2546 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558464    2546 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558468    2546 flags.go:64] FLAG: --eviction-hard=""
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558474    2546 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558479    2546 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558486    2546 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558491    2546 flags.go:64] FLAG: --eviction-soft=""
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558496    2546 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558500    2546 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558505    2546 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558509    2546 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 07:12:17.698657 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558514    2546 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 07:12:17.632041 ip-10-0-135-5 systemd[1]: Started Kubernetes Kubelet.
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558519    2546 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558523    2546 flags.go:64] FLAG: --feature-gates=""
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558529    2546 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558534    2546 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558538    2546 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558543    2546 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558549    2546 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558554    2546 flags.go:64] FLAG: --help="false"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558559    2546 flags.go:64] FLAG: --hostname-override="ip-10-0-135-5.ec2.internal"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558563    2546 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558568    2546 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558573    2546 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558578    2546 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558584    2546 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558588    2546 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558593    2546 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558598    2546 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558603    2546 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558608    2546 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558613    2546 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558619    2546 flags.go:64] FLAG: --kube-reserved=""
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558624    2546 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558627    2546 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 07:12:17.700183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558632    2546 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558637    2546 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558643    2546 flags.go:64] FLAG: --lock-file=""
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558648    2546 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558653    2546 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558657    2546 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558665    2546 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558670    2546 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558675    2546 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558680    2546 flags.go:64] FLAG: --logging-format="text"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558684    2546 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558689    2546 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558694    2546 flags.go:64] FLAG: --manifest-url=""
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558699    2546 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558705    2546 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558712    2546 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558718    2546 flags.go:64] FLAG: --max-pods="110"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558723    2546 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558728    2546 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558732    2546 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558737    2546 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558756    2546 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558761    2546 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558766    2546 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558777    2546 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 07:12:17.703407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558782    2546 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558787    2546 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558792    2546 flags.go:64] FLAG: --pod-cidr=""
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558798    2546 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558807    2546 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558812    2546 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558816    2546 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558821    2546 flags.go:64] FLAG: --port="10250"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558826    2546 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558831    2546 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08d2c9b56d1c5750d"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558837    2546 flags.go:64] FLAG: --qos-reserved=""
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558842    2546 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558847    2546 flags.go:64] FLAG: --register-node="true"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558852    2546 flags.go:64] FLAG: --register-with-taints=""
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558858    2546 flags.go:64] FLAG: --registry-burst="10"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558862    2546 flags.go:64] FLAG: --registry-qps="5"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558866    2546 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558871    2546 flags.go:64] FLAG: --reserved-memory=""
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558877    2546 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558881    2546 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558886    2546 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558890    2546 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558897    2546 flags.go:64] FLAG: --runonce="false"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558901    2546 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558907    2546 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 07:12:17.705979 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558911    2546 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558916    2546 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558920    2546 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558925    2546 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558930    2546 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558934    2546 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558940    2546 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558944    2546 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558949    2546 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558953    2546 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558958    2546 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558963    2546 flags.go:64] FLAG: --system-cgroups=""
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558968    2546 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558976    2546 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558981    2546 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558985    2546 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558991    2546 flags.go:64] FLAG: --tls-min-version=""
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.558997    2546 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.559002    2546 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.559007    2546 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.559012    2546 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.559016    2546 flags.go:64] FLAG: --v="2"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.559022    2546 flags.go:64] FLAG: --version="false"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.559028    2546 flags.go:64] FLAG: --vmodule=""
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.559035    2546 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 07:12:17.838355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.559041    2546 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559218    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559224    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559230    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559238    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559243    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559248    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559252    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559256    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559261    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559265    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559269    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559273    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559277    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559282    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559286    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559290    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559294    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559298    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 07:12:17.840783 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559304    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559308    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559312    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559316    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559320    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559326    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559330    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559334    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559338    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559342    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559346    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559350    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559354    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559358    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559362    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559366    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559370    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559377    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559380    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559384    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 07:12:17.842184 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559389    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559393    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559397    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559401    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559405    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559409    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559414    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559418    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559422    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559427    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559433    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559438    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559443    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559448    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559452    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559456    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559461    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559466    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559471    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 07:12:17.843798 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559475    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559479    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559483    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559487    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559491    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559495    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559499    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559503    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559507    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559511    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559517    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559521    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559525    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559529    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559534    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559539    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559543    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559546    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559550    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559556    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 07:12:17.845176 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559559    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559564    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559568    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559572    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559577    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559581    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559584    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559589    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559593    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559597    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559603    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559609    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559614    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559619    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559623    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559627    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559631    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559635    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559656    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 07:12:17.846576 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559661    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559665    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.559669    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.560677    2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.569014    2546 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.569032    2546 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.569049    2546 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.569055    2546 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569118    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569123    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569127    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569130    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569134    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569137    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569140    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 07:12:17.847753 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569143    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569146    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569149    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569152    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569155    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569158    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569161    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569163    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569166    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569169    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569172    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569174    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569177    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569181    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569186    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569191    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569194    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569198    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569202    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 07:12:17.849160 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569205    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569208    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569211    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569222    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569225    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569228    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569231    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569234    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569236    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569239    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569242    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569245    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569248    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569250    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569253    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569256    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569259    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569261    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569264    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569267    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 07:12:17.851252 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569270    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569273    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569276    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569279    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569283    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569285    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569288    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569291    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569295    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569297    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569300    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569303    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569306    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569309    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569311    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569314    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569317    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569320    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569323    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569326    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 07:12:17.852157 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569328    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569331    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569334    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569336    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569339    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569341    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569344    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569347    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569349    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569352    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569355    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569357    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569360    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569363    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569366    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569369    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569371    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569374    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569377    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569380    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 07:12:17.852994 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569383    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569386    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569389    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569391    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569394    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569397    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569400    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569405    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569410    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569414    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569417    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569419    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569422    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.569428    2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569580    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 07:12:17.853821 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569587    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569590    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569593    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569597    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569600    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569603    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569606    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569609    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569612    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569616    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569619    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569622    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569629    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569633    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569635    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569639    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569642    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569645    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569648    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 07:12:17.854435 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569650    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569653    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569657    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569659    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569662    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569667    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569669    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569672    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569676    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569680    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569683    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569686    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569689    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569692    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569694    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569697    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569700    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569702    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569705    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569708    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 07:12:17.855237 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569710    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569713    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569716    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569719    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569721    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569725    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569728    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569731    2546 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569734    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569736    2546 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569758    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569762    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569765    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569767    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569770    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569773    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569776    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569780    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569782    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569785    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569788    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 07:12:17.856145 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569800    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569804    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569807    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569810    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569813    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569817    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569820    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569822    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569825    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569828    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569832    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569836    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569839    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569842    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569845    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569848    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569852    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569855    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569858    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569861    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 07:12:17.856986 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569864    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569867    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569870    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569873    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569875    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569878    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569881    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569883    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569888    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569890    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569893    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569896    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569899    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569903    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569906    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569908    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569911    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 07:12:17.857810 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:17.569914    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.569918    2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.570052    2546 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.572484    2546 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.574201    2546 server.go:1019] "Starting client certificate rotation"
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.574329    2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.574382    2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.576555    2546 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.585446    2546 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.594664    2546 log.go:25] "Validated CRI v1 runtime API"
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.597531    2546 log.go:25] "Validated CRI v1 image API"
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.598462    2546 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 07:12:17.858492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.604362    2546 fs.go:135] Filesystem UUIDs: map[44e8edb7-642f-4906-a085-cdba472f5131:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b15b469b-ae09-4d68-93eb-4e8228fac367:/dev/nvme0n1p4]
Jul 17 07:12:17.858932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.604381    2546 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 07:12:17.858980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.608443    2546 manager.go:216] Machine: {Timestamp:2026-07-17 07:12:17.607934855 +0000 UTC m=+0.414132024 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100533 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b364aa3578e836630979276fb0f10 SystemUUID:ec2b364a-a357-8e83-6630-979276fb0f10 BootID:67318cc6-0b82-4a82-9deb-e8e27616a134 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9a:81:33:d5:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9a:81:33:d5:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:72:8e:60:33:8a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 07:12:17.858980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.608546    2546 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 07:12:17.858980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.608635    2546 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 07:12:17.858980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.611322    2546 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 07:12:17.858980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.611356    2546 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-5.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 07:12:17.858980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.612302    2546 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 07:12:17.858980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.612314    2546 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 07:12:17.858980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.612322    2546 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.612338    2546 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.613768    2546 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.617274    2546 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.617448    2546 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.618352    2546 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.618367    2546 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.618383    2546 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.618394    2546 kubelet.go:398] "Adding apiserver pod source"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.618403    2546 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.618769    2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.618788    2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.623087    2546 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.625196    2546 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.625479    2546 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.625518    2546 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626772    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626792    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626803    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626812    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626825    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626834    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626846    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626854    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626865    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626874    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626888    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.626897    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.627686    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.627696    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.631334    2546 server.go:1268] "Started kubelet"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.631710    2546 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.633080    2546 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.638950    2546 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.639057    2546 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.640639    2546 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-5.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.641376    2546 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.641494    2546 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.653279    2546 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 07:12:17.859312 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.656125    2546 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.656556    2546 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.656575    2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.656673    2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-65c2l"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.656809    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.657202    2546 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.657244    2546 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.657264    2546 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.657378    2546 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.657385    2546 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.657717    2546 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.657736    2546 factory.go:55] Registering systemd factory
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.657746    2546 factory.go:223] Registration of the systemd container factory successfully
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.658006    2546 factory.go:153] Registering CRI-O factory
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.658018    2546 factory.go:223] Registration of the crio container factory successfully
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.658037    2546 factory.go:103] Registering Raw factory
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.658048    2546 manager.go:1196] Started watching for new ooms in manager
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.658394    2546 manager.go:349] Starting recovery of all containers
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.658859    2546 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-5.ec2.internal.18c3023cd311f440  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-5.ec2.internal,UID:ip-10-0-135-5.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-5.ec2.internal,},FirstTimestamp:2026-07-17 07:12:17.631310912 +0000 UTC m=+0.437508079,LastTimestamp:2026-07-17 07:12:17.631310912 +0000 UTC m=+0.437508079,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-5.ec2.internal,}"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.666513    2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-65c2l"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.666768    2546 manager.go:354] Recovery completed
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.668257    2546 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.681822    2546 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.681851    2546 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.682533    2546 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.687882    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.690046    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.690083    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.690095    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientPID"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.690726    2546 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.690740    2546 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.690762    2546 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 07:12:17.860671 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.690741    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.691501    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.691535    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.691550    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientPID"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.692393    2546 policy_none.go:49] "None policy: Start"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.692406    2546 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.692417    2546 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.694104    2546 policy_none.go:47] "Start"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.757646    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.758567    2546 manager.go:337] "Starting Device Plugin manager"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.758601    2546 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.758611    2546 server.go:87] "Starting device plugin registration server"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.758917    2546 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.758933    2546 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.759005    2546 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.759099    2546 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.759108    2546 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.759713    2546 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 07:12:17.861825 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.759767    2546 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:17.864421 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.864394    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 07:12:17.875830 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.875809    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 07:12:17.875918 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.875848    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 07:12:17.875918 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.875859    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientPID"
Jul 17 07:12:17.875918 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.875885    2546 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-5.ec2.internal"
Jul 17 07:12:17.883317 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.883260    2546 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-5.ec2.internal"
Jul 17 07:12:17.883317 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.883287    2546 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-5.ec2.internal\": node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:17.898055 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.898028    2546 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 07:12:17.898187 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.898074    2546 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 07:12:17.898187 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.898100    2546 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 07:12:17.898187 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.898140    2546 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 07:12:17.900405 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:17.900386    2546 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 07:12:17.904252 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:17.904232    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:18.000680 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.000623    2546 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-5.ec2.internal"]
Jul 17 07:12:18.000844 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.000736    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 07:12:18.002606 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.002589    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 07:12:18.002697 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.002621    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 07:12:18.002697 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.002631    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientPID"
Jul 17 07:12:18.004898 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.004879    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:18.005063 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.005050    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 07:12:18.005243 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.005228    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.005298 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.005258    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 07:12:18.005947 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.005925    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 07:12:18.006039 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.005962    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 07:12:18.006039 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.005972    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientPID"
Jul 17 07:12:18.006039 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.005931    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 07:12:18.006039 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.006033    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 07:12:18.006184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.006048    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientPID"
Jul 17 07:12:18.008435 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.008410    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.008435 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.008436    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 07:12:18.009298 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.009278    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 07:12:18.009401 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.009302    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 07:12:18.009401 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.009318    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeHasSufficientPID"
Jul 17 07:12:18.022394 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.022368    2546 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-5.ec2.internal\" not found" node="ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.026180 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.026165    2546 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-5.ec2.internal\" not found" node="ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.065188 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.065152    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1c61e6da4cff8c983434da87105eae2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal\" (UID: \"d1c61e6da4cff8c983434da87105eae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.065188 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.065188    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1c61e6da4cff8c983434da87105eae2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal\" (UID: \"d1c61e6da4cff8c983434da87105eae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.065375 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.065206    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23184d284d24f037f7828701abf81791-config\") pod \"kube-apiserver-proxy-ip-10-0-135-5.ec2.internal\" (UID: \"23184d284d24f037f7828701abf81791\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.105748 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.105714    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:18.165787 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.165689    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1c61e6da4cff8c983434da87105eae2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal\" (UID: \"d1c61e6da4cff8c983434da87105eae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.165787 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.165735    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1c61e6da4cff8c983434da87105eae2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal\" (UID: \"d1c61e6da4cff8c983434da87105eae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.165787 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.165759    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23184d284d24f037f7828701abf81791-config\") pod \"kube-apiserver-proxy-ip-10-0-135-5.ec2.internal\" (UID: \"23184d284d24f037f7828701abf81791\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.166007 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.165796    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1c61e6da4cff8c983434da87105eae2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal\" (UID: \"d1c61e6da4cff8c983434da87105eae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.166007 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.165812    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23184d284d24f037f7828701abf81791-config\") pod \"kube-apiserver-proxy-ip-10-0-135-5.ec2.internal\" (UID: \"23184d284d24f037f7828701abf81791\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.166007 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.165805    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1c61e6da4cff8c983434da87105eae2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal\" (UID: \"d1c61e6da4cff8c983434da87105eae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.207646 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.207590    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:18.310921 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.310872    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:18.327319 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.327287    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.329632 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.329607    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:18.412882 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.412836    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:18.516776 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.516686    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:18.573572 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.573543    2546 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 07:12:18.573744 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.573725    2546 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 07:12:18.619308 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.619279    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:18.675116 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.675054    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 07:07:18 +0000 UTC" deadline="2028-03-24 21:51:59.366469046 +0000 UTC"
Jul 17 07:12:18.675116 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.675111    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14798h39m40.691361042s"
Jul 17 07:12:18.687925 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.687905    2546 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 07:12:18.721636 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.721607    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:18.822491 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.822408    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:18.924002 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:18.923971    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:18.960774 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:18.960719    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23184d284d24f037f7828701abf81791.slice/crio-63a4362faa09882151cc7a82c4c2669d253d204317b352c44dcf56898c8f950e WatchSource:0}: Error finding container 63a4362faa09882151cc7a82c4c2669d253d204317b352c44dcf56898c8f950e: Status 404 returned error can't find the container with id 63a4362faa09882151cc7a82c4c2669d253d204317b352c44dcf56898c8f950e
Jul 17 07:12:18.965004 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:18.964990    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 07:12:19.024467 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.024431    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:19.050917 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:19.050891    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c61e6da4cff8c983434da87105eae2.slice/crio-bd3757e5e4d182f92cfd2d425c49eabdb13a2b86bf3f5494a8e9703facadb7e7 WatchSource:0}: Error finding container bd3757e5e4d182f92cfd2d425c49eabdb13a2b86bf3f5494a8e9703facadb7e7: Status 404 returned error can't find the container with id bd3757e5e4d182f92cfd2d425c49eabdb13a2b86bf3f5494a8e9703facadb7e7
Jul 17 07:12:19.124749 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.124664    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-5.ec2.internal\" not found"
Jul 17 07:12:19.152043 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.152023    2546 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 07:12:19.157248 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.157225    2546 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:19.171957 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.171938    2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 07:12:19.173091 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.173078    2546 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-5.ec2.internal"
Jul 17 07:12:19.183532 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.183512    2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 07:12:19.204246 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.204224    2546 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 07:12:19.622150 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.622032    2546 apiserver.go:52] "Watching apiserver"
Jul 17 07:12:19.629843 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.629810    2546 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 07:12:19.630310 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.630276    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-bdfrt","kube-system/kube-apiserver-proxy-ip-10-0-135-5.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sd582","openshift-image-registry/node-ca-gt85w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal","openshift-multus/multus-8q2hw","openshift-multus/network-metrics-daemon-gnkns","openshift-network-diagnostics/network-check-target-kg768","kube-system/global-pull-secret-syncer-l8rd7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7","openshift-dns/node-resolver-rtjsd","openshift-multus/multus-additional-cni-plugins-t2w2w","openshift-network-operator/iptables-alerter-dvbtb","openshift-ovn-kubernetes/ovnkube-node-kl4bz"]
Jul 17 07:12:19.633349 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.633328    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:19.633474 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.633415    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:19.635797 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.635694    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rtjsd"
Jul 17 07:12:19.638196 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.638135    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8tdkk\""
Jul 17 07:12:19.639196 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.638542    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 07:12:19.639196 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.638800    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 07:12:19.639196 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.638823    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.640696 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.640632    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gt85w"
Jul 17 07:12:19.641204 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.641169    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 07:12:19.641293 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.641282    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 07:12:19.641364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.641300    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d4zbc\""
Jul 17 07:12:19.643215 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.643051    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 07:12:19.643215 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.643094    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 07:12:19.643215 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.643113    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 07:12:19.643422 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.643360    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.643422 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.643384    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ppjnf\""
Jul 17 07:12:19.645887 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.645624    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 07:12:19.645887 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.645730    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lj8vv\""
Jul 17 07:12:19.646040 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.645924    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 07:12:19.646040 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.645990    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 07:12:19.646223 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.646203    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.646682 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.646663    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 07:12:19.646787 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.646740    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 07:12:19.647172 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.647138    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 07:12:19.648278 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.648256    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:19.648379 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.648340    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:19.648647 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.648625    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 07:12:19.648739 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.648706    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b7xqq\""
Jul 17 07:12:19.649649 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.649382    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 07:12:19.649649 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.649560    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 07:12:19.649827 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.649776    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 07:12:19.651251 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.650709    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dvbtb"
Jul 17 07:12:19.653571 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.653437    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 07:12:19.653571 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.653501    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 07:12:19.654236 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.653808    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 07:12:19.654830 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.654523    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-djd8s\""
Jul 17 07:12:19.654950 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.654906    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:19.655035 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.655012    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:19.656907 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.656889    2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 07:12:19.657737 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.657353    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.659880 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.659854    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 07:12:19.660179 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.660158    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 07:12:19.660279 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.660161    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:19.660369 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.660362    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 07:12:19.660537 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.660513    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-swdcr\""
Jul 17 07:12:19.662870 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.662850    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.663430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.663409    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 07:12:19.663798 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.663778    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 07:12:19.664014 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.664001    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rw5kv\""
Jul 17 07:12:19.665834 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.665812    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bfp9n\""
Jul 17 07:12:19.665936 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.665857    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 07:12:19.665936 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.665912    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 07:12:19.671802 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.671779    2546 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 07:12:19.673833 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.673809    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-run-openvswitch\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.673917 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.673846    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-log-socket\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.673917 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.673872    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-ovn-node-metrics-cert\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.673917 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.673900    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/236f358b-1f12-4557-a344-79b8198771a6-multus-daemon-config\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.674092 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.673927    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-modprobe-d\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.674092 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.673951    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-cni-bin\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.674092 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.673975    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-ovnkube-config\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.674092 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.673999    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-multus-socket-dir-parent\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.674092 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674028    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/041670b5-0c0b-4067-9abd-0147b2aafd06-iptables-alerter-script\") pod \"iptables-alerter-dvbtb\" (UID: \"041670b5-0c0b-4067-9abd-0147b2aafd06\") " pod="openshift-network-operator/iptables-alerter-dvbtb"
Jul 17 07:12:19.674092 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674057    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6ms\" (UniqueName: \"kubernetes.io/projected/ab8d6a91-d06b-4095-a531-a470e2f000da-kube-api-access-qz6ms\") pod \"node-resolver-rtjsd\" (UID: \"ab8d6a91-d06b-4095-a531-a470e2f000da\") " pod="openshift-dns/node-resolver-rtjsd"
Jul 17 07:12:19.674092 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674082    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-run\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.674430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674106    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-os-release\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.674430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674131    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-etc-kubernetes\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.674430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674154    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-sysctl-conf\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.674430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674179    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-run-netns\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.674430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674202    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-var-lib-openvswitch\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.674430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674226    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-env-overrides\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.674430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674252    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-hostroot\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.674430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674277    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdwkg\" (UniqueName: \"kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg\") pod \"network-check-target-kg768\" (UID: \"d66998d5-f642-42f2-bad6-197b5ceb0bac\") " pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:19.674430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674301    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6974ffb8-419f-47f6-a360-8fc41ea1ec30-konnectivity-ca\") pod \"konnectivity-agent-bdfrt\" (UID: \"6974ffb8-419f-47f6-a360-8fc41ea1ec30\") " pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:19.674430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674368    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a32ad24-a73d-4805-a379-990aa9a4de37-serviceca\") pod \"node-ca-gt85w\" (UID: \"2a32ad24-a73d-4805-a379-990aa9a4de37\") " pod="openshift-image-registry/node-ca-gt85w"
Jul 17 07:12:19.674430 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674413    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgtzx\" (UniqueName: \"kubernetes.io/projected/2a32ad24-a73d-4805-a379-990aa9a4de37-kube-api-access-dgtzx\") pod \"node-ca-gt85w\" (UID: \"2a32ad24-a73d-4805-a379-990aa9a4de37\") " pod="openshift-image-registry/node-ca-gt85w"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674469    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-etc-openvswitch\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674500    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-run-multus-certs\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674522    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674547    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8d6a91-d06b-4095-a531-a470e2f000da-tmp-dir\") pod \"node-resolver-rtjsd\" (UID: \"ab8d6a91-d06b-4095-a531-a470e2f000da\") " pod="openshift-dns/node-resolver-rtjsd"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674576    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-multus-conf-dir\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674607    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-dbus\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674683    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-host\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674727    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-tuned\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674752    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-tmp\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674798    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-system-cni-dir\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674840    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-var-lib-kubelet\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674882    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-kubelet-config\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674912    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-registration-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.674932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674936    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-var-lib-kubelet\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674961    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-ovnkube-script-lib\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.674985    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/236f358b-1f12-4557-a344-79b8198771a6-cni-binary-copy\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675020    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675055    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-kubernetes\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675079    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-lib-modules\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675105    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-multus-cni-dir\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675131    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgxxv\" (UniqueName: \"kubernetes.io/projected/041670b5-0c0b-4067-9abd-0147b2aafd06-kube-api-access-sgxxv\") pod \"iptables-alerter-dvbtb\" (UID: \"041670b5-0c0b-4067-9abd-0147b2aafd06\") " pod="openshift-network-operator/iptables-alerter-dvbtb"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675156    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-device-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675199    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-sysconfig\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675223    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a32ad24-a73d-4805-a379-990aa9a4de37-host\") pod \"node-ca-gt85w\" (UID: \"2a32ad24-a73d-4805-a379-990aa9a4de37\") " pod="openshift-image-registry/node-ca-gt85w"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675250    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-systemd-units\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675278    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-slash\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675302    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-run-systemd\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.675623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675339    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675370    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-run-netns\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675395    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j4fb\" (UniqueName: \"kubernetes.io/projected/1af5082a-b742-44c6-8ed0-700ae4dd117b-kube-api-access-9j4fb\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675422    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-run-ovn\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675446    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-run-ovn-kubernetes\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675470    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-var-lib-cni-bin\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675508    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6974ffb8-419f-47f6-a360-8fc41ea1ec30-agent-certs\") pod \"konnectivity-agent-bdfrt\" (UID: \"6974ffb8-419f-47f6-a360-8fc41ea1ec30\") " pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675543    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-cni-netd\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675580    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/041670b5-0c0b-4067-9abd-0147b2aafd06-host-slash\") pod \"iptables-alerter-dvbtb\" (UID: \"041670b5-0c0b-4067-9abd-0147b2aafd06\") " pod="openshift-network-operator/iptables-alerter-dvbtb"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675605    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-socket-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675636    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-sys-fs\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675661    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-node-log\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675715    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.676350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675740    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssscz\" (UniqueName: \"kubernetes.io/projected/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-kube-api-access-ssscz\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675764    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjbb8\" (UniqueName: \"kubernetes.io/projected/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-kube-api-access-kjbb8\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675804    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab8d6a91-d06b-4095-a531-a470e2f000da-hosts-file\") pod \"node-resolver-rtjsd\" (UID: \"ab8d6a91-d06b-4095-a531-a470e2f000da\") " pod="openshift-dns/node-resolver-rtjsd"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675829    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-sysctl-d\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675853    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-run-k8s-cni-cncf-io\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675878    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675904    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfmd8\" (UniqueName: \"kubernetes.io/projected/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-kube-api-access-cfmd8\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675927    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-cnibin\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675951    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-var-lib-cni-multus\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.675988    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zlbv\" (UniqueName: \"kubernetes.io/projected/236f358b-1f12-4557-a344-79b8198771a6-kube-api-access-2zlbv\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.676016    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-systemd\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.676041    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-sys\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.677064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.676068    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-kubelet\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.705890 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.705861    2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d8mpb"
Jul 17 07:12:19.713868 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.713840    2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d8mpb"
Jul 17 07:12:19.759239 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.759208    2546 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 07:12:19.777050 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777019    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfmd8\" (UniqueName: \"kubernetes.io/projected/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-kube-api-access-cfmd8\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.777219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777062    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-cnibin\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.777219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777089    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-var-lib-cni-multus\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.777219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777112    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zlbv\" (UniqueName: \"kubernetes.io/projected/236f358b-1f12-4557-a344-79b8198771a6-kube-api-access-2zlbv\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.777219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777139    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.777219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777166    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-systemd\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.777219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777188    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-sys\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.777219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777210    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-kubelet\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777235    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-run-openvswitch\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777259    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-log-socket\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777350    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-ovn-node-metrics-cert\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777376    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/236f358b-1f12-4557-a344-79b8198771a6-multus-daemon-config\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777400    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-modprobe-d\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777410    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-sys\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777430    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-cni-bin\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777457    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-ovnkube-config\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777503    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-multus-socket-dir-parent\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777532    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/041670b5-0c0b-4067-9abd-0147b2aafd06-iptables-alerter-script\") pod \"iptables-alerter-dvbtb\" (UID: \"041670b5-0c0b-4067-9abd-0147b2aafd06\") " pod="openshift-network-operator/iptables-alerter-dvbtb"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777565    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6ms\" (UniqueName: \"kubernetes.io/projected/ab8d6a91-d06b-4095-a531-a470e2f000da-kube-api-access-qz6ms\") pod \"node-resolver-rtjsd\" (UID: \"ab8d6a91-d06b-4095-a531-a470e2f000da\") " pod="openshift-dns/node-resolver-rtjsd"
Jul 17 07:12:19.777609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777592    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-run\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777615    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-os-release\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777639    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-etc-kubernetes\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777673    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-sysctl-conf\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777700    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-run-netns\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777710    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-systemd\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777746    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-var-lib-openvswitch\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777782    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-env-overrides\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777807    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-hostroot\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777833    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwkg\" (UniqueName: \"kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg\") pod \"network-check-target-kg768\" (UID: \"d66998d5-f642-42f2-bad6-197b5ceb0bac\") " pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777859    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6974ffb8-419f-47f6-a360-8fc41ea1ec30-konnectivity-ca\") pod \"konnectivity-agent-bdfrt\" (UID: \"6974ffb8-419f-47f6-a360-8fc41ea1ec30\") " pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777887    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/685350e6-1b5d-472b-b075-9593e40ae8b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777914    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a32ad24-a73d-4805-a379-990aa9a4de37-serviceca\") pod \"node-ca-gt85w\" (UID: \"2a32ad24-a73d-4805-a379-990aa9a4de37\") " pod="openshift-image-registry/node-ca-gt85w"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777949    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgtzx\" (UniqueName: \"kubernetes.io/projected/2a32ad24-a73d-4805-a379-990aa9a4de37-kube-api-access-dgtzx\") pod \"node-ca-gt85w\" (UID: \"2a32ad24-a73d-4805-a379-990aa9a4de37\") " pod="openshift-image-registry/node-ca-gt85w"
Jul 17 07:12:19.778309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777976    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-etc-openvswitch\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778004    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-run-multus-certs\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778030    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778059    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8d6a91-d06b-4095-a531-a470e2f000da-tmp-dir\") pod \"node-resolver-rtjsd\" (UID: \"ab8d6a91-d06b-4095-a531-a470e2f000da\") " pod="openshift-dns/node-resolver-rtjsd"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778093    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-multus-conf-dir\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778119    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-dbus\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778159    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-host\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778191    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-tuned\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778222    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-tmp\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778250    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-system-cni-dir\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778248    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-modprobe-d\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778277    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-var-lib-kubelet\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778305    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-kubelet-config\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778310    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-cni-bin\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778343    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-registration-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.779020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778376    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/236f358b-1f12-4557-a344-79b8198771a6-multus-daemon-config\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778382    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-run\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778380    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9svjn\" (UniqueName: \"kubernetes.io/projected/685350e6-1b5d-472b-b075-9593e40ae8b5-kube-api-access-9svjn\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778419    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-kubelet-config\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778429    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-var-lib-kubelet\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778440    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-kubelet\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777232    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-cnibin\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778485    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-log-socket\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778507    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-os-release\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778555    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-run-openvswitch\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778601    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-etc-kubernetes\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778707    2546 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778727    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-sysctl-conf\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.777675    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-var-lib-cni-multus\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778806    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-run-netns\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.779790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778851    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-var-lib-openvswitch\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778976    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/041670b5-0c0b-4067-9abd-0147b2aafd06-iptables-alerter-script\") pod \"iptables-alerter-dvbtb\" (UID: \"041670b5-0c0b-4067-9abd-0147b2aafd06\") " pod="openshift-network-operator/iptables-alerter-dvbtb"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778994    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-ovnkube-config\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779030    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-ovnkube-script-lib\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779046    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-registration-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779061    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/236f358b-1f12-4557-a344-79b8198771a6-cni-binary-copy\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779088    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779119    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-kubernetes\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779148    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-lib-modules\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779174    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-multus-cni-dir\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779200    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgxxv\" (UniqueName: \"kubernetes.io/projected/041670b5-0c0b-4067-9abd-0147b2aafd06-kube-api-access-sgxxv\") pod \"iptables-alerter-dvbtb\" (UID: \"041670b5-0c0b-4067-9abd-0147b2aafd06\") " pod="openshift-network-operator/iptables-alerter-dvbtb"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779230    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-device-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779256    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-sysconfig\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779259    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-env-overrides\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779284    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a32ad24-a73d-4805-a379-990aa9a4de37-host\") pod \"node-ca-gt85w\" (UID: \"2a32ad24-a73d-4805-a379-990aa9a4de37\") " pod="openshift-image-registry/node-ca-gt85w"
Jul 17 07:12:19.780633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779327    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-hostroot\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779336    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a32ad24-a73d-4805-a379-990aa9a4de37-host\") pod \"node-ca-gt85w\" (UID: \"2a32ad24-a73d-4805-a379-990aa9a4de37\") " pod="openshift-image-registry/node-ca-gt85w"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779362    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-systemd-units\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779390    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-slash\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779416    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-run-systemd\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779445    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779474    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-run-netns\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779504    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j4fb\" (UniqueName: \"kubernetes.io/projected/1af5082a-b742-44c6-8ed0-700ae4dd117b-kube-api-access-9j4fb\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779532    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-run-ovn\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779558    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-run-ovn-kubernetes\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.778376    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-multus-socket-dir-parent\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779560    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-ovnkube-script-lib\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779607    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-var-lib-cni-bin\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779635    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6974ffb8-419f-47f6-a360-8fc41ea1ec30-agent-certs\") pod \"konnectivity-agent-bdfrt\" (UID: \"6974ffb8-419f-47f6-a360-8fc41ea1ec30\") " pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:19.781429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779666    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-system-cni-dir\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779696    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-os-release\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779724    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/685350e6-1b5d-472b-b075-9593e40ae8b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779770    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-cni-netd\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779809    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/041670b5-0c0b-4067-9abd-0147b2aafd06-host-slash\") pod \"iptables-alerter-dvbtb\" (UID: \"041670b5-0c0b-4067-9abd-0147b2aafd06\") " pod="openshift-network-operator/iptables-alerter-dvbtb"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779842    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-socket-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779847    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-var-lib-cni-bin\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779878    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/236f358b-1f12-4557-a344-79b8198771a6-cni-binary-copy\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779870    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-sys-fs\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779887    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-multus-cni-dir\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779924    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-sys-fs\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779923    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-node-log\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779959    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-node-log\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779966    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.782176 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779961    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-device-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.779995    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssscz\" (UniqueName: \"kubernetes.io/projected/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-kube-api-access-ssscz\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780026    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-sysconfig\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780025    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjbb8\" (UniqueName: \"kubernetes.io/projected/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-kube-api-access-kjbb8\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780064    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-cnibin\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780093    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab8d6a91-d06b-4095-a531-a470e2f000da-hosts-file\") pod \"node-resolver-rtjsd\" (UID: \"ab8d6a91-d06b-4095-a531-a470e2f000da\") " pod="openshift-dns/node-resolver-rtjsd"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780118    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-sysctl-d\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780145    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-run-k8s-cni-cncf-io\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780171    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780213    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/041670b5-0c0b-4067-9abd-0147b2aafd06-host-slash\") pod \"iptables-alerter-dvbtb\" (UID: \"041670b5-0c0b-4067-9abd-0147b2aafd06\") " pod="openshift-network-operator/iptables-alerter-dvbtb"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780241    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/685350e6-1b5d-472b-b075-9593e40ae8b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780336    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-socket-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780343    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab8d6a91-d06b-4095-a531-a470e2f000da-hosts-file\") pod \"node-resolver-rtjsd\" (UID: \"ab8d6a91-d06b-4095-a531-a470e2f000da\") " pod="openshift-dns/node-resolver-rtjsd"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780353    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-kubernetes\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.782927 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780382    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-run-k8s-cni-cncf-io\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780395    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6974ffb8-419f-47f6-a360-8fc41ea1ec30-konnectivity-ca\") pod \"konnectivity-agent-bdfrt\" (UID: \"6974ffb8-419f-47f6-a360-8fc41ea1ec30\") " pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780428    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780432    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1af5082a-b742-44c6-8ed0-700ae4dd117b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780463    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-sysctl-d\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780474    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-run-systemd\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780504    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-system-cni-dir\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780520    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-var-lib-kubelet\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.780535    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780553    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.780570    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.780597    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs podName:8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222 nodeName:}" failed. No retries permitted until 2026-07-17 07:12:20.280575832 +0000 UTC m=+3.086772989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs") pod "network-metrics-daemon-gnkns" (UID: "8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780598    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-systemd-units\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780604    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-run-netns\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.783755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780652    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-host-run-multus-certs\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.780665    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret podName:018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e nodeName:}" failed. No retries permitted until 2026-07-17 07:12:20.280647397 +0000 UTC m=+3.086844791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret") pod "global-pull-secret-syncer-l8rd7" (UID: "018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780668    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-lib-modules\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780564    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-var-lib-kubelet\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780710    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-run-ovn-kubernetes\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780803    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-slash\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780835    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-etc-openvswitch\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780857    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-dbus\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780897    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/236f358b-1f12-4557-a344-79b8198771a6-multus-conf-dir\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780861    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-run-ovn\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780905    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-host\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.780996    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-host-cni-netd\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.781162    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab8d6a91-d06b-4095-a531-a470e2f000da-tmp-dir\") pod \"node-resolver-rtjsd\" (UID: \"ab8d6a91-d06b-4095-a531-a470e2f000da\") " pod="openshift-dns/node-resolver-rtjsd"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.781419    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a32ad24-a73d-4805-a379-990aa9a4de37-serviceca\") pod \"node-ca-gt85w\" (UID: \"2a32ad24-a73d-4805-a379-990aa9a4de37\") " pod="openshift-image-registry/node-ca-gt85w"
Jul 17 07:12:19.784531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.782689    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-ovn-node-metrics-cert\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.785349 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.784247    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-etc-tuned\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.785349 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.784387    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-tmp\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.785349 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.784457    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6974ffb8-419f-47f6-a360-8fc41ea1ec30-agent-certs\") pod \"konnectivity-agent-bdfrt\" (UID: \"6974ffb8-419f-47f6-a360-8fc41ea1ec30\") " pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:19.785694 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.785671    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 07:12:19.785694 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.785695    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 07:12:19.785861 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.785710    2546 projected.go:196] Error preparing data for projected volume kube-api-access-bdwkg for pod openshift-network-diagnostics/network-check-target-kg768: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:19.785861 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:19.785831    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg podName:d66998d5-f642-42f2-bad6-197b5ceb0bac nodeName:}" failed. No retries permitted until 2026-07-17 07:12:20.285813776 +0000 UTC m=+3.092010949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bdwkg" (UniqueName: "kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg") pod "network-check-target-kg768" (UID: "d66998d5-f642-42f2-bad6-197b5ceb0bac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:19.787575 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.787544    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6ms\" (UniqueName: \"kubernetes.io/projected/ab8d6a91-d06b-4095-a531-a470e2f000da-kube-api-access-qz6ms\") pod \"node-resolver-rtjsd\" (UID: \"ab8d6a91-d06b-4095-a531-a470e2f000da\") " pod="openshift-dns/node-resolver-rtjsd"
Jul 17 07:12:19.789638 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.788891    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfmd8\" (UniqueName: \"kubernetes.io/projected/dae8c662-dcf7-4c44-88bb-f4f5c9da695e-kube-api-access-cfmd8\") pod \"tuned-sd582\" (UID: \"dae8c662-dcf7-4c44-88bb-f4f5c9da695e\") " pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.789638 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.789367    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgxxv\" (UniqueName: \"kubernetes.io/projected/041670b5-0c0b-4067-9abd-0147b2aafd06-kube-api-access-sgxxv\") pod \"iptables-alerter-dvbtb\" (UID: \"041670b5-0c0b-4067-9abd-0147b2aafd06\") " pod="openshift-network-operator/iptables-alerter-dvbtb"
Jul 17 07:12:19.789821 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.789798    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zlbv\" (UniqueName: \"kubernetes.io/projected/236f358b-1f12-4557-a344-79b8198771a6-kube-api-access-2zlbv\") pod \"multus-8q2hw\" (UID: \"236f358b-1f12-4557-a344-79b8198771a6\") " pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:19.792096 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.792071    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j4fb\" (UniqueName: \"kubernetes.io/projected/1af5082a-b742-44c6-8ed0-700ae4dd117b-kube-api-access-9j4fb\") pod \"aws-ebs-csi-driver-node-zzvn7\" (UID: \"1af5082a-b742-44c6-8ed0-700ae4dd117b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:19.792487 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.792444    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssscz\" (UniqueName: \"kubernetes.io/projected/3b8d47e6-fd99-4fa7-9822-0e29f21e132c-kube-api-access-ssscz\") pod \"ovnkube-node-kl4bz\" (UID: \"3b8d47e6-fd99-4fa7-9822-0e29f21e132c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.794010 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.793942    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgtzx\" (UniqueName: \"kubernetes.io/projected/2a32ad24-a73d-4805-a379-990aa9a4de37-kube-api-access-dgtzx\") pod \"node-ca-gt85w\" (UID: \"2a32ad24-a73d-4805-a379-990aa9a4de37\") " pod="openshift-image-registry/node-ca-gt85w"
Jul 17 07:12:19.794169 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.794147    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjbb8\" (UniqueName: \"kubernetes.io/projected/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-kube-api-access-kjbb8\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:19.881478 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.881387    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9svjn\" (UniqueName: \"kubernetes.io/projected/685350e6-1b5d-472b-b075-9593e40ae8b5-kube-api-access-9svjn\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.881478 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.881463    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-system-cni-dir\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.881728 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.881492    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-os-release\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.881728 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.881514    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/685350e6-1b5d-472b-b075-9593e40ae8b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.881728 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.881545    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-cnibin\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.881728 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.881575    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/685350e6-1b5d-472b-b075-9593e40ae8b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.881728 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.881602    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.881728 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.881659    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/685350e6-1b5d-472b-b075-9593e40ae8b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.882149 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.882118    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-system-cni-dir\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.882249 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.882191    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-cnibin\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.882249 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.882209    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.882398 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.882254    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/685350e6-1b5d-472b-b075-9593e40ae8b5-os-release\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.882398 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.882309    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/685350e6-1b5d-472b-b075-9593e40ae8b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.882552 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.882531    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/685350e6-1b5d-472b-b075-9593e40ae8b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.882967 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.882946    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/685350e6-1b5d-472b-b075-9593e40ae8b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.890691 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.890660    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9svjn\" (UniqueName: \"kubernetes.io/projected/685350e6-1b5d-472b-b075-9593e40ae8b5-kube-api-access-9svjn\") pod \"multus-additional-cni-plugins-t2w2w\" (UID: \"685350e6-1b5d-472b-b075-9593e40ae8b5\") " pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:19.903444 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.903395    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-5.ec2.internal" event={"ID":"23184d284d24f037f7828701abf81791","Type":"ContainerStarted","Data":"63a4362faa09882151cc7a82c4c2669d253d204317b352c44dcf56898c8f950e"}
Jul 17 07:12:19.905354 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.905304    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal" event={"ID":"d1c61e6da4cff8c983434da87105eae2","Type":"ContainerStarted","Data":"bd3757e5e4d182f92cfd2d425c49eabdb13a2b86bf3f5494a8e9703facadb7e7"}
Jul 17 07:12:19.950815 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.950786    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rtjsd"
Jul 17 07:12:19.962022 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.961996    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sd582"
Jul 17 07:12:19.972140 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.972116    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gt85w"
Jul 17 07:12:19.981279 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.981252    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:19.991733 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:19.991652    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8q2hw"
Jul 17 07:12:20.000723 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.000700    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dvbtb"
Jul 17 07:12:20.008782 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.008760    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7"
Jul 17 07:12:20.011032 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.011005    2546 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 07:12:20.018230 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.018201    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:20.024956 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.024938    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t2w2w"
Jul 17 07:12:20.285202 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.285105    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:20.285202 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.285167    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:20.285437 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:20.285298    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:20.285437 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:20.285322    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:20.285437 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:20.285362    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret podName:018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e nodeName:}" failed. No retries permitted until 2026-07-17 07:12:21.285343554 +0000 UTC m=+4.091540714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret") pod "global-pull-secret-syncer-l8rd7" (UID: "018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:20.285437 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:20.285411    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs podName:8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222 nodeName:}" failed. No retries permitted until 2026-07-17 07:12:21.285388388 +0000 UTC m=+4.091585546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs") pod "network-metrics-daemon-gnkns" (UID: "8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:20.386378 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.386332    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwkg\" (UniqueName: \"kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg\") pod \"network-check-target-kg768\" (UID: \"d66998d5-f642-42f2-bad6-197b5ceb0bac\") " pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:20.386570 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:20.386521    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 07:12:20.386570 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:20.386555    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 07:12:20.386570 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:20.386570    2546 projected.go:196] Error preparing data for projected volume kube-api-access-bdwkg for pod openshift-network-diagnostics/network-check-target-kg768: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:20.386720 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:20.386641    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg podName:d66998d5-f642-42f2-bad6-197b5ceb0bac nodeName:}" failed. No retries permitted until 2026-07-17 07:12:21.386619646 +0000 UTC m=+4.192816823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdwkg" (UniqueName: "kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg") pod "network-check-target-kg768" (UID: "d66998d5-f642-42f2-bad6-197b5ceb0bac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:20.717235 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.717148    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 07:07:19 +0000 UTC" deadline="2028-03-07 05:50:11.047534519 +0000 UTC"
Jul 17 07:12:20.717235 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.717212    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14374h37m50.330326395s"
Jul 17 07:12:20.717961 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:20.717899    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685350e6_1b5d_472b_b075_9593e40ae8b5.slice/crio-1577c856f7b6a7acd0edbab776bcb25c3cd3e30836531571bfc1f8d22eaf3165 WatchSource:0}: Error finding container 1577c856f7b6a7acd0edbab776bcb25c3cd3e30836531571bfc1f8d22eaf3165: Status 404 returned error can't find the container with id 1577c856f7b6a7acd0edbab776bcb25c3cd3e30836531571bfc1f8d22eaf3165
Jul 17 07:12:20.720761 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:20.720735    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a32ad24_a73d_4805_a379_990aa9a4de37.slice/crio-c730d0f8c62b52e443af633cb35b1c7936e71750528d9eb04048f6db1eec8ca3 WatchSource:0}: Error finding container c730d0f8c62b52e443af633cb35b1c7936e71750528d9eb04048f6db1eec8ca3: Status 404 returned error can't find the container with id c730d0f8c62b52e443af633cb35b1c7936e71750528d9eb04048f6db1eec8ca3
Jul 17 07:12:20.744428 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:20.744401    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8d47e6_fd99_4fa7_9822_0e29f21e132c.slice/crio-ef62bcbe10fa46467402b66465005dda779737cd04bc83f801de78974e01e36b WatchSource:0}: Error finding container ef62bcbe10fa46467402b66465005dda779737cd04bc83f801de78974e01e36b: Status 404 returned error can't find the container with id ef62bcbe10fa46467402b66465005dda779737cd04bc83f801de78974e01e36b
Jul 17 07:12:20.745762 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:20.745720    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6974ffb8_419f_47f6_a360_8fc41ea1ec30.slice/crio-ac51ac270f81878bedf56d4932d5f759f26a38bf18e884d8f57d5d9689ee68af WatchSource:0}: Error finding container ac51ac270f81878bedf56d4932d5f759f26a38bf18e884d8f57d5d9689ee68af: Status 404 returned error can't find the container with id ac51ac270f81878bedf56d4932d5f759f26a38bf18e884d8f57d5d9689ee68af
Jul 17 07:12:20.746645 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:20.746619    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8d6a91_d06b_4095_a531_a470e2f000da.slice/crio-a772e1697858a064d7eb54fa798bfc43a7632d32892c8d488f1d78c8041bcbee WatchSource:0}: Error finding container a772e1697858a064d7eb54fa798bfc43a7632d32892c8d488f1d78c8041bcbee: Status 404 returned error can't find the container with id a772e1697858a064d7eb54fa798bfc43a7632d32892c8d488f1d78c8041bcbee
Jul 17 07:12:20.747544 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:20.747485    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236f358b_1f12_4557_a344_79b8198771a6.slice/crio-6a006b83ccd2bea7cb9ca0692ca6d34ef50f5ac60dc6d8abadbe9ce4275f6d45 WatchSource:0}: Error finding container 6a006b83ccd2bea7cb9ca0692ca6d34ef50f5ac60dc6d8abadbe9ce4275f6d45: Status 404 returned error can't find the container with id 6a006b83ccd2bea7cb9ca0692ca6d34ef50f5ac60dc6d8abadbe9ce4275f6d45
Jul 17 07:12:20.748857 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:20.748836    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae8c662_dcf7_4c44_88bb_f4f5c9da695e.slice/crio-1579df1943678dca12d20fee2c82168601f06e1e563f968527238c7d6db7977c WatchSource:0}: Error finding container 1579df1943678dca12d20fee2c82168601f06e1e563f968527238c7d6db7977c: Status 404 returned error can't find the container with id 1579df1943678dca12d20fee2c82168601f06e1e563f968527238c7d6db7977c
Jul 17 07:12:20.749349 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:20.749325    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af5082a_b742_44c6_8ed0_700ae4dd117b.slice/crio-94b7d544fa76ea1a62230c110ba30ed4d2873d6621a51d53b2da07c3c5f09f17 WatchSource:0}: Error finding container 94b7d544fa76ea1a62230c110ba30ed4d2873d6621a51d53b2da07c3c5f09f17: Status 404 returned error can't find the container with id 94b7d544fa76ea1a62230c110ba30ed4d2873d6621a51d53b2da07c3c5f09f17
Jul 17 07:12:20.750402 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:20.750379    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041670b5_0c0b_4067_9abd_0147b2aafd06.slice/crio-b70860e249d3f7c1ae3e20254ec34db9399307706ef349ac14ee3801cfbe7101 WatchSource:0}: Error finding container b70860e249d3f7c1ae3e20254ec34db9399307706ef349ac14ee3801cfbe7101: Status 404 returned error can't find the container with id b70860e249d3f7c1ae3e20254ec34db9399307706ef349ac14ee3801cfbe7101
Jul 17 07:12:20.908919 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.908872    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dvbtb" event={"ID":"041670b5-0c0b-4067-9abd-0147b2aafd06","Type":"ContainerStarted","Data":"b70860e249d3f7c1ae3e20254ec34db9399307706ef349ac14ee3801cfbe7101"}
Jul 17 07:12:20.910279 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.910247    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sd582" event={"ID":"dae8c662-dcf7-4c44-88bb-f4f5c9da695e","Type":"ContainerStarted","Data":"1579df1943678dca12d20fee2c82168601f06e1e563f968527238c7d6db7977c"}
Jul 17 07:12:20.911494 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.911468    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rtjsd" event={"ID":"ab8d6a91-d06b-4095-a531-a470e2f000da","Type":"ContainerStarted","Data":"a772e1697858a064d7eb54fa798bfc43a7632d32892c8d488f1d78c8041bcbee"}
Jul 17 07:12:20.912769 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.912746    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bdfrt" event={"ID":"6974ffb8-419f-47f6-a360-8fc41ea1ec30","Type":"ContainerStarted","Data":"ac51ac270f81878bedf56d4932d5f759f26a38bf18e884d8f57d5d9689ee68af"}
Jul 17 07:12:20.913852 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.913818    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2w2w" event={"ID":"685350e6-1b5d-472b-b075-9593e40ae8b5","Type":"ContainerStarted","Data":"1577c856f7b6a7acd0edbab776bcb25c3cd3e30836531571bfc1f8d22eaf3165"}
Jul 17 07:12:20.915163 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.915134    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7" event={"ID":"1af5082a-b742-44c6-8ed0-700ae4dd117b","Type":"ContainerStarted","Data":"94b7d544fa76ea1a62230c110ba30ed4d2873d6621a51d53b2da07c3c5f09f17"}
Jul 17 07:12:20.916453 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.916428    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8q2hw" event={"ID":"236f358b-1f12-4557-a344-79b8198771a6","Type":"ContainerStarted","Data":"6a006b83ccd2bea7cb9ca0692ca6d34ef50f5ac60dc6d8abadbe9ce4275f6d45"}
Jul 17 07:12:20.917764 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.917742    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz" event={"ID":"3b8d47e6-fd99-4fa7-9822-0e29f21e132c","Type":"ContainerStarted","Data":"ef62bcbe10fa46467402b66465005dda779737cd04bc83f801de78974e01e36b"}
Jul 17 07:12:20.919011 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:20.918987    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gt85w" event={"ID":"2a32ad24-a73d-4805-a379-990aa9a4de37","Type":"ContainerStarted","Data":"c730d0f8c62b52e443af633cb35b1c7936e71750528d9eb04048f6db1eec8ca3"}
Jul 17 07:12:21.294683 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.294404    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:21.295048 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.294946    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:21.295167 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:21.294599    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:21.295167 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:21.295159    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs podName:8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222 nodeName:}" failed. No retries permitted until 2026-07-17 07:12:23.295135627 +0000 UTC m=+6.101332782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs") pod "network-metrics-daemon-gnkns" (UID: "8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:21.295523 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:21.295087    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:21.295717 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:21.295569    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret podName:018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e nodeName:}" failed. No retries permitted until 2026-07-17 07:12:23.2955492 +0000 UTC m=+6.101746355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret") pod "global-pull-secret-syncer-l8rd7" (UID: "018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:21.396389 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.396348    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwkg\" (UniqueName: \"kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg\") pod \"network-check-target-kg768\" (UID: \"d66998d5-f642-42f2-bad6-197b5ceb0bac\") " pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:21.396553 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:21.396536    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 07:12:21.396625 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:21.396555    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 07:12:21.396625 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:21.396570    2546 projected.go:196] Error preparing data for projected volume kube-api-access-bdwkg for pod openshift-network-diagnostics/network-check-target-kg768: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:21.396732 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:21.396631    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg podName:d66998d5-f642-42f2-bad6-197b5ceb0bac nodeName:}" failed. No retries permitted until 2026-07-17 07:12:23.396612717 +0000 UTC m=+6.202809872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdwkg" (UniqueName: "kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg") pod "network-check-target-kg768" (UID: "d66998d5-f642-42f2-bad6-197b5ceb0bac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:21.718238 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.718138    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 07:07:19 +0000 UTC" deadline="2028-04-14 00:59:32.125314216 +0000 UTC"
Jul 17 07:12:21.718238 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.718179    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15281h47m10.407139642s"
Jul 17 07:12:21.899982 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.899945    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:21.900171 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:21.900089    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:21.900545 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.900526    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:21.900664 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:21.900618    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:21.901326 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.901277    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:21.901421 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:21.901387    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:21.941555 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.941515    2546 generic.go:356] "Generic (PLEG): container finished" podID="d1c61e6da4cff8c983434da87105eae2" containerID="abd4a2fadaf29672f127b09569596ccb543689319971093fe38f939be6dec513" exitCode=0
Jul 17 07:12:21.941855 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.941827    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal" event={"ID":"d1c61e6da4cff8c983434da87105eae2","Type":"ContainerDied","Data":"abd4a2fadaf29672f127b09569596ccb543689319971093fe38f939be6dec513"}
Jul 17 07:12:21.954133 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.953600    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-5.ec2.internal" event={"ID":"23184d284d24f037f7828701abf81791","Type":"ContainerStarted","Data":"fb97968939462ac274e3d14b1f12717fa3b6dbd3d69dac2608ae019b43bd2119"}
Jul 17 07:12:21.975305 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:21.975204    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-5.ec2.internal" podStartSLOduration=2.975180589 podStartE2EDuration="2.975180589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:12:21.974365674 +0000 UTC m=+4.780562855" watchObservedRunningTime="2026-07-17 07:12:21.975180589 +0000 UTC m=+4.781377769"
Jul 17 07:12:22.973608 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:22.973488    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal" event={"ID":"d1c61e6da4cff8c983434da87105eae2","Type":"ContainerStarted","Data":"4fbb78e10b62098a2a6b4fa07f137e75eef97da0150f088d50a67867a1cdc7f1"}
Jul 17 07:12:23.311960 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:23.311877    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:23.311960 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:23.311931    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:23.312180 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:23.312048    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:23.312180 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:23.312050    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:23.312180 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:23.312114    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret podName:018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e nodeName:}" failed. No retries permitted until 2026-07-17 07:12:27.312095318 +0000 UTC m=+10.118292473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret") pod "global-pull-secret-syncer-l8rd7" (UID: "018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:23.312180 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:23.312133    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs podName:8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222 nodeName:}" failed. No retries permitted until 2026-07-17 07:12:27.312122669 +0000 UTC m=+10.118319825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs") pod "network-metrics-daemon-gnkns" (UID: "8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:23.412465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:23.412433    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwkg\" (UniqueName: \"kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg\") pod \"network-check-target-kg768\" (UID: \"d66998d5-f642-42f2-bad6-197b5ceb0bac\") " pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:23.412655 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:23.412639    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 07:12:23.412733 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:23.412678    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 07:12:23.412733 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:23.412692    2546 projected.go:196] Error preparing data for projected volume kube-api-access-bdwkg for pod openshift-network-diagnostics/network-check-target-kg768: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:23.412843 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:23.412748    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg podName:d66998d5-f642-42f2-bad6-197b5ceb0bac nodeName:}" failed. No retries permitted until 2026-07-17 07:12:27.412730231 +0000 UTC m=+10.218927389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdwkg" (UniqueName: "kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg") pod "network-check-target-kg768" (UID: "d66998d5-f642-42f2-bad6-197b5ceb0bac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:23.899832 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:23.899789    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:23.900004 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:23.899926    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:23.900288 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:23.900269    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:23.900429 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:23.900397    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:23.900480 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:23.900455    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:23.900540 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:23.900523    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:25.899991 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:25.899908    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:25.900441 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:25.899912    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:25.900441 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:25.900116    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:25.900441 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:25.900173    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:25.900441 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:25.900278    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:25.900441 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:25.900359    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:27.345741 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:27.345126    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:27.345741 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:27.345182    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:27.345741 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:27.345349    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:27.345741 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:27.345415    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret podName:018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e nodeName:}" failed. No retries permitted until 2026-07-17 07:12:35.345396589 +0000 UTC m=+18.151593741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret") pod "global-pull-secret-syncer-l8rd7" (UID: "018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:27.345741 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:27.345463    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:27.345741 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:27.345534    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs podName:8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222 nodeName:}" failed. No retries permitted until 2026-07-17 07:12:35.345515496 +0000 UTC m=+18.151712654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs") pod "network-metrics-daemon-gnkns" (UID: "8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:27.445949 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:27.445901    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwkg\" (UniqueName: \"kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg\") pod \"network-check-target-kg768\" (UID: \"d66998d5-f642-42f2-bad6-197b5ceb0bac\") " pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:27.446128 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:27.446079    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 07:12:27.446128 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:27.446109    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 07:12:27.446128 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:27.446122    2546 projected.go:196] Error preparing data for projected volume kube-api-access-bdwkg for pod openshift-network-diagnostics/network-check-target-kg768: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:27.446266 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:27.446194    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg podName:d66998d5-f642-42f2-bad6-197b5ceb0bac nodeName:}" failed. No retries permitted until 2026-07-17 07:12:35.446174216 +0000 UTC m=+18.252371380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdwkg" (UniqueName: "kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg") pod "network-check-target-kg768" (UID: "d66998d5-f642-42f2-bad6-197b5ceb0bac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:27.899553 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:27.899524    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:27.899774 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:27.899621    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:27.899774 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:27.899660    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:27.899774 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:27.899708    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:27.899774 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:27.899721    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:27.899983 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:27.899863    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:29.899146 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:29.899107    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:29.899835 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:29.899107    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:29.899835 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:29.899266    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:29.899835 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:29.899256    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:29.899835 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:29.899365    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:29.899835 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:29.899450    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:31.899380 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:31.899298    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:31.899380 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:31.899309    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:31.899380 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:31.899309    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:31.899983 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:31.899431    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:31.899983 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:31.899508    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:31.899983 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:31.899606    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:33.899246 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:33.899212    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:33.899246 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:33.899252    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:33.899782 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:33.899208    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:33.899782 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:33.899355    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:33.899782 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:33.899430    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:33.899782 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:33.899515    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:35.413498 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:35.413458    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:35.413498 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:35.413503    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:35.414059 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:35.413620    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:35.414059 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:35.413633    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:35.414059 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:35.413691    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret podName:018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e nodeName:}" failed. No retries permitted until 2026-07-17 07:12:51.413658811 +0000 UTC m=+34.219855983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret") pod "global-pull-secret-syncer-l8rd7" (UID: "018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:35.414059 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:35.413711    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs podName:8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222 nodeName:}" failed. No retries permitted until 2026-07-17 07:12:51.41370202 +0000 UTC m=+34.219899176 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs") pod "network-metrics-daemon-gnkns" (UID: "8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:35.514842 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:35.514798    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwkg\" (UniqueName: \"kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg\") pod \"network-check-target-kg768\" (UID: \"d66998d5-f642-42f2-bad6-197b5ceb0bac\") " pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:35.515014 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:35.514980    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 07:12:35.515014 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:35.515007    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 07:12:35.515139 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:35.515020    2546 projected.go:196] Error preparing data for projected volume kube-api-access-bdwkg for pod openshift-network-diagnostics/network-check-target-kg768: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:35.515139 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:35.515090    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg podName:d66998d5-f642-42f2-bad6-197b5ceb0bac nodeName:}" failed. No retries permitted until 2026-07-17 07:12:51.515069139 +0000 UTC m=+34.321266292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdwkg" (UniqueName: "kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg") pod "network-check-target-kg768" (UID: "d66998d5-f642-42f2-bad6-197b5ceb0bac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:35.899166 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:35.899129    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:35.899166 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:35.899166    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:35.899423 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:35.899129    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:35.899423 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:35.899269    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:35.899423 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:35.899362    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:35.899576 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:35.899433    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:37.899844 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:37.899806    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:37.900310 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:37.899904    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:37.900310 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:37.899920    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:37.900310 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:37.900049    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:37.900310 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:37.900125    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:37.900310 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:37.900223    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:39.902691 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:39.902341    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:39.903382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:39.902382    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:39.903382 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:39.902773    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:39.903382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:39.902385    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:39.903382 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:39.902832    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:39.903382 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:39.902898    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:40.011524 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.011486    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sd582" event={"ID":"dae8c662-dcf7-4c44-88bb-f4f5c9da695e","Type":"ContainerStarted","Data":"434404cf6a55ad729116012a53cbe4a58b97a577ecd89dbb58959ec675e08448"}
Jul 17 07:12:40.012866 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.012843    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rtjsd" event={"ID":"ab8d6a91-d06b-4095-a531-a470e2f000da","Type":"ContainerStarted","Data":"7438d43e5c5ce7e8256a5c38104e53a980ad7ec02c72e38d633d5a572dc9d014"}
Jul 17 07:12:40.014393 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.014370    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bdfrt" event={"ID":"6974ffb8-419f-47f6-a360-8fc41ea1ec30","Type":"ContainerStarted","Data":"e2d775ebde5cb184dcf47d49d8f4dfb0478a001a32ad3517fd26f38a508da639"}
Jul 17 07:12:40.016942 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.016919    2546 generic.go:356] "Generic (PLEG): container finished" podID="685350e6-1b5d-472b-b075-9593e40ae8b5" containerID="d69b08a0fa7f936b4fb2855bac555c4f385028efd01090bfa43d00c8d0ae33c4" exitCode=0
Jul 17 07:12:40.017015 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.016983    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2w2w" event={"ID":"685350e6-1b5d-472b-b075-9593e40ae8b5","Type":"ContainerDied","Data":"d69b08a0fa7f936b4fb2855bac555c4f385028efd01090bfa43d00c8d0ae33c4"}
Jul 17 07:12:40.018503 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.018479    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7" event={"ID":"1af5082a-b742-44c6-8ed0-700ae4dd117b","Type":"ContainerStarted","Data":"ab09b90fb71b9b1440355d3c208b8ea8029e64afa369ddd77dc63d648ee169e2"}
Jul 17 07:12:40.019982 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.019966    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8q2hw" event={"ID":"236f358b-1f12-4557-a344-79b8198771a6","Type":"ContainerStarted","Data":"fa1add347c84b650ed252536e5481f2130fd1bc584e09583164c4718ecfac695"}
Jul 17 07:12:40.022825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.022797    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz" event={"ID":"3b8d47e6-fd99-4fa7-9822-0e29f21e132c","Type":"ContainerStarted","Data":"0363b9a2ab3349f1a8fb9c560357564f5146eed7c57d7acfb4f395c4128518ef"}
Jul 17 07:12:40.022913 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.022893    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz" event={"ID":"3b8d47e6-fd99-4fa7-9822-0e29f21e132c","Type":"ContainerStarted","Data":"a277cf496d8e640d87f2ce4c3e64c8b097967e4186c1c0ad34bda51a0fdc1064"}
Jul 17 07:12:40.022963 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.022949    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz" event={"ID":"3b8d47e6-fd99-4fa7-9822-0e29f21e132c","Type":"ContainerStarted","Data":"c08acf1186fb91d045b4aeb7dc5b8a53380545b0091358120a7dbfaed626cb26"}
Jul 17 07:12:40.023035 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.023004    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz" event={"ID":"3b8d47e6-fd99-4fa7-9822-0e29f21e132c","Type":"ContainerStarted","Data":"6e954a59f362e4f3600d4712483f3248808a363b3b79a560fb188b488d37a1b0"}
Jul 17 07:12:40.023141 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.023054    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz" event={"ID":"3b8d47e6-fd99-4fa7-9822-0e29f21e132c","Type":"ContainerStarted","Data":"0bebc3e16bdc7f67bab796f56fd5786cf864fd5efcb805b8f4b42e540ea0042e"}
Jul 17 07:12:40.024259 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.024237    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gt85w" event={"ID":"2a32ad24-a73d-4805-a379-990aa9a4de37","Type":"ContainerStarted","Data":"e5c4a366584055fe440e62927fdeb3eb2707af92c3493bf63cc58548eea83a69"}
Jul 17 07:12:40.034397 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.034351    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sd582" podStartSLOduration=3.306078173 podStartE2EDuration="22.034338912s" totalImagesPullingTime="18.728260739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:12:40.033749008 +0000 UTC m=+22.839946184" watchObservedRunningTime="2026-07-17 07:12:40.034338912 +0000 UTC m=+22.840536087"
Jul 17 07:12:40.034505 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.034468    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-5.ec2.internal" podStartSLOduration=21.034463315 podStartE2EDuration="21.034463315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:12:22.997873219 +0000 UTC m=+5.804070395" watchObservedRunningTime="2026-07-17 07:12:40.034463315 +0000 UTC m=+22.840660489"
Jul 17 07:12:40.090604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.090541    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rtjsd" podStartSLOduration=11.547435256 podStartE2EDuration="22.090519595s" totalImagesPullingTime="10.543084339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:12:40.0900898 +0000 UTC m=+22.896286975" watchObservedRunningTime="2026-07-17 07:12:40.090519595 +0000 UTC m=+22.896716771"
Jul 17 07:12:40.113487 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.113418    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8q2hw" podStartSLOduration=3.328831018 podStartE2EDuration="22.113396012s" totalImagesPullingTime="18.784564994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:12:40.112559483 +0000 UTC m=+22.918756657" watchObservedRunningTime="2026-07-17 07:12:40.113396012 +0000 UTC m=+22.919593188"
Jul 17 07:12:40.134130 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.134078    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gt85w" podStartSLOduration=11.585527257 podStartE2EDuration="22.134061631s" totalImagesPullingTime="10.548534374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:12:40.133796862 +0000 UTC m=+22.939994037" watchObservedRunningTime="2026-07-17 07:12:40.134061631 +0000 UTC m=+22.940258806"
Jul 17 07:12:40.536463 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.536432    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:40.537138 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.537120    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:40.557822 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.557774    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bdfrt" podStartSLOduration=12.049760771 podStartE2EDuration="22.557758878s" totalImagesPullingTime="10.507998107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:12:40.151812003 +0000 UTC m=+22.958009179" watchObservedRunningTime="2026-07-17 07:12:40.557758878 +0000 UTC m=+23.363956054"
Jul 17 07:12:40.863459 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:40.863432    2546 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 07:12:41.028683 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.028628    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dvbtb" event={"ID":"041670b5-0c0b-4067-9abd-0147b2aafd06","Type":"ContainerStarted","Data":"372a21e26e05d12ef9317dcfb3c62f9a54139cc35069d4a8cd2204fec71928a8"}
Jul 17 07:12:41.030809 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.030782    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7" event={"ID":"1af5082a-b742-44c6-8ed0-700ae4dd117b","Type":"ContainerStarted","Data":"252b4efc33ba452cf724e76a22205236a0233c3cbcf81a1ec538d3a260077207"}
Jul 17 07:12:41.034177 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.034155    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz" event={"ID":"3b8d47e6-fd99-4fa7-9822-0e29f21e132c","Type":"ContainerStarted","Data":"a86dc94573da87a2009e78dd2b8db087222f96bcf2810376017ce5e6e1927265"}
Jul 17 07:12:41.049188 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.049142    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dvbtb" podStartSLOduration=12.511954719 podStartE2EDuration="23.049123627s" totalImagesPullingTime="10.537168908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:12:41.048974726 +0000 UTC m=+23.855171901" watchObservedRunningTime="2026-07-17 07:12:41.049123627 +0000 UTC m=+23.855320803"
Jul 17 07:12:41.266709 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.266652    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:41.267261 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.267229    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bdfrt"
Jul 17 07:12:41.772271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.772146    2546 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T07:12:40.86345141Z","UUID":"e3bc60d0-f93a-4466-8cf9-3d1030a0dd7f","Handler":null,"Name":"","Endpoint":""}
Jul 17 07:12:41.773869 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.773845    2546 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 07:12:41.774007 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.773892    2546 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 07:12:41.898418 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.898382    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:41.898564 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:41.898512    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:41.898564 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.898382    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:41.898564 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:41.898381    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:41.898705 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:41.898612    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:41.898747 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:41.898699    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:42.038678 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:42.038586    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7" event={"ID":"1af5082a-b742-44c6-8ed0-700ae4dd117b","Type":"ContainerStarted","Data":"883b1256b27964e440f22fa3d3c704a844562b6750e8ef951e7910a09b6161f9"}
Jul 17 07:12:43.044091 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:43.044051    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz" event={"ID":"3b8d47e6-fd99-4fa7-9822-0e29f21e132c","Type":"ContainerStarted","Data":"61c0bd8182ae07852650496efdc23b0de5bfa3551aa2498953062b15bb07df8e"}
Jul 17 07:12:43.899290 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:43.899258    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:43.899482 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:43.899305    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:43.899482 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:43.899412    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:43.899590 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:43.899489    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:43.899630 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:43.899599    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:43.899735 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:43.899700    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:45.899450 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:45.899276    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:45.900128 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:45.899276    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:45.900128 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:45.899542    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:45.900128 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:45.899333    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:45.900128 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:45.899604    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:45.900128 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:45.899718    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:46.054998 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:46.054963    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz" event={"ID":"3b8d47e6-fd99-4fa7-9822-0e29f21e132c","Type":"ContainerStarted","Data":"60e32ba30101dacca91f4d5f8a16a629a158cc91aa546abb2a224ddd927a25bb"}
Jul 17 07:12:46.055303 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:46.055276    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:46.057043 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:46.057019    2546 generic.go:356] "Generic (PLEG): container finished" podID="685350e6-1b5d-472b-b075-9593e40ae8b5" containerID="45048b995c7f9717535913167369c10159fd9a7ef83e89b36794ae355ba831ae" exitCode=0
Jul 17 07:12:46.057186 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:46.057046    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2w2w" event={"ID":"685350e6-1b5d-472b-b075-9593e40ae8b5","Type":"ContainerDied","Data":"45048b995c7f9717535913167369c10159fd9a7ef83e89b36794ae355ba831ae"}
Jul 17 07:12:46.071630 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:46.071601    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:46.084785 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:46.084748    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zzvn7" podStartSLOduration=15.457320381 podStartE2EDuration="28.084734672s" totalImagesPullingTime="12.627414291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:12:42.065218147 +0000 UTC m=+24.871415326" watchObservedRunningTime="2026-07-17 07:12:46.084734672 +0000 UTC m=+28.890931846"
Jul 17 07:12:46.084969 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:46.084952    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz" podStartSLOduration=9.282662076 podStartE2EDuration="28.084946449s" totalImagesPullingTime="18.802284373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:12:46.084523112 +0000 UTC m=+28.890720287" watchObservedRunningTime="2026-07-17 07:12:46.084946449 +0000 UTC m=+28.891143623"
Jul 17 07:12:47.059412 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:47.059379    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:47.059921 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:47.059509    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:47.075678 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:47.075637    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:12:47.899410 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:47.899324    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:47.899410 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:47.899398    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:47.899595 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:47.899412    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:47.899595 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:47.899507    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:47.899595 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:47.899540    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:47.899595 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:47.899594    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:48.063077 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:48.063046    2546 generic.go:356] "Generic (PLEG): container finished" podID="685350e6-1b5d-472b-b075-9593e40ae8b5" containerID="d8928fa22db2a35685db085a296a29f17616d9c63783206b652f06d0873232df" exitCode=0
Jul 17 07:12:48.063444 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:48.063103    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2w2w" event={"ID":"685350e6-1b5d-472b-b075-9593e40ae8b5","Type":"ContainerDied","Data":"d8928fa22db2a35685db085a296a29f17616d9c63783206b652f06d0873232df"}
Jul 17 07:12:49.899083 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:49.899051    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:49.899083 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:49.899067    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:49.899495 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:49.899054    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:49.899495 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:49.899150    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:49.899495 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:49.899226    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:49.899495 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:49.899293    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:50.068523 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:50.068492    2546 generic.go:356] "Generic (PLEG): container finished" podID="685350e6-1b5d-472b-b075-9593e40ae8b5" containerID="328daf305e38a3a3f65cb06bbd4d8330283860c8ced756ed15b7830dd63c5dc5" exitCode=0
Jul 17 07:12:50.068706 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:50.068546    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2w2w" event={"ID":"685350e6-1b5d-472b-b075-9593e40ae8b5","Type":"ContainerDied","Data":"328daf305e38a3a3f65cb06bbd4d8330283860c8ced756ed15b7830dd63c5dc5"}
Jul 17 07:12:51.433546 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:51.433510    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:51.433546 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:51.433560    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:51.434097 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:51.433690    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:51.434097 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:51.433717    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:51.434097 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:51.433767    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs podName:8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222 nodeName:}" failed. No retries permitted until 2026-07-17 07:13:23.433747744 +0000 UTC m=+66.239944903 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs") pod "network-metrics-daemon-gnkns" (UID: "8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 07:12:51.434097 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:51.433786    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret podName:018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e nodeName:}" failed. No retries permitted until 2026-07-17 07:13:23.43377649 +0000 UTC m=+66.239973647 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret") pod "global-pull-secret-syncer-l8rd7" (UID: "018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 07:12:51.534485 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:51.534448    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwkg\" (UniqueName: \"kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg\") pod \"network-check-target-kg768\" (UID: \"d66998d5-f642-42f2-bad6-197b5ceb0bac\") " pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:51.534649 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:51.534584    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 07:12:51.534649 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:51.534599    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 07:12:51.534649 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:51.534608    2546 projected.go:196] Error preparing data for projected volume kube-api-access-bdwkg for pod openshift-network-diagnostics/network-check-target-kg768: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:51.534801 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:51.534654    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg podName:d66998d5-f642-42f2-bad6-197b5ceb0bac nodeName:}" failed. No retries permitted until 2026-07-17 07:13:23.534640822 +0000 UTC m=+66.340837976 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdwkg" (UniqueName: "kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg") pod "network-check-target-kg768" (UID: "d66998d5-f642-42f2-bad6-197b5ceb0bac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 07:12:51.898838 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:51.898801    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:51.899025 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:51.898808    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:51.899025 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:51.898932    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:51.899025 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:51.898805    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:51.899182 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:51.899035    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:51.899182 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:51.899091    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:53.269154 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:53.268935    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l8rd7"]
Jul 17 07:12:53.269527 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:53.269262    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:53.269527 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:53.269370    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:53.272686 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:53.272639    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gnkns"]
Jul 17 07:12:53.272794 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:53.272721    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kg768"]
Jul 17 07:12:53.272832 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:53.272803    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:53.272917 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:53.272897    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:53.272984 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:53.272970    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:53.273074 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:53.273057    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:54.898343 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:54.898283    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:54.898343 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:54.898330    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:54.898861 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:54.898329    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:54.898861 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:54.898423    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:54.898861 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:54.898488    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:54.898861 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:54.898579    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:56.083788 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:56.083753    2546 generic.go:356] "Generic (PLEG): container finished" podID="685350e6-1b5d-472b-b075-9593e40ae8b5" containerID="90878a10ab899577de022dbdb81a33f2fdd404145511fcc4e3e8bc62cb626bd6" exitCode=0
Jul 17 07:12:56.084461 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:56.083819    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2w2w" event={"ID":"685350e6-1b5d-472b-b075-9593e40ae8b5","Type":"ContainerDied","Data":"90878a10ab899577de022dbdb81a33f2fdd404145511fcc4e3e8bc62cb626bd6"}
Jul 17 07:12:56.898370 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:56.898332    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:56.898553 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:56.898377    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:56.898553 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:56.898332    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:56.898553 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:56.898450    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l8rd7" podUID="018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e"
Jul 17 07:12:56.898553 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:56.898514    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnkns" podUID="8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222"
Jul 17 07:12:56.898719 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:12:56.898559    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg768" podUID="d66998d5-f642-42f2-bad6-197b5ceb0bac"
Jul 17 07:12:57.088565 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.088536    2546 generic.go:356] "Generic (PLEG): container finished" podID="685350e6-1b5d-472b-b075-9593e40ae8b5" containerID="0c9b69403ba9aa6cc9090fe5c45603472c1bf17d2e224d1d17333ea433819972" exitCode=0
Jul 17 07:12:57.089028 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.088587    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2w2w" event={"ID":"685350e6-1b5d-472b-b075-9593e40ae8b5","Type":"ContainerDied","Data":"0c9b69403ba9aa6cc9090fe5c45603472c1bf17d2e224d1d17333ea433819972"}
Jul 17 07:12:57.489143 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.489065    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-5.ec2.internal" event="NodeReady"
Jul 17 07:12:57.489285 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.489168    2546 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 07:12:57.561159 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.561126    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c2p6j"]
Jul 17 07:12:57.582189 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.582160    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-66xpt"]
Jul 17 07:12:57.582341 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.582286    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.584503 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.584470    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 07:12:57.584503 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.584503    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kjdqb\""
Jul 17 07:12:57.584716 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.584548    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 07:12:57.602323 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.602300    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c2p6j"]
Jul 17 07:12:57.602323 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.602333    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-66xpt"]
Jul 17 07:12:57.602521 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.602440    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.604790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.604762    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 07:12:57.604934 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.604769    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 07:12:57.604934 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.604904    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 07:12:57.604934 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.604931    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gcxnf\""
Jul 17 07:12:57.605219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.605204    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 07:12:57.662212 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.662173    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qbzsx"]
Jul 17 07:12:57.684128 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.684098    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34f4bb5b-d587-46a9-9296-d548428394a7-metrics-tls\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.684268 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.684133    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-544ln\" (UniqueName: \"kubernetes.io/projected/34f4bb5b-d587-46a9-9296-d548428394a7-kube-api-access-544ln\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.684268 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.684207    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34f4bb5b-d587-46a9-9296-d548428394a7-config-volume\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.684268 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.684244    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34f4bb5b-d587-46a9-9296-d548428394a7-tmp-dir\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.684384 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.684329    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qbzsx"]
Jul 17 07:12:57.684423 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.684411    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qbzsx"
Jul 17 07:12:57.687002 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.686982    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 07:12:57.687136 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.687121    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 07:12:57.687229 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.687204    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 07:12:57.687299 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.687213    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z4klw\""
Jul 17 07:12:57.785273 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785244    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2525926-7a6e-4463-b5a9-30dd75d433f5-data-volume\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.785273 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785275    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2525926-7a6e-4463-b5a9-30dd75d433f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.785506 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785312    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34f4bb5b-d587-46a9-9296-d548428394a7-metrics-tls\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.785506 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785336    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2525926-7a6e-4463-b5a9-30dd75d433f5-crio-socket\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.785506 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785353    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-544ln\" (UniqueName: \"kubernetes.io/projected/34f4bb5b-d587-46a9-9296-d548428394a7-kube-api-access-544ln\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.785506 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785373    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7fdl\" (UniqueName: \"kubernetes.io/projected/f7ca342e-6272-492c-bb62-7e3b0879a07a-kube-api-access-f7fdl\") pod \"ingress-canary-qbzsx\" (UID: \"f7ca342e-6272-492c-bb62-7e3b0879a07a\") " pod="openshift-ingress-canary/ingress-canary-qbzsx"
Jul 17 07:12:57.785506 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785393    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xx68\" (UniqueName: \"kubernetes.io/projected/f2525926-7a6e-4463-b5a9-30dd75d433f5-kube-api-access-4xx68\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.785506 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785468    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2525926-7a6e-4463-b5a9-30dd75d433f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.785506 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785508    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34f4bb5b-d587-46a9-9296-d548428394a7-config-volume\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.785845 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785531    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34f4bb5b-d587-46a9-9296-d548428394a7-tmp-dir\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.785845 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785557    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7ca342e-6272-492c-bb62-7e3b0879a07a-cert\") pod \"ingress-canary-qbzsx\" (UID: \"f7ca342e-6272-492c-bb62-7e3b0879a07a\") " pod="openshift-ingress-canary/ingress-canary-qbzsx"
Jul 17 07:12:57.785934 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.785902    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34f4bb5b-d587-46a9-9296-d548428394a7-tmp-dir\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.786112 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.786094    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34f4bb5b-d587-46a9-9296-d548428394a7-config-volume\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.789415 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.789393    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34f4bb5b-d587-46a9-9296-d548428394a7-metrics-tls\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.793769 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.793750    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-544ln\" (UniqueName: \"kubernetes.io/projected/34f4bb5b-d587-46a9-9296-d548428394a7-kube-api-access-544ln\") pod \"dns-default-c2p6j\" (UID: \"34f4bb5b-d587-46a9-9296-d548428394a7\") " pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.886352 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.886308    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2525926-7a6e-4463-b5a9-30dd75d433f5-data-volume\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.886352 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.886346    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2525926-7a6e-4463-b5a9-30dd75d433f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.886613 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.886375    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2525926-7a6e-4463-b5a9-30dd75d433f5-crio-socket\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.886613 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.886494    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7fdl\" (UniqueName: \"kubernetes.io/projected/f7ca342e-6272-492c-bb62-7e3b0879a07a-kube-api-access-f7fdl\") pod \"ingress-canary-qbzsx\" (UID: \"f7ca342e-6272-492c-bb62-7e3b0879a07a\") " pod="openshift-ingress-canary/ingress-canary-qbzsx"
Jul 17 07:12:57.886613 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.886525    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2525926-7a6e-4463-b5a9-30dd75d433f5-crio-socket\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.886613 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.886529    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xx68\" (UniqueName: \"kubernetes.io/projected/f2525926-7a6e-4463-b5a9-30dd75d433f5-kube-api-access-4xx68\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.886613 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.886581    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2525926-7a6e-4463-b5a9-30dd75d433f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.886613 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.886613    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7ca342e-6272-492c-bb62-7e3b0879a07a-cert\") pod \"ingress-canary-qbzsx\" (UID: \"f7ca342e-6272-492c-bb62-7e3b0879a07a\") " pod="openshift-ingress-canary/ingress-canary-qbzsx"
Jul 17 07:12:57.886900 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.886751    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2525926-7a6e-4463-b5a9-30dd75d433f5-data-volume\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.886948 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.886898    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2525926-7a6e-4463-b5a9-30dd75d433f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.888881 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.888858    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2525926-7a6e-4463-b5a9-30dd75d433f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.889063 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.889048    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7ca342e-6272-492c-bb62-7e3b0879a07a-cert\") pod \"ingress-canary-qbzsx\" (UID: \"f7ca342e-6272-492c-bb62-7e3b0879a07a\") " pod="openshift-ingress-canary/ingress-canary-qbzsx"
Jul 17 07:12:57.891934 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.891919    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:12:57.894974 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.894951    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xx68\" (UniqueName: \"kubernetes.io/projected/f2525926-7a6e-4463-b5a9-30dd75d433f5-kube-api-access-4xx68\") pod \"insights-runtime-extractor-66xpt\" (UID: \"f2525926-7a6e-4463-b5a9-30dd75d433f5\") " pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.895068 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.895045    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7fdl\" (UniqueName: \"kubernetes.io/projected/f7ca342e-6272-492c-bb62-7e3b0879a07a-kube-api-access-f7fdl\") pod \"ingress-canary-qbzsx\" (UID: \"f7ca342e-6272-492c-bb62-7e3b0879a07a\") " pod="openshift-ingress-canary/ingress-canary-qbzsx"
Jul 17 07:12:57.910082 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.910060    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-66xpt"
Jul 17 07:12:57.992931 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:57.992896    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qbzsx"
Jul 17 07:12:58.096298 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.096088    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t2w2w" event={"ID":"685350e6-1b5d-472b-b075-9593e40ae8b5","Type":"ContainerStarted","Data":"979681b7cf5c31fc65bb98b949b0fc1dbb86faf06ddf9ea3a2a007c1c0cb9f6a"}
Jul 17 07:12:58.107183 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.107153    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c2p6j"]
Jul 17 07:12:58.112294 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:58.112272    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f4bb5b_d587_46a9_9296_d548428394a7.slice/crio-b314f12b113f20f7ebf09438484096f16a33c9e8effe9816f77c10e5aded4ded WatchSource:0}: Error finding container b314f12b113f20f7ebf09438484096f16a33c9e8effe9816f77c10e5aded4ded: Status 404 returned error can't find the container with id b314f12b113f20f7ebf09438484096f16a33c9e8effe9816f77c10e5aded4ded
Jul 17 07:12:58.120475 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.120421    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t2w2w" podStartSLOduration=16.336912982 podStartE2EDuration="40.120400851s" totalImagesPullingTime="23.783487869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:12:58.119529754 +0000 UTC m=+40.925726932" watchObservedRunningTime="2026-07-17 07:12:58.120400851 +0000 UTC m=+40.926598023"
Jul 17 07:12:58.123152 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.123130    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-66xpt"]
Jul 17 07:12:58.139731 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:58.139697    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2525926_7a6e_4463_b5a9_30dd75d433f5.slice/crio-360f35971ebb824635b3a1922b625169cd6afe7681ae68cadb33bd06874b3c3e WatchSource:0}: Error finding container 360f35971ebb824635b3a1922b625169cd6afe7681ae68cadb33bd06874b3c3e: Status 404 returned error can't find the container with id 360f35971ebb824635b3a1922b625169cd6afe7681ae68cadb33bd06874b3c3e
Jul 17 07:12:58.185452 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.185421    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qbzsx"]
Jul 17 07:12:58.188500 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:12:58.188462    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ca342e_6272_492c_bb62_7e3b0879a07a.slice/crio-83b96b2d6c1be9b0b230486166b7cda7d93431469e6fa05a4195f162e7b6e2e3 WatchSource:0}: Error finding container 83b96b2d6c1be9b0b230486166b7cda7d93431469e6fa05a4195f162e7b6e2e3: Status 404 returned error can't find the container with id 83b96b2d6c1be9b0b230486166b7cda7d93431469e6fa05a4195f162e7b6e2e3
Jul 17 07:12:58.898445 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.898406    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:12:58.898990 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.898972    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:12:58.901204 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.899552    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:12:58.906073 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.906043    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 07:12:58.907993 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.907964    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c28tv\""
Jul 17 07:12:58.909696 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.908595    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 07:12:58.909696 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.909381    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 07:12:58.911168 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.911147    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 07:12:58.933184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:58.932797    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4jgz\""
Jul 17 07:12:59.104215 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:59.104173    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qbzsx" event={"ID":"f7ca342e-6272-492c-bb62-7e3b0879a07a","Type":"ContainerStarted","Data":"83b96b2d6c1be9b0b230486166b7cda7d93431469e6fa05a4195f162e7b6e2e3"}
Jul 17 07:12:59.108983 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:59.108946    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66xpt" event={"ID":"f2525926-7a6e-4463-b5a9-30dd75d433f5","Type":"ContainerStarted","Data":"360f35971ebb824635b3a1922b625169cd6afe7681ae68cadb33bd06874b3c3e"}
Jul 17 07:12:59.112139 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:12:59.112074    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c2p6j" event={"ID":"34f4bb5b-d587-46a9-9296-d548428394a7","Type":"ContainerStarted","Data":"b314f12b113f20f7ebf09438484096f16a33c9e8effe9816f77c10e5aded4ded"}
Jul 17 07:13:02.634381 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.634347    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"]
Jul 17 07:13:02.745695 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.745652    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"]
Jul 17 07:13:02.745867 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.745788    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.748711 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.748681    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 17 07:13:02.749481 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.749457    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 17 07:13:02.749588 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.749457    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 07:13:02.749687 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.749645    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 07:13:02.749816 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.749796    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 07:13:02.749991 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.749893    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fwb7t\""
Jul 17 07:13:02.821057 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.821014    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmvt6\" (UniqueName: \"kubernetes.io/projected/5ba0208a-ce1c-4390-b578-14813da0f6e0-kube-api-access-lmvt6\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.821249 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.821064    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ba0208a-ce1c-4390-b578-14813da0f6e0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.821249 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.821149    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ba0208a-ce1c-4390-b578-14813da0f6e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.821249 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.821176    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ba0208a-ce1c-4390-b578-14813da0f6e0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.921878 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.921798    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ba0208a-ce1c-4390-b578-14813da0f6e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.921878 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.921841    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ba0208a-ce1c-4390-b578-14813da0f6e0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.922096 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.921899    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmvt6\" (UniqueName: \"kubernetes.io/projected/5ba0208a-ce1c-4390-b578-14813da0f6e0-kube-api-access-lmvt6\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.922096 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.921930    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ba0208a-ce1c-4390-b578-14813da0f6e0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.922696 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.922653    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ba0208a-ce1c-4390-b578-14813da0f6e0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.924576 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.924554    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ba0208a-ce1c-4390-b578-14813da0f6e0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.924763 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.924737    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ba0208a-ce1c-4390-b578-14813da0f6e0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:02.931220 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:02.931193    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmvt6\" (UniqueName: \"kubernetes.io/projected/5ba0208a-ce1c-4390-b578-14813da0f6e0-kube-api-access-lmvt6\") pod \"prometheus-operator-5945b5cfd-49qx6\" (UID: \"5ba0208a-ce1c-4390-b578-14813da0f6e0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:03.056702 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.056652    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"
Jul 17 07:13:03.794423 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.794383    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b94c4bccb-82dkr"]
Jul 17 07:13:03.810784 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.810755    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b94c4bccb-82dkr"]
Jul 17 07:13:03.810919 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.810843    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.814310 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.814248    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 07:13:03.814310 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.814296    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 07:13:03.815284 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.815138    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fgp5z\""
Jul 17 07:13:03.815284 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.815137    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 07:13:03.815284 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.815194    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 07:13:03.815284 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.815231    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 07:13:03.815543 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.815374    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 07:13:03.815543 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.815446    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 07:13:03.822364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.822343    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 17 07:13:03.830656 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.830638    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-config\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.830758 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.830679    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-oauth-config\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.830758 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.830702    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-serving-cert\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.830758 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.830718    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-trusted-ca-bundle\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.830922 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.830794    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpq44\" (UniqueName: \"kubernetes.io/projected/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-kube-api-access-gpq44\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.830922 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.830866    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-oauth-serving-cert\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.830922 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.830913    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-service-ca\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.931980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.931949    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpq44\" (UniqueName: \"kubernetes.io/projected/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-kube-api-access-gpq44\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.932153 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.932003    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-oauth-serving-cert\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.932153 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.932033    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-service-ca\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.932153 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.932078    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-config\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.932153 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.932108    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-oauth-config\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.932153 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.932145    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-serving-cert\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.932397 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.932171    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-trusted-ca-bundle\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.932874 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.932841    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-oauth-serving-cert\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.932992 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.932928    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-trusted-ca-bundle\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.933305 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.933286    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-config\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.933392 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.933372    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-service-ca\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.935140 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.935116    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-serving-cert\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.935358 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.935340    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-oauth-config\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:03.941868 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:03.941844    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpq44\" (UniqueName: \"kubernetes.io/projected/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-kube-api-access-gpq44\") pod \"console-5b94c4bccb-82dkr\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") " pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:04.124699 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:04.124571    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:04.842593 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:04.842514    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-49qx6"]
Jul 17 07:13:04.846221 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:04.846197    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba0208a_ce1c_4390_b578_14813da0f6e0.slice/crio-031dbeab77360e8bd43449843ec6058134fb021e763a81f8b190cd4d2d50c38d WatchSource:0}: Error finding container 031dbeab77360e8bd43449843ec6058134fb021e763a81f8b190cd4d2d50c38d: Status 404 returned error can't find the container with id 031dbeab77360e8bd43449843ec6058134fb021e763a81f8b190cd4d2d50c38d
Jul 17 07:13:04.863457 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:04.863402    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b94c4bccb-82dkr"]
Jul 17 07:13:04.978648 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:04.978580    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc360db2a_fdf8_4817_a5a5_5b65495b5fb0.slice/crio-d71b1049c2a04e33a4e0116d727bae7470495f1c16c972343207f090d43112b6 WatchSource:0}: Error finding container d71b1049c2a04e33a4e0116d727bae7470495f1c16c972343207f090d43112b6: Status 404 returned error can't find the container with id d71b1049c2a04e33a4e0116d727bae7470495f1c16c972343207f090d43112b6
Jul 17 07:13:05.132184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:05.132155    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c2p6j" event={"ID":"34f4bb5b-d587-46a9-9296-d548428394a7","Type":"ContainerStarted","Data":"d5c4fb5d7a843cf716b3db011700679f0b9b18531641c7d4d938285586829158"}
Jul 17 07:13:05.132317 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:05.132225    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c2p6j" event={"ID":"34f4bb5b-d587-46a9-9296-d548428394a7","Type":"ContainerStarted","Data":"6f7489d8351b39a390e68d62a7a99632b1635669e546f81eb242b1d7eaf3642a"}
Jul 17 07:13:05.133891 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:05.133863    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66xpt" event={"ID":"f2525926-7a6e-4463-b5a9-30dd75d433f5","Type":"ContainerStarted","Data":"1593779f84c90adb55c10fbba211ffe2e04def88c1e61f564f7821ca05248833"}
Jul 17 07:13:05.135205 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:05.135187    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b94c4bccb-82dkr" event={"ID":"c360db2a-fdf8-4817-a5a5-5b65495b5fb0","Type":"ContainerStarted","Data":"d71b1049c2a04e33a4e0116d727bae7470495f1c16c972343207f090d43112b6"}
Jul 17 07:13:05.136694 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:05.136656    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6" event={"ID":"5ba0208a-ce1c-4390-b578-14813da0f6e0","Type":"ContainerStarted","Data":"031dbeab77360e8bd43449843ec6058134fb021e763a81f8b190cd4d2d50c38d"}
Jul 17 07:13:05.138492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:05.138470    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qbzsx" event={"ID":"f7ca342e-6272-492c-bb62-7e3b0879a07a","Type":"ContainerStarted","Data":"209cb09b0278616041826c4665798caaf5a56eb6a7a55f95e02f5cd912cf139f"}
Jul 17 07:13:05.154734 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:05.154686    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qbzsx" podStartSLOduration=1.6466657279999999 podStartE2EDuration="8.154649987s" totalImagesPullingTime="6.507984259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:05.154583752 +0000 UTC m=+47.960780927" watchObservedRunningTime="2026-07-17 07:13:05.154649987 +0000 UTC m=+47.960847185"
Jul 17 07:13:06.164686 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:06.164332    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c2p6j" podStartSLOduration=3.426763951 podStartE2EDuration="9.164313149s" totalImagesPullingTime="5.737549198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:06.162623194 +0000 UTC m=+48.968820370" watchObservedRunningTime="2026-07-17 07:13:06.164313149 +0000 UTC m=+48.970510326"
Jul 17 07:13:07.144013 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:07.143983    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:13:12.160025 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:12.159982    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66xpt" event={"ID":"f2525926-7a6e-4463-b5a9-30dd75d433f5","Type":"ContainerStarted","Data":"1575dea5cb8b7e072c55501baa2d0ea17c89bf14e8b710873fc37d24d7c0df43"}
Jul 17 07:13:12.161713 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:12.161684    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b94c4bccb-82dkr" event={"ID":"c360db2a-fdf8-4817-a5a5-5b65495b5fb0","Type":"ContainerStarted","Data":"d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18"}
Jul 17 07:13:12.163717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:12.163656    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6" event={"ID":"5ba0208a-ce1c-4390-b578-14813da0f6e0","Type":"ContainerStarted","Data":"480874272d72f4feb476c8189315eeb15e04c68cb016ee45f46e48000fd8bf2e"}
Jul 17 07:13:12.163829 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:12.163735    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6" event={"ID":"5ba0208a-ce1c-4390-b578-14813da0f6e0","Type":"ContainerStarted","Data":"f6272df0310644277125fb23921075355faff2938ff7e2e52ca4619b632824eb"}
Jul 17 07:13:12.179888 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:12.179843    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b94c4bccb-82dkr" podStartSLOduration=3.064296696 podStartE2EDuration="9.179826349s" totalImagesPullingTime="6.115529653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:12.179714324 +0000 UTC m=+54.985911499" watchObservedRunningTime="2026-07-17 07:13:12.179826349 +0000 UTC m=+54.986023525"
Jul 17 07:13:12.195982 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:12.195936    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-49qx6" podStartSLOduration=3.936390618 podStartE2EDuration="10.195921881s" totalImagesPullingTime="6.259531263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:12.194963037 +0000 UTC m=+55.001160212" watchObservedRunningTime="2026-07-17 07:13:12.195921881 +0000 UTC m=+55.002119034"
Jul 17 07:13:14.125595 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:14.125559    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:14.126220 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:14.125620    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:14.131409 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:14.131381    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:14.148892 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:14.148863    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c2p6j"
Jul 17 07:13:14.177343 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:14.177315    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:13:15.177880 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:15.177784    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-66xpt" event={"ID":"f2525926-7a6e-4463-b5a9-30dd75d433f5","Type":"ContainerStarted","Data":"62a6aaacf1df6d143e4510141388d1abebbeaffc5aed58635a3e93087e81c7d8"}
Jul 17 07:13:15.198619 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:15.198567    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-66xpt" podStartSLOduration=1.634375632 podStartE2EDuration="18.198552679s" totalImagesPullingTime="16.564177047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:15.197303963 +0000 UTC m=+58.003501138" watchObservedRunningTime="2026-07-17 07:13:15.198552679 +0000 UTC m=+58.004749854"
Jul 17 07:13:18.166039 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.166005    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"]
Jul 17 07:13:18.193015 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.192984    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"]
Jul 17 07:13:18.193221 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.193148    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.195719 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.195699    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xq7pb\""
Jul 17 07:13:18.195840 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.195814    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 17 07:13:18.196647 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.196631    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 17 07:13:18.250916 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.250883    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11b501f2-5df3-4d59-9ab5-d1b213678d9c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.251061 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.250950    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11b501f2-5df3-4d59-9ab5-d1b213678d9c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.251061 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.251035    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11b501f2-5df3-4d59-9ab5-d1b213678d9c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.251148 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.251064    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94wkm\" (UniqueName: \"kubernetes.io/projected/11b501f2-5df3-4d59-9ab5-d1b213678d9c-kube-api-access-94wkm\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.334584 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.334550    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"]
Jul 17 07:13:18.351622 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.351587    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11b501f2-5df3-4d59-9ab5-d1b213678d9c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.351622 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.351623    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94wkm\" (UniqueName: \"kubernetes.io/projected/11b501f2-5df3-4d59-9ab5-d1b213678d9c-kube-api-access-94wkm\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.351865 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.351648    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11b501f2-5df3-4d59-9ab5-d1b213678d9c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.351865 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.351715    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11b501f2-5df3-4d59-9ab5-d1b213678d9c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.352500 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.352475    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11b501f2-5df3-4d59-9ab5-d1b213678d9c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.354189 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.354168    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11b501f2-5df3-4d59-9ab5-d1b213678d9c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.354287 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.354245    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11b501f2-5df3-4d59-9ab5-d1b213678d9c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.356101 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.356087    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p9hj7"]
Jul 17 07:13:18.356241 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.356223    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.358930 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.358911    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 17 07:13:18.359182 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.359161    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xh4h2\""
Jul 17 07:13:18.359534 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.359514    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 17 07:13:18.360245 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.360220    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 17 07:13:18.370190 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.370163    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94wkm\" (UniqueName: \"kubernetes.io/projected/11b501f2-5df3-4d59-9ab5-d1b213678d9c-kube-api-access-94wkm\") pod \"openshift-state-metrics-79f6958cdf-jt6w7\" (UID: \"11b501f2-5df3-4d59-9ab5-d1b213678d9c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.378040 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.378021    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"]
Jul 17 07:13:18.378136 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.378117    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.381298 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.381277    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g952c\""
Jul 17 07:13:18.381400 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.381315    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 07:13:18.381458 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.381428    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 07:13:18.381996 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.381976    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 07:13:18.452931 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.452836    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79d4m\" (UniqueName: \"kubernetes.io/projected/a1502a15-f7bc-4ca7-a188-77f5e5874acc-kube-api-access-79d4m\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.452931 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.452892    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.453163 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.452968    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-textfile\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.453163 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453011    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.453163 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453053    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.453163 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453083    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.453163 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453106    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.453163 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453144    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.453419 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453180    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-wtmp\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.453419 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453209    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-tls\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.453419 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453224    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1502a15-f7bc-4ca7-a188-77f5e5874acc-metrics-client-ca\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.453419 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453241    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q8kj\" (UniqueName: \"kubernetes.io/projected/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-api-access-2q8kj\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.453419 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453278    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.453419 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453293    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1502a15-f7bc-4ca7-a188-77f5e5874acc-sys\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.453419 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.453307    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1502a15-f7bc-4ca7-a188-77f5e5874acc-root\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.503719 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.503690    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"
Jul 17 07:13:18.554683 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.554640    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.554846 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.554691    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.554846 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.554807    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.554956 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.554857    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.554956 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.554912    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-wtmp\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.554956 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.554953    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-tls\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.555107 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.554977    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1502a15-f7bc-4ca7-a188-77f5e5874acc-metrics-client-ca\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.555162 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555116    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q8kj\" (UniqueName: \"kubernetes.io/projected/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-api-access-2q8kj\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.555221 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555185    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.555288 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555218    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1502a15-f7bc-4ca7-a188-77f5e5874acc-sys\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.555288 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555245    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1502a15-f7bc-4ca7-a188-77f5e5874acc-root\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.555392 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555284    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79d4m\" (UniqueName: \"kubernetes.io/projected/a1502a15-f7bc-4ca7-a188-77f5e5874acc-kube-api-access-79d4m\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.555392 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555343    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.555392 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555366    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-textfile\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.555549 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555399    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.555549 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555480    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.555549 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555480    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1502a15-f7bc-4ca7-a188-77f5e5874acc-sys\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.555716 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555554    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.555716 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555611    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-wtmp\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.556239 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.555905    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1502a15-f7bc-4ca7-a188-77f5e5874acc-root\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.556239 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.556047    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.556239 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.556102    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.556239 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.556182    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-textfile\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.556477 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.556256    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1502a15-f7bc-4ca7-a188-77f5e5874acc-metrics-client-ca\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.558134 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.558065    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.558134 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.558111    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.558311 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.558199    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.558472 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.558441    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1502a15-f7bc-4ca7-a188-77f5e5874acc-node-exporter-tls\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.564836 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.564815    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79d4m\" (UniqueName: \"kubernetes.io/projected/a1502a15-f7bc-4ca7-a188-77f5e5874acc-kube-api-access-79d4m\") pod \"node-exporter-p9hj7\" (UID: \"a1502a15-f7bc-4ca7-a188-77f5e5874acc\") " pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.564941 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.564909    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q8kj\" (UniqueName: \"kubernetes.io/projected/64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5-kube-api-access-2q8kj\") pod \"kube-state-metrics-56c5594674-qvmm2\" (UID: \"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.645436 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.645406    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7"]
Jul 17 07:13:18.648072 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:18.648043    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b501f2_5df3_4d59_9ab5_d1b213678d9c.slice/crio-720f38cecdd3aab03a1f6b16cce0922a6195fbcfc5918578641788adbd160a4b WatchSource:0}: Error finding container 720f38cecdd3aab03a1f6b16cce0922a6195fbcfc5918578641788adbd160a4b: Status 404 returned error can't find the container with id 720f38cecdd3aab03a1f6b16cce0922a6195fbcfc5918578641788adbd160a4b
Jul 17 07:13:18.677700 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.677640    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"
Jul 17 07:13:18.687008 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.686992    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p9hj7"
Jul 17 07:13:18.727996 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:18.727968    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1502a15_f7bc_4ca7_a188_77f5e5874acc.slice/crio-2c790efcaa0164f0aa0cdd29908cfd3d27b313bd4196b3cc8894573b573d79e3 WatchSource:0}: Error finding container 2c790efcaa0164f0aa0cdd29908cfd3d27b313bd4196b3cc8894573b573d79e3: Status 404 returned error can't find the container with id 2c790efcaa0164f0aa0cdd29908cfd3d27b313bd4196b3cc8894573b573d79e3
Jul 17 07:13:18.816539 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:18.816519    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-qvmm2"]
Jul 17 07:13:18.818743 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:18.818715    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f530dc_cdc1_4a3f_88e9_b1e95cc26fc5.slice/crio-29d4505e3e992e45165d634d18f994c58813d55fc1f71d5d83cd8b86a211c785 WatchSource:0}: Error finding container 29d4505e3e992e45165d634d18f994c58813d55fc1f71d5d83cd8b86a211c785: Status 404 returned error can't find the container with id 29d4505e3e992e45165d634d18f994c58813d55fc1f71d5d83cd8b86a211c785
Jul 17 07:13:19.085960 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.085934    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kl4bz"
Jul 17 07:13:19.190617 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.190582    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2" event={"ID":"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5","Type":"ContainerStarted","Data":"29d4505e3e992e45165d634d18f994c58813d55fc1f71d5d83cd8b86a211c785"}
Jul 17 07:13:19.192263 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.192238    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7" event={"ID":"11b501f2-5df3-4d59-9ab5-d1b213678d9c","Type":"ContainerStarted","Data":"df71e336df2a30faeecd256a679d123979af940630fdd3af06742b2be1ab1feb"}
Jul 17 07:13:19.192385 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.192281    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7" event={"ID":"11b501f2-5df3-4d59-9ab5-d1b213678d9c","Type":"ContainerStarted","Data":"0f58010b2280724a356226b3a97f5d830ca8a3beb662c214e6a6ff10cba71e12"}
Jul 17 07:13:19.192385 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.192300    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7" event={"ID":"11b501f2-5df3-4d59-9ab5-d1b213678d9c","Type":"ContainerStarted","Data":"720f38cecdd3aab03a1f6b16cce0922a6195fbcfc5918578641788adbd160a4b"}
Jul 17 07:13:19.193234 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.193216    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9hj7" event={"ID":"a1502a15-f7bc-4ca7-a188-77f5e5874acc","Type":"ContainerStarted","Data":"2c790efcaa0164f0aa0cdd29908cfd3d27b313bd4196b3cc8894573b573d79e3"}
Jul 17 07:13:19.351307 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.351212    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 07:13:19.364115 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.364082    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.367346 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.367311    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 07:13:19.368000 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.367976    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 07:13:19.368000 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.367996    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 07:13:19.368293 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.368267    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 07:13:19.368629 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.368614    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 07:13:19.368732 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.368631    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 07:13:19.368831 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.368812    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 07:13:19.368931 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.368838    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 07:13:19.368996 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.368944    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 07:13:19.368996 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.368953    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mrx89\""
Jul 17 07:13:19.373868 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.373848    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 07:13:19.463826 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.463767    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c55b7f7e-ce36-4b50-b810-337e07d9ae15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.463826 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.463816    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55b7f7e-ce36-4b50-b810-337e07d9ae15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.464184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.463871    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.464184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.463968    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c55b7f7e-ce36-4b50-b810-337e07d9ae15-config-out\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.464184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.464022    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-config-volume\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.464184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.464099    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.464184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.464128    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.464184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.464166    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh69b\" (UniqueName: \"kubernetes.io/projected/c55b7f7e-ce36-4b50-b810-337e07d9ae15-kube-api-access-jh69b\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.464500 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.464197    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c55b7f7e-ce36-4b50-b810-337e07d9ae15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.464500 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.464221    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.464500 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.464328    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.464500 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.464366    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c55b7f7e-ce36-4b50-b810-337e07d9ae15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.464500 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.464396    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-web-config\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.564994 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.564954    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565013    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c55b7f7e-ce36-4b50-b810-337e07d9ae15-config-out\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565047    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-config-volume\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565075    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565100    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565133    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh69b\" (UniqueName: \"kubernetes.io/projected/c55b7f7e-ce36-4b50-b810-337e07d9ae15-kube-api-access-jh69b\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565166    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c55b7f7e-ce36-4b50-b810-337e07d9ae15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565517 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565189    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565517 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565246    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565517 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565277    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c55b7f7e-ce36-4b50-b810-337e07d9ae15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565517 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565302    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-web-config\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565517 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565367    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c55b7f7e-ce36-4b50-b810-337e07d9ae15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.565517 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.565402    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55b7f7e-ce36-4b50-b810-337e07d9ae15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.566736 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.566533    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c55b7f7e-ce36-4b50-b810-337e07d9ae15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.566736 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.566655    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c55b7f7e-ce36-4b50-b810-337e07d9ae15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.566923 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:13:19.566786    2546 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 17 07:13:19.566923 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.566822    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c55b7f7e-ce36-4b50-b810-337e07d9ae15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.566923 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:13:19.566841    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-main-tls podName:c55b7f7e-ce36-4b50-b810-337e07d9ae15 nodeName:}" failed. No retries permitted until 2026-07-17 07:13:20.066824295 +0000 UTC m=+62.873021454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c55b7f7e-ce36-4b50-b810-337e07d9ae15") : secret "alertmanager-main-tls" not found
Jul 17 07:13:19.570074 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.569904    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-web-config\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.570074 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.570040    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c55b7f7e-ce36-4b50-b810-337e07d9ae15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.570074 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.570049    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.570505 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.570475    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c55b7f7e-ce36-4b50-b810-337e07d9ae15-config-out\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.570587 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.570541    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-config-volume\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.571009 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.570645    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.571594 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.571562    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.571953 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.571918    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:19.579546 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:19.579521    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh69b\" (UniqueName: \"kubernetes.io/projected/c55b7f7e-ce36-4b50-b810-337e07d9ae15-kube-api-access-jh69b\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:20.069641 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.069607    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:20.072526 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.072483    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c55b7f7e-ce36-4b50-b810-337e07d9ae15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c55b7f7e-ce36-4b50-b810-337e07d9ae15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:20.255699 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.255646    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-849864688f-g7zn9"]
Jul 17 07:13:20.258448 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.258428    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.260959 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.260924    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 17 07:13:20.261090 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.260991    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 17 07:13:20.261090 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.261008    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ber831c50rlrc\""
Jul 17 07:13:20.261090 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.261020    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 17 07:13:20.261090 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.261054    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 17 07:13:20.261444 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.261424    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-d9n7k\""
Jul 17 07:13:20.261794 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.261772    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 17 07:13:20.274233 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.274211    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-849864688f-g7zn9"]
Jul 17 07:13:20.286684 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.286641    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 07:13:20.372904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.372818    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.372904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.372874    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-tls\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.373123 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.372905    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tbv4\" (UniqueName: \"kubernetes.io/projected/13213d21-c20c-45eb-916f-53505037c9a1-kube-api-access-4tbv4\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.373123 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.372993    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13213d21-c20c-45eb-916f-53505037c9a1-metrics-client-ca\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.373123 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.373066    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.373123 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.373093    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.373123 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.373118    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-grpc-tls\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.373316 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.373205    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.473624 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.473596    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.473718 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.473638    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.473718 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.473689    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-tls\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.473718 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.473708    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tbv4\" (UniqueName: \"kubernetes.io/projected/13213d21-c20c-45eb-916f-53505037c9a1-kube-api-access-4tbv4\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.473857 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.473745    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13213d21-c20c-45eb-916f-53505037c9a1-metrics-client-ca\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.473952 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.473927    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.474021 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.473970    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.474021 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.473999    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-grpc-tls\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.474583 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.474555    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13213d21-c20c-45eb-916f-53505037c9a1-metrics-client-ca\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.476791 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.476735    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-tls\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.476901 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.476826    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.476901 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.476858    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-grpc-tls\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.476901 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.476860    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.477133 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.477112    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.477223 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.477200    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/13213d21-c20c-45eb-916f-53505037c9a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.482981 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.482956    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tbv4\" (UniqueName: \"kubernetes.io/projected/13213d21-c20c-45eb-916f-53505037c9a1-kube-api-access-4tbv4\") pod \"thanos-querier-849864688f-g7zn9\" (UID: \"13213d21-c20c-45eb-916f-53505037c9a1\") " pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.569323 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.569101    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:20.644065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.643963    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 07:13:20.653045 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:20.652947    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55b7f7e_ce36_4b50_b810_337e07d9ae15.slice/crio-cde9974d51052d287cd2fee25aea4dc48034ec38470dd3688a767342fbec3718 WatchSource:0}: Error finding container cde9974d51052d287cd2fee25aea4dc48034ec38470dd3688a767342fbec3718: Status 404 returned error can't find the container with id cde9974d51052d287cd2fee25aea4dc48034ec38470dd3688a767342fbec3718
Jul 17 07:13:20.749918 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:20.749880    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-849864688f-g7zn9"]
Jul 17 07:13:20.754661 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:20.754631    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13213d21_c20c_45eb_916f_53505037c9a1.slice/crio-c88dd841bf218bd4cbfec5faea59d788ae3287ff3c5ae1120005babf5e4e8cdd WatchSource:0}: Error finding container c88dd841bf218bd4cbfec5faea59d788ae3287ff3c5ae1120005babf5e4e8cdd: Status 404 returned error can't find the container with id c88dd841bf218bd4cbfec5faea59d788ae3287ff3c5ae1120005babf5e4e8cdd
Jul 17 07:13:21.202125 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:21.202085    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2" event={"ID":"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5","Type":"ContainerStarted","Data":"ffd7b53c4df9e3e04575f4efcb8731994a00ca0ea5e20f812cf2eeb46c1dfdca"}
Jul 17 07:13:21.202300 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:21.202144    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2" event={"ID":"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5","Type":"ContainerStarted","Data":"4f77276c7e8d2c2597e215f4c79bb79621aa6e71e3870f61a25799196e4d9689"}
Jul 17 07:13:21.202300 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:21.202168    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2" event={"ID":"64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5","Type":"ContainerStarted","Data":"b1e100e0803d5ae8a67af18512db2e0f69203a58ebc0da239156f3108ae56a09"}
Jul 17 07:13:21.204130 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:21.204107    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7" event={"ID":"11b501f2-5df3-4d59-9ab5-d1b213678d9c","Type":"ContainerStarted","Data":"350648a4c0e15367c60f6d95389229e828ff272e740f23fa01974e0926adda32"}
Jul 17 07:13:21.205211 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:21.205190    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9" event={"ID":"13213d21-c20c-45eb-916f-53505037c9a1","Type":"ContainerStarted","Data":"c88dd841bf218bd4cbfec5faea59d788ae3287ff3c5ae1120005babf5e4e8cdd"}
Jul 17 07:13:21.206746 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:21.206721    2546 generic.go:356] "Generic (PLEG): container finished" podID="a1502a15-f7bc-4ca7-a188-77f5e5874acc" containerID="223d24d180fea906178d8e7e5b5410eef83c553aeac7312295b184541bfbd5a4" exitCode=0
Jul 17 07:13:21.206841 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:21.206790    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9hj7" event={"ID":"a1502a15-f7bc-4ca7-a188-77f5e5874acc","Type":"ContainerDied","Data":"223d24d180fea906178d8e7e5b5410eef83c553aeac7312295b184541bfbd5a4"}
Jul 17 07:13:21.207942 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:21.207919    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c55b7f7e-ce36-4b50-b810-337e07d9ae15","Type":"ContainerStarted","Data":"cde9974d51052d287cd2fee25aea4dc48034ec38470dd3688a767342fbec3718"}
Jul 17 07:13:21.225651 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:21.225612    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-qvmm2" podStartSLOduration=1.5632245409999999 podStartE2EDuration="3.225596855s" totalImagesPullingTime="1.662372314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:21.223568391 +0000 UTC m=+64.029765568" watchObservedRunningTime="2026-07-17 07:13:21.225596855 +0000 UTC m=+64.031794008"
Jul 17 07:13:21.263888 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:21.263848    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jt6w7" podStartSLOduration=1.697730561 podStartE2EDuration="3.263831071s" totalImagesPullingTime="1.56610051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:21.263804495 +0000 UTC m=+64.070001682" watchObservedRunningTime="2026-07-17 07:13:21.263831071 +0000 UTC m=+64.070028246"
Jul 17 07:13:22.214274 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.214178    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9hj7" event={"ID":"a1502a15-f7bc-4ca7-a188-77f5e5874acc","Type":"ContainerStarted","Data":"3188b4e59c2341228dabe9af08aa1e4974990c5006e6dff174f613d0452a2025"}
Jul 17 07:13:22.214274 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.214256    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9hj7" event={"ID":"a1502a15-f7bc-4ca7-a188-77f5e5874acc","Type":"ContainerStarted","Data":"f75da333cf9841969227d06fd20884b00ba03d42579ad2b39a894d4262a0c13d"}
Jul 17 07:13:22.215760 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.215734    2546 generic.go:356] "Generic (PLEG): container finished" podID="c55b7f7e-ce36-4b50-b810-337e07d9ae15" containerID="6aee0d3798c18a97223f8c829a7881d7be2fcee153f1f234238f2268a90bf2ae" exitCode=0
Jul 17 07:13:22.215882 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.215826    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c55b7f7e-ce36-4b50-b810-337e07d9ae15","Type":"ContainerDied","Data":"6aee0d3798c18a97223f8c829a7881d7be2fcee153f1f234238f2268a90bf2ae"}
Jul 17 07:13:22.235634 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.235580    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p9hj7" podStartSLOduration=2.384735462 podStartE2EDuration="4.235559356s" totalImagesPullingTime="1.750961909s" totalInitContainerRuntime="99.861985ms" isStatefulPod=true podCreationTimestamp="2026-07-17 07:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:22.233579407 +0000 UTC m=+65.039776581" watchObservedRunningTime="2026-07-17 07:13:22.235559356 +0000 UTC m=+65.041756529"
Jul 17 07:13:22.586783 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.586747    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-989794db7-f7gmz"]
Jul 17 07:13:22.590166 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.590141    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.592909 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.592877    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 17 07:13:22.593150 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.593126    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-qc0iq086t03k\""
Jul 17 07:13:22.593851 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.593813    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 07:13:22.593953 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.593860    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 17 07:13:22.593953 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.593911    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pkd6f\""
Jul 17 07:13:22.594081 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.593911    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 17 07:13:22.602635 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.602609    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-989794db7-f7gmz"]
Jul 17 07:13:22.696896 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.696872    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw7nk\" (UniqueName: \"kubernetes.io/projected/a60d4f78-8935-4705-99ee-90b932b2aeee-kube-api-access-lw7nk\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.697006 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.696912    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a60d4f78-8935-4705-99ee-90b932b2aeee-secret-metrics-server-client-certs\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.697006 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.696931    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a60d4f78-8935-4705-99ee-90b932b2aeee-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.697006 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.696971    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a60d4f78-8935-4705-99ee-90b932b2aeee-metrics-server-audit-profiles\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.697142 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.697014    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a60d4f78-8935-4705-99ee-90b932b2aeee-client-ca-bundle\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.697142 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.697040    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a60d4f78-8935-4705-99ee-90b932b2aeee-secret-metrics-server-tls\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.697142 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.697070    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a60d4f78-8935-4705-99ee-90b932b2aeee-audit-log\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.798022 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.797992    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw7nk\" (UniqueName: \"kubernetes.io/projected/a60d4f78-8935-4705-99ee-90b932b2aeee-kube-api-access-lw7nk\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.798129 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.798050    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a60d4f78-8935-4705-99ee-90b932b2aeee-secret-metrics-server-client-certs\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.798129 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.798081    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a60d4f78-8935-4705-99ee-90b932b2aeee-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.798129 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.798109    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a60d4f78-8935-4705-99ee-90b932b2aeee-metrics-server-audit-profiles\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.798297 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.798277    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a60d4f78-8935-4705-99ee-90b932b2aeee-client-ca-bundle\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.798353 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.798335    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a60d4f78-8935-4705-99ee-90b932b2aeee-secret-metrics-server-tls\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.798411 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.798377    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a60d4f78-8935-4705-99ee-90b932b2aeee-audit-log\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.798854 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.798775    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a60d4f78-8935-4705-99ee-90b932b2aeee-audit-log\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.798854 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.798842    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a60d4f78-8935-4705-99ee-90b932b2aeee-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.799251 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.799225    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a60d4f78-8935-4705-99ee-90b932b2aeee-metrics-server-audit-profiles\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.800925 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.800904    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a60d4f78-8935-4705-99ee-90b932b2aeee-secret-metrics-server-client-certs\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.801484 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.801464    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a60d4f78-8935-4705-99ee-90b932b2aeee-client-ca-bundle\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.801574 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.801516    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a60d4f78-8935-4705-99ee-90b932b2aeee-secret-metrics-server-tls\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.805923 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.805901    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw7nk\" (UniqueName: \"kubernetes.io/projected/a60d4f78-8935-4705-99ee-90b932b2aeee-kube-api-access-lw7nk\") pod \"metrics-server-989794db7-f7gmz\" (UID: \"a60d4f78-8935-4705-99ee-90b932b2aeee\") " pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:22.902444 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:22.902410    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:23.055612 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.055573    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-989794db7-f7gmz"]
Jul 17 07:13:23.058967 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.058917    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"]
Jul 17 07:13:23.061973 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:23.061950    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60d4f78_8935_4705_99ee_90b932b2aeee.slice/crio-86e13b80af1475cd5fab409558fb01df52de7f3d635ab964ac44db0dceed5ce0 WatchSource:0}: Error finding container 86e13b80af1475cd5fab409558fb01df52de7f3d635ab964ac44db0dceed5ce0: Status 404 returned error can't find the container with id 86e13b80af1475cd5fab409558fb01df52de7f3d635ab964ac44db0dceed5ce0
Jul 17 07:13:23.062086 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.062073    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66c9f8794d-hfn8b"]
Jul 17 07:13:23.062229 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.062208    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"
Jul 17 07:13:23.065124 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.064925    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.065449 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.065301    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 17 07:13:23.065449 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.065346    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7bn8n\""
Jul 17 07:13:23.075105 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.075079    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"]
Jul 17 07:13:23.081459 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.081422    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c9f8794d-hfn8b"]
Jul 17 07:13:23.203478 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.203384    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-oauth-config\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.203478 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.203437    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-serving-cert\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.203717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.203482    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/959a3983-e44f-4163-bc64-9ea8ea64b696-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-49cx2\" (UID: \"959a3983-e44f-4163-bc64-9ea8ea64b696\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"
Jul 17 07:13:23.203717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.203510    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27g56\" (UniqueName: \"kubernetes.io/projected/959a3983-e44f-4163-bc64-9ea8ea64b696-kube-api-access-27g56\") pod \"monitoring-plugin-7b7b7bc8bf-49cx2\" (UID: \"959a3983-e44f-4163-bc64-9ea8ea64b696\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"
Jul 17 07:13:23.203717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.203660    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-config\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.203717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.203700    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sx79\" (UniqueName: \"kubernetes.io/projected/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-kube-api-access-4sx79\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.203717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.203717    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-trusted-ca-bundle\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.203907 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.203731    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-oauth-serving-cert\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.203907 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.203750    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-service-ca\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.221171 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.221132    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-989794db7-f7gmz" event={"ID":"a60d4f78-8935-4705-99ee-90b932b2aeee","Type":"ContainerStarted","Data":"86e13b80af1475cd5fab409558fb01df52de7f3d635ab964ac44db0dceed5ce0"}
Jul 17 07:13:23.224083 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.224052    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9" event={"ID":"13213d21-c20c-45eb-916f-53505037c9a1","Type":"ContainerStarted","Data":"5e5d341c96c1e681cfc8a2944941b5b5e175f7ee0d1eddf7008754bc7b540128"}
Jul 17 07:13:23.224219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.224130    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9" event={"ID":"13213d21-c20c-45eb-916f-53505037c9a1","Type":"ContainerStarted","Data":"6642edc9abfef7622645ff9315a67e8f49a23b2b3a616623b7eae4491e979f69"}
Jul 17 07:13:23.224219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.224175    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9" event={"ID":"13213d21-c20c-45eb-916f-53505037c9a1","Type":"ContainerStarted","Data":"5c4c05a62749d7a6b6cb0cf48548058e97cb2db1d485e567ad1f28d24f2eed41"}
Jul 17 07:13:23.305032 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.304994    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-oauth-config\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.305032 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.305037    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-serving-cert\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.305266 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.305247    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/959a3983-e44f-4163-bc64-9ea8ea64b696-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-49cx2\" (UID: \"959a3983-e44f-4163-bc64-9ea8ea64b696\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"
Jul 17 07:13:23.305308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.305280    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27g56\" (UniqueName: \"kubernetes.io/projected/959a3983-e44f-4163-bc64-9ea8ea64b696-kube-api-access-27g56\") pod \"monitoring-plugin-7b7b7bc8bf-49cx2\" (UID: \"959a3983-e44f-4163-bc64-9ea8ea64b696\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"
Jul 17 07:13:23.305914 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.305589    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-config\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.305914 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.305633    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sx79\" (UniqueName: \"kubernetes.io/projected/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-kube-api-access-4sx79\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.305914 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.305688    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-trusted-ca-bundle\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.305914 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.305719    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-oauth-serving-cert\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.305914 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.305791    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-service-ca\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.306928 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.306902    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-service-ca\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.307113 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.307088    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-oauth-serving-cert\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.307189 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.307091    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-config\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.307280 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.307252    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-trusted-ca-bundle\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.307739 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.307716    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-oauth-config\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.307827 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.307790    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/959a3983-e44f-4163-bc64-9ea8ea64b696-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-49cx2\" (UID: \"959a3983-e44f-4163-bc64-9ea8ea64b696\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"
Jul 17 07:13:23.307863 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.307832    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-serving-cert\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.314090 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.314070    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sx79\" (UniqueName: \"kubernetes.io/projected/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-kube-api-access-4sx79\") pod \"console-66c9f8794d-hfn8b\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") " pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.314180 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.314149    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27g56\" (UniqueName: \"kubernetes.io/projected/959a3983-e44f-4163-bc64-9ea8ea64b696-kube-api-access-27g56\") pod \"monitoring-plugin-7b7b7bc8bf-49cx2\" (UID: \"959a3983-e44f-4163-bc64-9ea8ea64b696\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"
Jul 17 07:13:23.376065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.376028    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"
Jul 17 07:13:23.385061 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.385032    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:23.480731 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.479926    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5757d965dd-cxh7m"]
Jul 17 07:13:23.484987 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.484940    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.487416 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.487390    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 17 07:13:23.487911 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.487694    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 17 07:13:23.487911 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.487711    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 17 07:13:23.488590 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.488142    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 17 07:13:23.488975 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.488953    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bpmsp\""
Jul 17 07:13:23.489503 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.489483    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 17 07:13:23.496138 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.496119    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 17 07:13:23.498589 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.498517    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5757d965dd-cxh7m"]
Jul 17 07:13:23.508350 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.508322    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:13:23.508817 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.508783    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:13:23.511215 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.511196    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 07:13:23.511589 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.511559    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 07:13:23.521172 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.521155    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222-metrics-certs\") pod \"network-metrics-daemon-gnkns\" (UID: \"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222\") " pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:13:23.522132 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.522110    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e-original-pull-secret\") pod \"global-pull-secret-syncer-l8rd7\" (UID: \"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e\") " pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:13:23.525298 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.524985    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s4jgz\""
Jul 17 07:13:23.532764 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.532703    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnkns"
Jul 17 07:13:23.536195 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.536037    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l8rd7"
Jul 17 07:13:23.555390 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.555187    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"]
Jul 17 07:13:23.574246 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.574176    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c9f8794d-hfn8b"]
Jul 17 07:13:23.609830 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.609794    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl824\" (UniqueName: \"kubernetes.io/projected/4930b7ac-1314-4d80-880d-b490ad6c907e-kube-api-access-pl824\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.610278 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.609847    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwkg\" (UniqueName: \"kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg\") pod \"network-check-target-kg768\" (UID: \"d66998d5-f642-42f2-bad6-197b5ceb0bac\") " pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:13:23.610278 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.609878    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4930b7ac-1314-4d80-880d-b490ad6c907e-serving-certs-ca-bundle\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.610278 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.609935    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-secret-telemeter-client\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.610278 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.609961    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-federate-client-tls\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.610278 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.610031    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.610278 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.610066    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4930b7ac-1314-4d80-880d-b490ad6c907e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.610278 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.610097    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4930b7ac-1314-4d80-880d-b490ad6c907e-metrics-client-ca\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.610278 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.610158    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-telemeter-client-tls\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.612774 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.612731    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 07:13:23.623599 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.623577    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 07:13:23.634757 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.634703    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdwkg\" (UniqueName: \"kubernetes.io/projected/d66998d5-f642-42f2-bad6-197b5ceb0bac-kube-api-access-bdwkg\") pod \"network-check-target-kg768\" (UID: \"d66998d5-f642-42f2-bad6-197b5ceb0bac\") " pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:13:23.711215 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.711183    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-secret-telemeter-client\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.711396 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.711233    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-federate-client-tls\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.711396 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.711285    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.711396 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.711320    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4930b7ac-1314-4d80-880d-b490ad6c907e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.711396 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.711350    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4930b7ac-1314-4d80-880d-b490ad6c907e-metrics-client-ca\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.711605 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.711414    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-telemeter-client-tls\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.711605 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.711479    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl824\" (UniqueName: \"kubernetes.io/projected/4930b7ac-1314-4d80-880d-b490ad6c907e-kube-api-access-pl824\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.711605 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.711540    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4930b7ac-1314-4d80-880d-b490ad6c907e-serving-certs-ca-bundle\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.713311 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.713252    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4930b7ac-1314-4d80-880d-b490ad6c907e-metrics-client-ca\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.715944 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.715890    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4930b7ac-1314-4d80-880d-b490ad6c907e-serving-certs-ca-bundle\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.716141 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.716090    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-secret-telemeter-client\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.717004 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.716841    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.717368 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.717340    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-telemeter-client-tls\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.718053 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.718025    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4930b7ac-1314-4d80-880d-b490ad6c907e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.719874 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.719835    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4930b7ac-1314-4d80-880d-b490ad6c907e-federate-client-tls\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.721687 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.721632    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl824\" (UniqueName: \"kubernetes.io/projected/4930b7ac-1314-4d80-880d-b490ad6c907e-kube-api-access-pl824\") pod \"telemeter-client-5757d965dd-cxh7m\" (UID: \"4930b7ac-1314-4d80-880d-b490ad6c907e\") " pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.802838 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.802794    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m"
Jul 17 07:13:23.844708 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.844681    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c28tv\""
Jul 17 07:13:23.852532 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:23.852501    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:13:23.898758 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:23.898727    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959a3983_e44f_4163_bc64_9ea8ea64b696.slice/crio-1a97bcd007370e3ea397286e6c19e2dda7a01e6a9e2355dd7d506ac0bed8be54 WatchSource:0}: Error finding container 1a97bcd007370e3ea397286e6c19e2dda7a01e6a9e2355dd7d506ac0bed8be54: Status 404 returned error can't find the container with id 1a97bcd007370e3ea397286e6c19e2dda7a01e6a9e2355dd7d506ac0bed8be54
Jul 17 07:13:24.016687 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:24.016629    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ed371f_f698_4f07_beba_f2ccd7a8bf2a.slice/crio-9fb918c64540dd46cf75092f7e17ebbb88d17729b8961c1e03e2753e3611b2a3 WatchSource:0}: Error finding container 9fb918c64540dd46cf75092f7e17ebbb88d17729b8961c1e03e2753e3611b2a3: Status 404 returned error can't find the container with id 9fb918c64540dd46cf75092f7e17ebbb88d17729b8961c1e03e2753e3611b2a3
Jul 17 07:13:24.240827 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.240153    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c9f8794d-hfn8b" event={"ID":"68ed371f-f698-4f07-beba-f2ccd7a8bf2a","Type":"ContainerStarted","Data":"a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8"}
Jul 17 07:13:24.240827 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.240207    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c9f8794d-hfn8b" event={"ID":"68ed371f-f698-4f07-beba-f2ccd7a8bf2a","Type":"ContainerStarted","Data":"9fb918c64540dd46cf75092f7e17ebbb88d17729b8961c1e03e2753e3611b2a3"}
Jul 17 07:13:24.244056 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.242186    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2" event={"ID":"959a3983-e44f-4163-bc64-9ea8ea64b696","Type":"ContainerStarted","Data":"1a97bcd007370e3ea397286e6c19e2dda7a01e6a9e2355dd7d506ac0bed8be54"}
Jul 17 07:13:24.261122 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.260074    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9" event={"ID":"13213d21-c20c-45eb-916f-53505037c9a1","Type":"ContainerStarted","Data":"c474524422ec2a00e030686f43b08cd1a00d58c684176c91c2e77763680e5f1d"}
Jul 17 07:13:24.284921 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.276113    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66c9f8794d-hfn8b" podStartSLOduration=1.2760922080000001 podStartE2EDuration="1.276092208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:13:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:24.272694652 +0000 UTC m=+67.078891819" watchObservedRunningTime="2026-07-17 07:13:24.276092208 +0000 UTC m=+67.082289385"
Jul 17 07:13:24.290016 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.289987    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l8rd7"]
Jul 17 07:13:24.305234 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.304969    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c55b7f7e-ce36-4b50-b810-337e07d9ae15","Type":"ContainerStarted","Data":"1b0f67bfbf20b4d09e47645ecb09f11f3d7f94cdb214bef1c2ba48f13f57dab6"}
Jul 17 07:13:24.326892 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.326821    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kg768"]
Jul 17 07:13:24.345923 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:24.345892    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66998d5_f642_42f2_bad6_197b5ceb0bac.slice/crio-eac8fc7829237eda86818d94348bb24161691e925f96359aa5820ddd8f90cd92 WatchSource:0}: Error finding container eac8fc7829237eda86818d94348bb24161691e925f96359aa5820ddd8f90cd92: Status 404 returned error can't find the container with id eac8fc7829237eda86818d94348bb24161691e925f96359aa5820ddd8f90cd92
Jul 17 07:13:24.354938 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.354911    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5757d965dd-cxh7m"]
Jul 17 07:13:24.371901 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.371100    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gnkns"]
Jul 17 07:13:24.377471 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:13:24.377434    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eeb3ad6_cd1f_4ecd_9d87_dcd568d53222.slice/crio-60cde927823c09807eb0a4b57f90928655f489d99d63227f1737b8e8cdf1573a WatchSource:0}: Error finding container 60cde927823c09807eb0a4b57f90928655f489d99d63227f1737b8e8cdf1573a: Status 404 returned error can't find the container with id 60cde927823c09807eb0a4b57f90928655f489d99d63227f1737b8e8cdf1573a
Jul 17 07:13:24.580971 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.580941    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 07:13:24.584544 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.584526    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.589415    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.589685    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.589897    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.590602    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.590839    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.590927    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.591047    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-56sgl\""
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.591152    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.591240    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.591351    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.591561    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 17 07:13:24.593308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.591578    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 17 07:13:24.596277 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.595488    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 17 07:13:24.596277 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.595779    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 17 07:13:24.596277 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.595989    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-48oi6ee4jr168\""
Jul 17 07:13:24.605543 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.601954    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 17 07:13:24.605543 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.604151    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 07:13:24.719477 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.719448    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-config\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.719919 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.719487    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.719919 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.719512    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.719919 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.719598    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.719919 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.719640    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.719919 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.719739    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.719919 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.719798    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.719919 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.719835    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d125c1c-99dc-451a-9577-aabd12aaf11f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.719923    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljgpf\" (UniqueName: \"kubernetes.io/projected/6d125c1c-99dc-451a-9577-aabd12aaf11f-kube-api-access-ljgpf\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.719957    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.719990    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d125c1c-99dc-451a-9577-aabd12aaf11f-config-out\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.720013    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.720042    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.720105    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.720137    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.720162    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.720189    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-web-config\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.720228    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.720258    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.720766 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.720298    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.821606    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.821655    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.821728    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.821773    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.821815    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d125c1c-99dc-451a-9577-aabd12aaf11f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.821868    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgpf\" (UniqueName: \"kubernetes.io/projected/6d125c1c-99dc-451a-9577-aabd12aaf11f-kube-api-access-ljgpf\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.821898    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.821928    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d125c1c-99dc-451a-9577-aabd12aaf11f-config-out\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.821957    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.821987    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.822020    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.822048    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.822072    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.823465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.822100    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-web-config\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.824376 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.822141    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.824376 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.822174    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.824376 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.822198    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.824376 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.822233    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-config\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.824376 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.822256    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.824376 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.822283    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.824376 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.823096    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.824376 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.823710    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.825519 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.825158    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.827312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.827285    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.827800 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.827752    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.827984 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.827958    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.833214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.829288    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.833214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.831097    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.833214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.831724    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-web-config\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.833214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.832395    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.833214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.832707    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.833214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.832998    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.833214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.833177    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6d125c1c-99dc-451a-9577-aabd12aaf11f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.835104 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.834714    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d125c1c-99dc-451a-9577-aabd12aaf11f-config-out\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.835217 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.835185    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.835909 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.835870    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-config\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.836395 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.836357    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d125c1c-99dc-451a-9577-aabd12aaf11f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.836572 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.836548    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.838893 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.838852    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljgpf\" (UniqueName: \"kubernetes.io/projected/6d125c1c-99dc-451a-9577-aabd12aaf11f-kube-api-access-ljgpf\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.839494 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.839454    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6d125c1c-99dc-451a-9577-aabd12aaf11f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6d125c1c-99dc-451a-9577-aabd12aaf11f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:24.908703 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:24.908407    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:25.138627 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.138470    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 07:13:25.317034 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.316937    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l8rd7" event={"ID":"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e","Type":"ContainerStarted","Data":"13d50263113dde1f6266f6f7c43d424735e64e7b41c50d56eece0d234dd383b5"}
Jul 17 07:13:25.325214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.325181    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c55b7f7e-ce36-4b50-b810-337e07d9ae15","Type":"ContainerStarted","Data":"c6ec930f629f898532fef3e4fad2e1febc513f059995cc724d1dea5e75f39fb1"}
Jul 17 07:13:25.325464 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.325448    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c55b7f7e-ce36-4b50-b810-337e07d9ae15","Type":"ContainerStarted","Data":"6e92b94c30120defff42274a4ec60ae1478235314695ce0aa5333c2c5c60db21"}
Jul 17 07:13:25.325588 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.325575    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c55b7f7e-ce36-4b50-b810-337e07d9ae15","Type":"ContainerStarted","Data":"f42b85ed89a30b3070268d1f9d97d2d37c6c8cb09e8b62e1ad08731c8535bffd"}
Jul 17 07:13:25.325747 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.325734    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c55b7f7e-ce36-4b50-b810-337e07d9ae15","Type":"ContainerStarted","Data":"66b9674a34e81d6d4ebce26734fc169ca613b250382882261aaa96589d1f9e12"}
Jul 17 07:13:25.325867 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.325855    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c55b7f7e-ce36-4b50-b810-337e07d9ae15","Type":"ContainerStarted","Data":"97c75059605a49ec75e9acb4c9c6dde9df0af6065b663631aa6ffe3f37ae59dd"}
Jul 17 07:13:25.330281 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.330063    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kg768" event={"ID":"d66998d5-f642-42f2-bad6-197b5ceb0bac","Type":"ContainerStarted","Data":"eac8fc7829237eda86818d94348bb24161691e925f96359aa5820ddd8f90cd92"}
Jul 17 07:13:25.332241 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.332209    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m" event={"ID":"4930b7ac-1314-4d80-880d-b490ad6c907e","Type":"ContainerStarted","Data":"051fff28fcea4f59aa52985792ce428e54c4286f080255e51f976eea5d866603"}
Jul 17 07:13:25.336888 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.336860    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9" event={"ID":"13213d21-c20c-45eb-916f-53505037c9a1","Type":"ContainerStarted","Data":"859f042888a6b7a1aeba0e22c6ef34c562d5c7be52b7c738ea18de7748481ac7"}
Jul 17 07:13:25.337003 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.336936    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9" event={"ID":"13213d21-c20c-45eb-916f-53505037c9a1","Type":"ContainerStarted","Data":"bb2258fd1de36bbf2d25b9af623bc70be36ee39caf121c3b94499e09f8946a81"}
Jul 17 07:13:25.337803 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.337782    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:25.341525 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.341501    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnkns" event={"ID":"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222","Type":"ContainerStarted","Data":"60cde927823c09807eb0a4b57f90928655f489d99d63227f1737b8e8cdf1573a"}
Jul 17 07:13:25.355635 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:25.355123    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.260599494 podStartE2EDuration="6.355101564s" totalImagesPullingTime="3.079551359s" totalInitContainerRuntime="14.950711ms" isStatefulPod=false podCreationTimestamp="2026-07-17 07:13:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:25.352422695 +0000 UTC m=+68.158619873" watchObservedRunningTime="2026-07-17 07:13:25.355101564 +0000 UTC m=+68.161298739"
Jul 17 07:13:26.349502 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:26.349374    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d125c1c-99dc-451a-9577-aabd12aaf11f","Type":"ContainerStarted","Data":"2d5f33dbbe83e4303088977fe15535ed5546ea57cfa310a2b29f577aaff2f127"}
Jul 17 07:13:27.361466 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:27.361440    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9"
Jul 17 07:13:27.387502 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:27.387448    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-849864688f-g7zn9" podStartSLOduration=4.262837537 podStartE2EDuration="7.38742708s" totalImagesPullingTime="3.124589543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:13:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:25.379591047 +0000 UTC m=+68.185788224" watchObservedRunningTime="2026-07-17 07:13:27.38742708 +0000 UTC m=+70.193624256"
Jul 17 07:13:30.371105 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.371063    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l8rd7" event={"ID":"018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e","Type":"ContainerStarted","Data":"5f8c9d014939dce51e3241114d25cff1d1c31c69c9344ceeb4eaa8b3a321e121"}
Jul 17 07:13:30.373422 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.373395    2546 generic.go:356] "Generic (PLEG): container finished" podID="6d125c1c-99dc-451a-9577-aabd12aaf11f" containerID="bfea9996afc01f722895e58757327c67f2eef60ecd4b0745c5aab319a0369c0b" exitCode=0
Jul 17 07:13:30.373552 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.373468    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d125c1c-99dc-451a-9577-aabd12aaf11f","Type":"ContainerDied","Data":"bfea9996afc01f722895e58757327c67f2eef60ecd4b0745c5aab319a0369c0b"}
Jul 17 07:13:30.376768 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.376743    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-989794db7-f7gmz" event={"ID":"a60d4f78-8935-4705-99ee-90b932b2aeee","Type":"ContainerStarted","Data":"0c9937c7bdfe5096b4c46466dab23dc8ed149601a30c752e6870bd4d21034119"}
Jul 17 07:13:30.379105 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.379084    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2" event={"ID":"959a3983-e44f-4163-bc64-9ea8ea64b696","Type":"ContainerStarted","Data":"314b89bf5744246819ae1807307434481baa55afa9a4cb4b70b30b2331374f7f"}
Jul 17 07:13:30.379406 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.379387    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"
Jul 17 07:13:30.381775 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.381622    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m" event={"ID":"4930b7ac-1314-4d80-880d-b490ad6c907e","Type":"ContainerStarted","Data":"0fc1f54ce14166c18f9f18b38c1e31ca2942206bfef950feede6a24ea42e35ec"}
Jul 17 07:13:30.383009 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.382985    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m" event={"ID":"4930b7ac-1314-4d80-880d-b490ad6c907e","Type":"ContainerStarted","Data":"826e18663e14ff1e346ff6e5e7f111a5ba9c45bf2d3da19c1940f54c3153eda1"}
Jul 17 07:13:30.384150 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.384112    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnkns" event={"ID":"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222","Type":"ContainerStarted","Data":"d533996ddda5d22d888db2b1c8982ca66bc5f0904382ba06646c6a0daf470dc0"}
Jul 17 07:13:30.384256 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.384165    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnkns" event={"ID":"8eeb3ad6-cd1f-4ecd-9d87-dcd568d53222","Type":"ContainerStarted","Data":"cc1c2be1d4c33db331449cf3ecda0f269e4a45d39191a89e012666810b71b330"}
Jul 17 07:13:30.386236 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.386215    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2"
Jul 17 07:13:30.386836 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.386639    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kg768" event={"ID":"d66998d5-f642-42f2-bad6-197b5ceb0bac","Type":"ContainerStarted","Data":"f7fe5e50c2906ca730035b48619d903b155519a640f80433b1b135f5486494b6"}
Jul 17 07:13:30.386953 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.386927    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:13:30.388420 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.388384    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l8rd7" podStartSLOduration=66.597029136 podStartE2EDuration="1m12.388370852s" totalImagesPullingTime="5.791341716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:30.387479337 +0000 UTC m=+73.193676511" watchObservedRunningTime="2026-07-17 07:13:30.388370852 +0000 UTC m=+73.194568005"
Jul 17 07:13:30.407987 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.407937    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-989794db7-f7gmz" podStartSLOduration=1.400083726 podStartE2EDuration="8.407916468s" totalImagesPullingTime="7.007832742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:30.406571655 +0000 UTC m=+73.212768835" watchObservedRunningTime="2026-07-17 07:13:30.407916468 +0000 UTC m=+73.214113645"
Jul 17 07:13:30.452523 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.452470    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kg768" podStartSLOduration=66.711221767 podStartE2EDuration="1m12.452456017s" totalImagesPullingTime="5.74123425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:30.452020238 +0000 UTC m=+73.258217411" watchObservedRunningTime="2026-07-17 07:13:30.452456017 +0000 UTC m=+73.258653193"
Jul 17 07:13:30.466621 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.466574    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gnkns" podStartSLOduration=66.774100194 podStartE2EDuration="1m12.466554803s" totalImagesPullingTime="5.692454609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:30.466302718 +0000 UTC m=+73.272499896" watchObservedRunningTime="2026-07-17 07:13:30.466554803 +0000 UTC m=+73.272751977"
Jul 17 07:13:30.483547 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:30.483238    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-49cx2" podStartSLOduration=1.311576504 podStartE2EDuration="7.483217705s" totalImagesPullingTime="6.171641201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:13:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:30.482800836 +0000 UTC m=+73.288998012" watchObservedRunningTime="2026-07-17 07:13:30.483217705 +0000 UTC m=+73.289414881"
Jul 17 07:13:31.393314 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:31.393216    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m" event={"ID":"4930b7ac-1314-4d80-880d-b490ad6c907e","Type":"ContainerStarted","Data":"afdf8669d9f0af4beee8a3d309b194013a1d9c50210ea3e58768960e9a2acff7"}
Jul 17 07:13:32.314541 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:32.314474    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5757d965dd-cxh7m" podStartSLOduration=3.612652845 podStartE2EDuration="9.314450665s" totalImagesPullingTime="5.70179782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:13:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:31.444242027 +0000 UTC m=+74.250439203" watchObservedRunningTime="2026-07-17 07:13:32.314450665 +0000 UTC m=+75.120647841"
Jul 17 07:13:32.316163 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:32.316137    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c9f8794d-hfn8b"]
Jul 17 07:13:33.385324 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:33.385284    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:34.409499 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:34.409466    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d125c1c-99dc-451a-9577-aabd12aaf11f","Type":"ContainerStarted","Data":"2c54116ba1fb241b9a95903f836fd655b36f158d26793ff37acb3302e748c22d"}
Jul 17 07:13:34.409904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:34.409530    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d125c1c-99dc-451a-9577-aabd12aaf11f","Type":"ContainerStarted","Data":"98bb74c8780ac96ee9ab41ff901e98a72b74298c130ec472e60f0f5bd07be753"}
Jul 17 07:13:34.409904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:34.409556    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d125c1c-99dc-451a-9577-aabd12aaf11f","Type":"ContainerStarted","Data":"5fec101ee72963de50102b29d1308265cd680e71fa7768d6840ede95502bd064"}
Jul 17 07:13:34.409904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:34.409579    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d125c1c-99dc-451a-9577-aabd12aaf11f","Type":"ContainerStarted","Data":"8d4b8129b51a3947f6b23275260641d93301e0c1152b1b35261c28a310fa787d"}
Jul 17 07:13:34.409904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:34.409604    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d125c1c-99dc-451a-9577-aabd12aaf11f","Type":"ContainerStarted","Data":"a2a7db0aa244ed79d23adaad0517c805d45b167129c0fbfe0f81cbb19ee382de"}
Jul 17 07:13:34.409904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:34.409626    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6d125c1c-99dc-451a-9577-aabd12aaf11f","Type":"ContainerStarted","Data":"cd2f6df45a6ad7251f129c90d7b4f9b5f913b07c0da1967c4bc217d3fca0f43c"}
Jul 17 07:13:34.440191 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:34.440104    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.135170126 podStartE2EDuration="10.440080931s" totalImagesPullingTime="3.272794987s" totalInitContainerRuntime="32.115818ms" isStatefulPod=false podCreationTimestamp="2026-07-17 07:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:13:34.437828237 +0000 UTC m=+77.244025411" watchObservedRunningTime="2026-07-17 07:13:34.440080931 +0000 UTC m=+77.246278107"
Jul 17 07:13:34.909285 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:34.909256    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:13:42.902771 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:42.902642    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:42.902771 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:42.902715    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:13:42.934951 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:42.934919    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b94c4bccb-82dkr"]
Jul 17 07:13:57.345310 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:57.345266    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66c9f8794d-hfn8b" podUID="68ed371f-f698-4f07-beba-f2ccd7a8bf2a" containerName="console" containerID="cri-o://a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8" gracePeriod=15
Jul 17 07:13:58.112954 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.112922    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:58.216834 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.216799    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-oauth-config\") pod \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") "
Jul 17 07:13:58.217009 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.216845    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-serving-cert\") pod \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") "
Jul 17 07:13:58.217009 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.216892    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-config\") pod \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") "
Jul 17 07:13:58.217009 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.216936    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-service-ca\") pod \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") "
Jul 17 07:13:58.217009 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.216970    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-trusted-ca-bundle\") pod \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") "
Jul 17 07:13:58.217009 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.217003    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-oauth-serving-cert\") pod \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") "
Jul 17 07:13:58.217289 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.217034    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sx79\" (UniqueName: \"kubernetes.io/projected/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-kube-api-access-4sx79\") pod \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\" (UID: \"68ed371f-f698-4f07-beba-f2ccd7a8bf2a\") "
Jul 17 07:13:58.217418 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.217390    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "68ed371f-f698-4f07-beba-f2ccd7a8bf2a" (UID: "68ed371f-f698-4f07-beba-f2ccd7a8bf2a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:13:58.217418 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.217405    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-config" (OuterVolumeSpecName: "console-config") pod "68ed371f-f698-4f07-beba-f2ccd7a8bf2a" (UID: "68ed371f-f698-4f07-beba-f2ccd7a8bf2a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:13:58.217541 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.217412    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-service-ca" (OuterVolumeSpecName: "service-ca") pod "68ed371f-f698-4f07-beba-f2ccd7a8bf2a" (UID: "68ed371f-f698-4f07-beba-f2ccd7a8bf2a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:13:58.217541 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.217420    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "68ed371f-f698-4f07-beba-f2ccd7a8bf2a" (UID: "68ed371f-f698-4f07-beba-f2ccd7a8bf2a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:13:58.219125 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.219098    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "68ed371f-f698-4f07-beba-f2ccd7a8bf2a" (UID: "68ed371f-f698-4f07-beba-f2ccd7a8bf2a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 07:13:58.219219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.219149    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "68ed371f-f698-4f07-beba-f2ccd7a8bf2a" (UID: "68ed371f-f698-4f07-beba-f2ccd7a8bf2a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 07:13:58.219281 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.219261    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-kube-api-access-4sx79" (OuterVolumeSpecName: "kube-api-access-4sx79") pod "68ed371f-f698-4f07-beba-f2ccd7a8bf2a" (UID: "68ed371f-f698-4f07-beba-f2ccd7a8bf2a"). InnerVolumeSpecName "kube-api-access-4sx79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 07:13:58.318367 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.318334    2546 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-config\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:13:58.318367 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.318361    2546 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:13:58.318367 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.318370    2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-trusted-ca-bundle\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:13:58.318585 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.318378    2546 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-oauth-serving-cert\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:13:58.318585 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.318388    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sx79\" (UniqueName: \"kubernetes.io/projected/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-kube-api-access-4sx79\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:13:58.318585 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.318396    2546 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-oauth-config\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:13:58.318585 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.318404    2546 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68ed371f-f698-4f07-beba-f2ccd7a8bf2a-console-serving-cert\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:13:58.514240 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.514139    2546 generic.go:356] "Generic (PLEG): container finished" podID="68ed371f-f698-4f07-beba-f2ccd7a8bf2a" containerID="a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8" exitCode=0
Jul 17 07:13:58.514240 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.514199    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c9f8794d-hfn8b"
Jul 17 07:13:58.514240 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.514207    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c9f8794d-hfn8b" event={"ID":"68ed371f-f698-4f07-beba-f2ccd7a8bf2a","Type":"ContainerDied","Data":"a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8"}
Jul 17 07:13:58.514787 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.514283    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c9f8794d-hfn8b" event={"ID":"68ed371f-f698-4f07-beba-f2ccd7a8bf2a","Type":"ContainerDied","Data":"9fb918c64540dd46cf75092f7e17ebbb88d17729b8961c1e03e2753e3611b2a3"}
Jul 17 07:13:58.514787 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.514324    2546 scope.go:117] "RemoveContainer" containerID="a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8"
Jul 17 07:13:58.523538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.523521    2546 scope.go:117] "RemoveContainer" containerID="a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8"
Jul 17 07:13:58.523815 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:13:58.523795    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8\": container with ID starting with a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8 not found: ID does not exist" containerID="a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8"
Jul 17 07:13:58.523888 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.523822    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8"} err="failed to get container status \"a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8\": rpc error: code = NotFound desc = could not find container \"a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8\": container with ID starting with a874ae668f5afaf7224268915b4a329c6faec122a78c0ae08a3276b8ee2f1de8 not found: ID does not exist"
Jul 17 07:13:58.537185 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.537160    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c9f8794d-hfn8b"]
Jul 17 07:13:58.541142 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:58.541120    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66c9f8794d-hfn8b"]
Jul 17 07:13:59.903611 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:13:59.903577    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68ed371f-f698-4f07-beba-f2ccd7a8bf2a" path="/var/lib/kubelet/pods/68ed371f-f698-4f07-beba-f2ccd7a8bf2a/volumes"
Jul 17 07:14:01.396305 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:01.396278    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kg768"
Jul 17 07:14:02.908333 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:02.908265    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:14:02.912022 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:02.912003    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-989794db7-f7gmz"
Jul 17 07:14:07.961059 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:07.960999    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b94c4bccb-82dkr" podUID="c360db2a-fdf8-4817-a5a5-5b65495b5fb0" containerName="console" containerID="cri-o://d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18" gracePeriod=15
Jul 17 07:14:08.196521 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.196497    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:14:08.307933 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.307899    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-oauth-serving-cert\") pod \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") "
Jul 17 07:14:08.307933 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.307938    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-oauth-config\") pod \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") "
Jul 17 07:14:08.308143 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.308068    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpq44\" (UniqueName: \"kubernetes.io/projected/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-kube-api-access-gpq44\") pod \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") "
Jul 17 07:14:08.308143 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.308102    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-config\") pod \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") "
Jul 17 07:14:08.308143 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.308121    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-trusted-ca-bundle\") pod \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") "
Jul 17 07:14:08.308300 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.308146    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-service-ca\") pod \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") "
Jul 17 07:14:08.308300 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.308173    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-serving-cert\") pod \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\" (UID: \"c360db2a-fdf8-4817-a5a5-5b65495b5fb0\") "
Jul 17 07:14:08.308436 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.308401    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c360db2a-fdf8-4817-a5a5-5b65495b5fb0" (UID: "c360db2a-fdf8-4817-a5a5-5b65495b5fb0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:14:08.308517 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.308470    2546 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-oauth-serving-cert\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:14:08.308517 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.308492    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-config" (OuterVolumeSpecName: "console-config") pod "c360db2a-fdf8-4817-a5a5-5b65495b5fb0" (UID: "c360db2a-fdf8-4817-a5a5-5b65495b5fb0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:14:08.308601 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.308538    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c360db2a-fdf8-4817-a5a5-5b65495b5fb0" (UID: "c360db2a-fdf8-4817-a5a5-5b65495b5fb0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:14:08.308601 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.308547    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-service-ca" (OuterVolumeSpecName: "service-ca") pod "c360db2a-fdf8-4817-a5a5-5b65495b5fb0" (UID: "c360db2a-fdf8-4817-a5a5-5b65495b5fb0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:14:08.310432 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.310411    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c360db2a-fdf8-4817-a5a5-5b65495b5fb0" (UID: "c360db2a-fdf8-4817-a5a5-5b65495b5fb0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 07:14:08.310654 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.310633    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c360db2a-fdf8-4817-a5a5-5b65495b5fb0" (UID: "c360db2a-fdf8-4817-a5a5-5b65495b5fb0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 07:14:08.310654 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.310643    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-kube-api-access-gpq44" (OuterVolumeSpecName: "kube-api-access-gpq44") pod "c360db2a-fdf8-4817-a5a5-5b65495b5fb0" (UID: "c360db2a-fdf8-4817-a5a5-5b65495b5fb0"). InnerVolumeSpecName "kube-api-access-gpq44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 07:14:08.409824 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.409791    2546 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-config\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:14:08.409824 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.409819    2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-trusted-ca-bundle\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:14:08.409824 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.409831    2546 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:14:08.410018 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.409843    2546 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-serving-cert\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:14:08.410018 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.409855    2546 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-console-oauth-config\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:14:08.410018 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.409867    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpq44\" (UniqueName: \"kubernetes.io/projected/c360db2a-fdf8-4817-a5a5-5b65495b5fb0-kube-api-access-gpq44\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:14:08.558156 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.558066    2546 generic.go:356] "Generic (PLEG): container finished" podID="c360db2a-fdf8-4817-a5a5-5b65495b5fb0" containerID="d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18" exitCode=0
Jul 17 07:14:08.558156 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.558125    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b94c4bccb-82dkr"
Jul 17 07:14:08.558320 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.558155    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b94c4bccb-82dkr" event={"ID":"c360db2a-fdf8-4817-a5a5-5b65495b5fb0","Type":"ContainerDied","Data":"d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18"}
Jul 17 07:14:08.558320 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.558226    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b94c4bccb-82dkr" event={"ID":"c360db2a-fdf8-4817-a5a5-5b65495b5fb0","Type":"ContainerDied","Data":"d71b1049c2a04e33a4e0116d727bae7470495f1c16c972343207f090d43112b6"}
Jul 17 07:14:08.558320 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.558249    2546 scope.go:117] "RemoveContainer" containerID="d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18"
Jul 17 07:14:08.566953 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.566931    2546 scope.go:117] "RemoveContainer" containerID="d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18"
Jul 17 07:14:08.567200 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:14:08.567176    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18\": container with ID starting with d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18 not found: ID does not exist" containerID="d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18"
Jul 17 07:14:08.567248 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.567214    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18"} err="failed to get container status \"d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18\": rpc error: code = NotFound desc = could not find container \"d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18\": container with ID starting with d47c78e1ff61afe69f7f362a9e260efeeaf74227787667cfbcdfe69e4fabaa18 not found: ID does not exist"
Jul 17 07:14:08.579579 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.579548    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b94c4bccb-82dkr"]
Jul 17 07:14:08.587259 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:08.587233    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b94c4bccb-82dkr"]
Jul 17 07:14:09.904682 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:09.904642    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c360db2a-fdf8-4817-a5a5-5b65495b5fb0" path="/var/lib/kubelet/pods/c360db2a-fdf8-4817-a5a5-5b65495b5fb0/volumes"
Jul 17 07:14:24.909092 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:24.909051    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:14:24.928214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:24.928190    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:14:25.641037 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:14:25.641008    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 07:15:48.207554 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.207514    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sg4nv"]
Jul 17 07:15:48.208090 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.207904    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c360db2a-fdf8-4817-a5a5-5b65495b5fb0" containerName="console"
Jul 17 07:15:48.208090 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.207916    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="c360db2a-fdf8-4817-a5a5-5b65495b5fb0" containerName="console"
Jul 17 07:15:48.208090 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.207930    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ed371f-f698-4f07-beba-f2ccd7a8bf2a" containerName="console"
Jul 17 07:15:48.208090 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.207935    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ed371f-f698-4f07-beba-f2ccd7a8bf2a" containerName="console"
Jul 17 07:15:48.208090 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.207999    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ed371f-f698-4f07-beba-f2ccd7a8bf2a" containerName="console"
Jul 17 07:15:48.208090 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.208012    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="c360db2a-fdf8-4817-a5a5-5b65495b5fb0" containerName="console"
Jul 17 07:15:48.209987 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.209970    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv"
Jul 17 07:15:48.212592 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.212567    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 07:15:48.212720 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.212638    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9fvmj\""
Jul 17 07:15:48.213490 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.213471    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 07:15:48.223761 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.223735    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sg4nv"]
Jul 17 07:15:48.302340 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.302303    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sg4nv\" (UID: \"a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv"
Jul 17 07:15:48.302340 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.302351    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrjv2\" (UniqueName: \"kubernetes.io/projected/a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e-kube-api-access-wrjv2\") pod \"cert-manager-webhook-6486ffd997-sg4nv\" (UID: \"a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv"
Jul 17 07:15:48.403023 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.402971    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sg4nv\" (UID: \"a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv"
Jul 17 07:15:48.403023 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.403032    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrjv2\" (UniqueName: \"kubernetes.io/projected/a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e-kube-api-access-wrjv2\") pod \"cert-manager-webhook-6486ffd997-sg4nv\" (UID: \"a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv"
Jul 17 07:15:48.414537 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.414500    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sg4nv\" (UID: \"a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv"
Jul 17 07:15:48.416597 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.416571    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrjv2\" (UniqueName: \"kubernetes.io/projected/a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e-kube-api-access-wrjv2\") pod \"cert-manager-webhook-6486ffd997-sg4nv\" (UID: \"a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv"
Jul 17 07:15:48.528208 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.528176    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv"
Jul 17 07:15:48.656557 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.656532    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sg4nv"]
Jul 17 07:15:48.658944 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:15:48.658918    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7632d5d_bb2d_42d9_9891_4ad7a9d7ca2e.slice/crio-050a27bece59871171c5f76c1c730bdd280025c87c259133364afee21938b1a4 WatchSource:0}: Error finding container 050a27bece59871171c5f76c1c730bdd280025c87c259133364afee21938b1a4: Status 404 returned error can't find the container with id 050a27bece59871171c5f76c1c730bdd280025c87c259133364afee21938b1a4
Jul 17 07:15:48.958813 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:48.958729    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv" event={"ID":"a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e","Type":"ContainerStarted","Data":"050a27bece59871171c5f76c1c730bdd280025c87c259133364afee21938b1a4"}
Jul 17 07:15:51.505983 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.505947    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl"]
Jul 17 07:15:51.508456 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.508432    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl"
Jul 17 07:15:51.510892 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.510870    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-54bz9\""
Jul 17 07:15:51.519380 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.519349    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl"]
Jul 17 07:15:51.524866 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.524837    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66khn\" (UniqueName: \"kubernetes.io/projected/940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2-kube-api-access-66khn\") pod \"cert-manager-cainjector-559cdd8c87-bbmzl\" (UID: \"940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl"
Jul 17 07:15:51.525007 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.524939    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bbmzl\" (UID: \"940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl"
Jul 17 07:15:51.626266 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.626225    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bbmzl\" (UID: \"940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl"
Jul 17 07:15:51.626465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.626343    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66khn\" (UniqueName: \"kubernetes.io/projected/940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2-kube-api-access-66khn\") pod \"cert-manager-cainjector-559cdd8c87-bbmzl\" (UID: \"940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl"
Jul 17 07:15:51.634318 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.634286    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bbmzl\" (UID: \"940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl"
Jul 17 07:15:51.634318 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.634310    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66khn\" (UniqueName: \"kubernetes.io/projected/940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2-kube-api-access-66khn\") pod \"cert-manager-cainjector-559cdd8c87-bbmzl\" (UID: \"940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl"
Jul 17 07:15:51.819743 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.819706    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl"
Jul 17 07:15:51.959047 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.959023    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl"]
Jul 17 07:15:51.961811 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:15:51.961780    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod940cf208_1eaf_4de4_9b6b_e9b3e1a6dae2.slice/crio-ef7636e21fd7fbdf4cba435040ea62593879fa3734ac7a63f8deee7d563de5a5 WatchSource:0}: Error finding container ef7636e21fd7fbdf4cba435040ea62593879fa3734ac7a63f8deee7d563de5a5: Status 404 returned error can't find the container with id ef7636e21fd7fbdf4cba435040ea62593879fa3734ac7a63f8deee7d563de5a5
Jul 17 07:15:51.974407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.974368    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv" event={"ID":"a7632d5d-bb2d-42d9-9891-4ad7a9d7ca2e","Type":"ContainerStarted","Data":"6412287b76e33f3455f0bc7e136bd63bd2838ced8a6081ed2bc7177df8bb242a"}
Jul 17 07:15:51.974542 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.974431    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv"
Jul 17 07:15:51.975635 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.975603    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl" event={"ID":"940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2","Type":"ContainerStarted","Data":"ef7636e21fd7fbdf4cba435040ea62593879fa3734ac7a63f8deee7d563de5a5"}
Jul 17 07:15:51.993484 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:51.993437    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv" podStartSLOduration=0.823428287 podStartE2EDuration="3.993423669s" totalImagesPullingTime="3.169995382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:15:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:15:51.992049204 +0000 UTC m=+214.798246378" watchObservedRunningTime="2026-07-17 07:15:51.993423669 +0000 UTC m=+214.799620844"
Jul 17 07:15:52.981785 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:52.981742    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl" event={"ID":"940cf208-1eaf-4de4-9b6b-e9b3e1a6dae2","Type":"ContainerStarted","Data":"382f40ad1ff4937d6745faa4ffd2ccffd91e862945d3466326165960579d4f34"}
Jul 17 07:15:52.999838 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:52.999776    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bbmzl" podStartSLOduration=1.999753831 podStartE2EDuration="1.999753831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:15:52.999335437 +0000 UTC m=+215.805532612" watchObservedRunningTime="2026-07-17 07:15:52.999753831 +0000 UTC m=+215.805951007"
Jul 17 07:15:57.983912 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:15:57.983876    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sg4nv"
Jul 17 07:16:00.879344 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:00.879301    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc"]
Jul 17 07:16:00.881885 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:00.881862    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc"
Jul 17 07:16:00.884398 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:00.884375    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 07:16:00.884490 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:00.884385    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 07:16:00.885259 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:00.885240    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-k7r7d\""
Jul 17 07:16:00.892436 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:00.892412    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc"]
Jul 17 07:16:00.907637 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:00.907606    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48hxj\" (UniqueName: \"kubernetes.io/projected/b4af7d89-db67-4177-b42b-b135e2a5a892-kube-api-access-48hxj\") pod \"openshift-lws-operator-fd8ccff4c-ckdcc\" (UID: \"b4af7d89-db67-4177-b42b-b135e2a5a892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc"
Jul 17 07:16:00.907808 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:00.907645    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4af7d89-db67-4177-b42b-b135e2a5a892-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ckdcc\" (UID: \"b4af7d89-db67-4177-b42b-b135e2a5a892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc"
Jul 17 07:16:01.008650 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:01.008613    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48hxj\" (UniqueName: \"kubernetes.io/projected/b4af7d89-db67-4177-b42b-b135e2a5a892-kube-api-access-48hxj\") pod \"openshift-lws-operator-fd8ccff4c-ckdcc\" (UID: \"b4af7d89-db67-4177-b42b-b135e2a5a892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc"
Jul 17 07:16:01.008859 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:01.008685    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4af7d89-db67-4177-b42b-b135e2a5a892-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ckdcc\" (UID: \"b4af7d89-db67-4177-b42b-b135e2a5a892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc"
Jul 17 07:16:01.009054 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:01.009036    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4af7d89-db67-4177-b42b-b135e2a5a892-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ckdcc\" (UID: \"b4af7d89-db67-4177-b42b-b135e2a5a892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc"
Jul 17 07:16:01.017586 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:01.017553    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48hxj\" (UniqueName: \"kubernetes.io/projected/b4af7d89-db67-4177-b42b-b135e2a5a892-kube-api-access-48hxj\") pod \"openshift-lws-operator-fd8ccff4c-ckdcc\" (UID: \"b4af7d89-db67-4177-b42b-b135e2a5a892\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc"
Jul 17 07:16:01.191783 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:01.191693    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc"
Jul 17 07:16:01.318357 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:01.318293    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc"]
Jul 17 07:16:01.320747 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:16:01.320718    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4af7d89_db67_4177_b42b_b135e2a5a892.slice/crio-45045822c95b917fa63b4859df306327dc1a331663d8c0cc82d6ca14700c3e35 WatchSource:0}: Error finding container 45045822c95b917fa63b4859df306327dc1a331663d8c0cc82d6ca14700c3e35: Status 404 returned error can't find the container with id 45045822c95b917fa63b4859df306327dc1a331663d8c0cc82d6ca14700c3e35
Jul 17 07:16:02.018961 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:02.018926    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc" event={"ID":"b4af7d89-db67-4177-b42b-b135e2a5a892","Type":"ContainerStarted","Data":"45045822c95b917fa63b4859df306327dc1a331663d8c0cc82d6ca14700c3e35"}
Jul 17 07:16:04.028856 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:04.028818    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc" event={"ID":"b4af7d89-db67-4177-b42b-b135e2a5a892","Type":"ContainerStarted","Data":"e309aa4d968ae4caabbde654aa33a09eb5fa07552aabc9534a6d1b763cfcddc7"}
Jul 17 07:16:04.045790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:04.045726    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ckdcc" podStartSLOduration=1.4272685649999999 podStartE2EDuration="4.045708366s" totalImagesPullingTime="2.618439801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:16:04.044765162 +0000 UTC m=+226.850962341" watchObservedRunningTime="2026-07-17 07:16:04.045708366 +0000 UTC m=+226.851905541"
Jul 17 07:16:22.122926 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.122891    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"]
Jul 17 07:16:22.125579 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.125564    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.134151 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.134121    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 07:16:22.134731 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.134707    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cjtgt\""
Jul 17 07:16:22.134941 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.134918    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 07:16:22.135299 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.135283    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 07:16:22.137550 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.137528    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 07:16:22.202994 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.202957    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d643e70c-240b-43eb-a90c-199b9e28c21e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.203199 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.203008    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzf2d\" (UniqueName: \"kubernetes.io/projected/d643e70c-240b-43eb-a90c-199b9e28c21e-kube-api-access-vzf2d\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.203199 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.203035    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d643e70c-240b-43eb-a90c-199b9e28c21e-manifests\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.203199 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.203108    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d643e70c-240b-43eb-a90c-199b9e28c21e-webhook-cert\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.203199 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.203183    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d643e70c-240b-43eb-a90c-199b9e28c21e-tmp\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.272808 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.272773    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"]
Jul 17 07:16:22.304363 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.304336    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d643e70c-240b-43eb-a90c-199b9e28c21e-webhook-cert\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.304522 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.304380    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d643e70c-240b-43eb-a90c-199b9e28c21e-tmp\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.304580 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.304560    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d643e70c-240b-43eb-a90c-199b9e28c21e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.304643 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.304626    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzf2d\" (UniqueName: \"kubernetes.io/projected/d643e70c-240b-43eb-a90c-199b9e28c21e-kube-api-access-vzf2d\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.304783 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.304755    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d643e70c-240b-43eb-a90c-199b9e28c21e-manifests\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.305128 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.305097    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d643e70c-240b-43eb-a90c-199b9e28c21e-manifests\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.306710 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.306686    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d643e70c-240b-43eb-a90c-199b9e28c21e-tmp\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.306814 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.306796    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d643e70c-240b-43eb-a90c-199b9e28c21e-webhook-cert\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.306912 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.306895    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d643e70c-240b-43eb-a90c-199b9e28c21e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.320593 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.320572    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzf2d\" (UniqueName: \"kubernetes.io/projected/d643e70c-240b-43eb-a90c-199b9e28c21e-kube-api-access-vzf2d\") pod \"opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg\" (UID: \"d643e70c-240b-43eb-a90c-199b9e28c21e\") " pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.441761 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.441657    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:22.588925 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:22.588893    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"]
Jul 17 07:16:22.592369 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:16:22.592342    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd643e70c_240b_43eb_a90c_199b9e28c21e.slice/crio-9d15f1cad4a01d3d0d475521d42b8c223c0a66fa3cdf4fcb9316cf3a4c3d1fde WatchSource:0}: Error finding container 9d15f1cad4a01d3d0d475521d42b8c223c0a66fa3cdf4fcb9316cf3a4c3d1fde: Status 404 returned error can't find the container with id 9d15f1cad4a01d3d0d475521d42b8c223c0a66fa3cdf4fcb9316cf3a4c3d1fde
Jul 17 07:16:23.108409 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:23.108374    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg" event={"ID":"d643e70c-240b-43eb-a90c-199b9e28c21e","Type":"ContainerStarted","Data":"9d15f1cad4a01d3d0d475521d42b8c223c0a66fa3cdf4fcb9316cf3a4c3d1fde"}
Jul 17 07:16:27.130485 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:27.130448    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg" event={"ID":"d643e70c-240b-43eb-a90c-199b9e28c21e","Type":"ContainerStarted","Data":"de8926f7e64904428e3f29784d49d518d774c04b208f6ceeb80d333a1c0e6951"}
Jul 17 07:16:28.141597 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:28.141561    2546 generic.go:356] "Generic (PLEG): container finished" podID="d643e70c-240b-43eb-a90c-199b9e28c21e" containerID="de8926f7e64904428e3f29784d49d518d774c04b208f6ceeb80d333a1c0e6951" exitCode=0
Jul 17 07:16:28.142010 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:28.141602    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg" event={"ID":"d643e70c-240b-43eb-a90c-199b9e28c21e","Type":"ContainerDied","Data":"de8926f7e64904428e3f29784d49d518d774c04b208f6ceeb80d333a1c0e6951"}
Jul 17 07:16:29.148568 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:29.148537    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg" event={"ID":"d643e70c-240b-43eb-a90c-199b9e28c21e","Type":"ContainerStarted","Data":"cf9b0c7372b056dfee3252b160e0797235fb00ff84e99c9ecd728f0e5b72c396"}
Jul 17 07:16:29.149164 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:29.148699    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:29.176801 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:29.176723    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg" podStartSLOduration=2.227188885 podStartE2EDuration="7.176703238s" totalImagesPullingTime="3.924472919s" totalInitContainerRuntime="1.025041434s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:16:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:16:29.175305176 +0000 UTC m=+251.981502351" watchObservedRunningTime="2026-07-17 07:16:29.176703238 +0000 UTC m=+251.982900414"
Jul 17 07:16:39.775370 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.775288    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"]
Jul 17 07:16:39.783258 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.783220    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.787240 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.786985    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ccphb\""
Jul 17 07:16:39.787240 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.787003    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 07:16:39.787240 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.787007    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 07:16:39.787240 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.786985    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 07:16:39.787988 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.787969    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"]
Jul 17 07:16:39.862386 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.862342    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-manager-config\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.862583 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.862456    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhkjn\" (UniqueName: \"kubernetes.io/projected/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-kube-api-access-xhkjn\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.862583 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.862493    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-cert\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.862583 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.862522    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-metrics-cert\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.963780 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.963749    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-metrics-cert\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.963977 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.963813    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-manager-config\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.963977 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.963951    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkjn\" (UniqueName: \"kubernetes.io/projected/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-kube-api-access-xhkjn\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.964092 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.963991    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-cert\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.964520 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.964497    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-manager-config\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.966353 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.966332    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-metrics-cert\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.966462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.966390    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-cert\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:39.974970 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:39.974945    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhkjn\" (UniqueName: \"kubernetes.io/projected/3325ee55-24c5-4173-82ae-eb1a6d5bf00d-kube-api-access-xhkjn\") pod \"lws-controller-manager-6fc85c6965-tvm89\" (UID: \"3325ee55-24c5-4173-82ae-eb1a6d5bf00d\") " pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:40.093643 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:40.093547    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:40.156703 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:40.156645    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg"
Jul 17 07:16:40.227650 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:40.227622    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"]
Jul 17 07:16:40.229698 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:16:40.229653    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3325ee55_24c5_4173_82ae_eb1a6d5bf00d.slice/crio-63879178c2c81c85c87210c3b89328b1d0ffac86f04121100fc43ff8a3d46a1a WatchSource:0}: Error finding container 63879178c2c81c85c87210c3b89328b1d0ffac86f04121100fc43ff8a3d46a1a: Status 404 returned error can't find the container with id 63879178c2c81c85c87210c3b89328b1d0ffac86f04121100fc43ff8a3d46a1a
Jul 17 07:16:41.204853 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:41.204818    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89" event={"ID":"3325ee55-24c5-4173-82ae-eb1a6d5bf00d","Type":"ContainerStarted","Data":"63879178c2c81c85c87210c3b89328b1d0ffac86f04121100fc43ff8a3d46a1a"}
Jul 17 07:16:42.211050 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:42.211015    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89" event={"ID":"3325ee55-24c5-4173-82ae-eb1a6d5bf00d","Type":"ContainerStarted","Data":"1cdd1bfb41b51c77d69296fb92461c1a69d3ab574f9af6d7d281818143f2d910"}
Jul 17 07:16:42.211455 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:42.211153    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:16:42.238101 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:42.238050    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89" podStartSLOduration=1.872437471 podStartE2EDuration="3.238030247s" totalImagesPullingTime="1.365592776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:16:42.235225778 +0000 UTC m=+265.041422953" watchObservedRunningTime="2026-07-17 07:16:42.238030247 +0000 UTC m=+265.044227425"
Jul 17 07:16:48.022040 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.021996    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"]
Jul 17 07:16:48.025903 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.025871    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"
Jul 17 07:16:48.028564 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.028537    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 07:16:48.028763 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.028564    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 07:16:48.028763 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.028537    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 07:16:48.029174 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.029156    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dbrkw\""
Jul 17 07:16:48.029484 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.029154    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 07:16:48.036156 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.036132    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"]
Jul 17 07:16:48.138576 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.138534    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5fb2e41-af67-4efa-ac7e-3b902ca8335d-tmp\") pod \"kube-auth-proxy-5f788c4b68-nlnlq\" (UID: \"e5fb2e41-af67-4efa-ac7e-3b902ca8335d\") " pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"
Jul 17 07:16:48.138777 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.138656    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5fb2e41-af67-4efa-ac7e-3b902ca8335d-tls-certs\") pod \"kube-auth-proxy-5f788c4b68-nlnlq\" (UID: \"e5fb2e41-af67-4efa-ac7e-3b902ca8335d\") " pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"
Jul 17 07:16:48.138777 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.138739    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntb9h\" (UniqueName: \"kubernetes.io/projected/e5fb2e41-af67-4efa-ac7e-3b902ca8335d-kube-api-access-ntb9h\") pod \"kube-auth-proxy-5f788c4b68-nlnlq\" (UID: \"e5fb2e41-af67-4efa-ac7e-3b902ca8335d\") " pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"
Jul 17 07:16:48.239804 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.239770    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5fb2e41-af67-4efa-ac7e-3b902ca8335d-tls-certs\") pod \"kube-auth-proxy-5f788c4b68-nlnlq\" (UID: \"e5fb2e41-af67-4efa-ac7e-3b902ca8335d\") " pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"
Jul 17 07:16:48.239966 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.239825    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntb9h\" (UniqueName: \"kubernetes.io/projected/e5fb2e41-af67-4efa-ac7e-3b902ca8335d-kube-api-access-ntb9h\") pod \"kube-auth-proxy-5f788c4b68-nlnlq\" (UID: \"e5fb2e41-af67-4efa-ac7e-3b902ca8335d\") " pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"
Jul 17 07:16:48.239966 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.239868    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5fb2e41-af67-4efa-ac7e-3b902ca8335d-tmp\") pod \"kube-auth-proxy-5f788c4b68-nlnlq\" (UID: \"e5fb2e41-af67-4efa-ac7e-3b902ca8335d\") " pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"
Jul 17 07:16:48.242232 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.242205    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5fb2e41-af67-4efa-ac7e-3b902ca8335d-tmp\") pod \"kube-auth-proxy-5f788c4b68-nlnlq\" (UID: \"e5fb2e41-af67-4efa-ac7e-3b902ca8335d\") " pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"
Jul 17 07:16:48.242447 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.242428    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5fb2e41-af67-4efa-ac7e-3b902ca8335d-tls-certs\") pod \"kube-auth-proxy-5f788c4b68-nlnlq\" (UID: \"e5fb2e41-af67-4efa-ac7e-3b902ca8335d\") " pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"
Jul 17 07:16:48.249590 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.249567    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntb9h\" (UniqueName: \"kubernetes.io/projected/e5fb2e41-af67-4efa-ac7e-3b902ca8335d-kube-api-access-ntb9h\") pod \"kube-auth-proxy-5f788c4b68-nlnlq\" (UID: \"e5fb2e41-af67-4efa-ac7e-3b902ca8335d\") " pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"
Jul 17 07:16:48.338586 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.338503    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"
Jul 17 07:16:48.476178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:48.476140    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq"]
Jul 17 07:16:48.479202 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:16:48.479172    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fb2e41_af67_4efa_ac7e_3b902ca8335d.slice/crio-6061b721b7893258760eb377c787c8d43d9724265a655afe74540d89a8d91eab WatchSource:0}: Error finding container 6061b721b7893258760eb377c787c8d43d9724265a655afe74540d89a8d91eab: Status 404 returned error can't find the container with id 6061b721b7893258760eb377c787c8d43d9724265a655afe74540d89a8d91eab
Jul 17 07:16:49.248315 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:49.248279    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq" event={"ID":"e5fb2e41-af67-4efa-ac7e-3b902ca8335d","Type":"ContainerStarted","Data":"6061b721b7893258760eb377c787c8d43d9724265a655afe74540d89a8d91eab"}
Jul 17 07:16:52.264426 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:52.264390    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq" event={"ID":"e5fb2e41-af67-4efa-ac7e-3b902ca8335d","Type":"ContainerStarted","Data":"362e8bc64433b44a3872a89b19d24c311dd18b2b84e6cef182a6e23d65343220"}
Jul 17 07:16:52.304324 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:52.304274    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f788c4b68-nlnlq" podStartSLOduration=1.2544337190000001 podStartE2EDuration="4.30425897s" totalImagesPullingTime="3.049825251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:16:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:16:52.302024392 +0000 UTC m=+275.108221567" watchObservedRunningTime="2026-07-17 07:16:52.30425897 +0000 UTC m=+275.110456145"
Jul 17 07:16:53.218168 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:16:53.218137    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6fc85c6965-tvm89"
Jul 17 07:17:17.686357 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:17:17.686329    2546 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 07:18:35.597869 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.597834    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69bc96598-dpjrt"]
Jul 17 07:18:35.601415 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.601395    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.604131 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.604109    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 07:18:35.609699 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.609653    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fgp5z\""
Jul 17 07:18:35.610066 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.610049    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 07:18:35.610711 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.610695    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 07:18:35.610766 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.610710    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 07:18:35.610809 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.610772    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 07:18:35.610856 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.610804    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 07:18:35.611034 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.611020    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 07:18:35.618203 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.618181    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69bc96598-dpjrt"]
Jul 17 07:18:35.618592 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.618574    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 17 07:18:35.692915 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.692877    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48a61b08-ab4a-40df-aacc-2352dcde00c4-console-oauth-config\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.693129 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.692944    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-service-ca\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.693129 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.693031    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p9td\" (UniqueName: \"kubernetes.io/projected/48a61b08-ab4a-40df-aacc-2352dcde00c4-kube-api-access-7p9td\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.693129 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.693071    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-console-config\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.693129 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.693119    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-oauth-serving-cert\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.693323 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.693151    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-trusted-ca-bundle\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.693323 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.693210    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48a61b08-ab4a-40df-aacc-2352dcde00c4-console-serving-cert\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.794120 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.794076    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p9td\" (UniqueName: \"kubernetes.io/projected/48a61b08-ab4a-40df-aacc-2352dcde00c4-kube-api-access-7p9td\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.794120 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.794116    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-console-config\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.794384 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.794145    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-oauth-serving-cert\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.794384 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.794265    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-trusted-ca-bundle\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.794384 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.794329    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48a61b08-ab4a-40df-aacc-2352dcde00c4-console-serving-cert\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.794384 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.794371    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48a61b08-ab4a-40df-aacc-2352dcde00c4-console-oauth-config\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.794594 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.794436    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-service-ca\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.794946 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.794922    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-console-config\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.795062 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.794973    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-oauth-serving-cert\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.795110 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.795082    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-service-ca\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.795213 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.795196    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48a61b08-ab4a-40df-aacc-2352dcde00c4-trusted-ca-bundle\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.796920 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.796899    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48a61b08-ab4a-40df-aacc-2352dcde00c4-console-serving-cert\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.797029 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.797012    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48a61b08-ab4a-40df-aacc-2352dcde00c4-console-oauth-config\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.802514 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.802481    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p9td\" (UniqueName: \"kubernetes.io/projected/48a61b08-ab4a-40df-aacc-2352dcde00c4-kube-api-access-7p9td\") pod \"console-69bc96598-dpjrt\" (UID: \"48a61b08-ab4a-40df-aacc-2352dcde00c4\") " pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:35.911241 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:35.911158    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:36.045066 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:36.044943    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69bc96598-dpjrt"]
Jul 17 07:18:36.047950 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:18:36.047924    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a61b08_ab4a_40df_aacc_2352dcde00c4.slice/crio-9ee7568862f13c7b25b9d85cad0fa94e329fe4a670cbc52fc2d147d08d05f54a WatchSource:0}: Error finding container 9ee7568862f13c7b25b9d85cad0fa94e329fe4a670cbc52fc2d147d08d05f54a: Status 404 returned error can't find the container with id 9ee7568862f13c7b25b9d85cad0fa94e329fe4a670cbc52fc2d147d08d05f54a
Jul 17 07:18:36.731928 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:36.731885    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69bc96598-dpjrt" event={"ID":"48a61b08-ab4a-40df-aacc-2352dcde00c4","Type":"ContainerStarted","Data":"5b73321d66893face621fbb7e752472151678bd485d7c70064145edcc9168df9"}
Jul 17 07:18:36.732321 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:36.731972    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69bc96598-dpjrt" event={"ID":"48a61b08-ab4a-40df-aacc-2352dcde00c4","Type":"ContainerStarted","Data":"9ee7568862f13c7b25b9d85cad0fa94e329fe4a670cbc52fc2d147d08d05f54a"}
Jul 17 07:18:36.758645 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:36.758589    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69bc96598-dpjrt" podStartSLOduration=1.758571154 podStartE2EDuration="1.758571154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:18:36.758239069 +0000 UTC m=+379.564436256" watchObservedRunningTime="2026-07-17 07:18:36.758571154 +0000 UTC m=+379.564768329"
Jul 17 07:18:39.132583 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.132552    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"]
Jul 17 07:18:39.136028 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.136007    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:18:39.138526 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.138496    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 07:18:39.138620 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.138544    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pvj5d\""
Jul 17 07:18:39.138620 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.138559    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 07:18:39.148213 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.148194    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"]
Jul 17 07:18:39.225850 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.225805    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4qnh\" (UniqueName: \"kubernetes.io/projected/f53d83ed-1fc7-456b-8ab9-6e0366828deb-kube-api-access-d4qnh\") pod \"kuadrant-operator-controller-manager-86878c769f-kdg47\" (UID: \"f53d83ed-1fc7-456b-8ab9-6e0366828deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:18:39.226017 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.225877    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f53d83ed-1fc7-456b-8ab9-6e0366828deb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kdg47\" (UID: \"f53d83ed-1fc7-456b-8ab9-6e0366828deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:18:39.327118 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.327074    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4qnh\" (UniqueName: \"kubernetes.io/projected/f53d83ed-1fc7-456b-8ab9-6e0366828deb-kube-api-access-d4qnh\") pod \"kuadrant-operator-controller-manager-86878c769f-kdg47\" (UID: \"f53d83ed-1fc7-456b-8ab9-6e0366828deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:18:39.327304 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.327148    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f53d83ed-1fc7-456b-8ab9-6e0366828deb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kdg47\" (UID: \"f53d83ed-1fc7-456b-8ab9-6e0366828deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:18:39.327587 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.327567    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f53d83ed-1fc7-456b-8ab9-6e0366828deb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kdg47\" (UID: \"f53d83ed-1fc7-456b-8ab9-6e0366828deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:18:39.338318 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.338289    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4qnh\" (UniqueName: \"kubernetes.io/projected/f53d83ed-1fc7-456b-8ab9-6e0366828deb-kube-api-access-d4qnh\") pod \"kuadrant-operator-controller-manager-86878c769f-kdg47\" (UID: \"f53d83ed-1fc7-456b-8ab9-6e0366828deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:18:39.447078 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.446998    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:18:39.586726 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.586693    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"]
Jul 17 07:18:39.590134 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:18:39.590105    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53d83ed_1fc7_456b_8ab9_6e0366828deb.slice/crio-377e124f630acef9501bdf936af3bbaf087dec37acf560a02a804c522a434da3 WatchSource:0}: Error finding container 377e124f630acef9501bdf936af3bbaf087dec37acf560a02a804c522a434da3: Status 404 returned error can't find the container with id 377e124f630acef9501bdf936af3bbaf087dec37acf560a02a804c522a434da3
Jul 17 07:18:39.592879 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.592861    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 07:18:39.746825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:39.746737    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47" event={"ID":"f53d83ed-1fc7-456b-8ab9-6e0366828deb","Type":"ContainerStarted","Data":"377e124f630acef9501bdf936af3bbaf087dec37acf560a02a804c522a434da3"}
Jul 17 07:18:44.774370 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:44.774334    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47" event={"ID":"f53d83ed-1fc7-456b-8ab9-6e0366828deb","Type":"ContainerStarted","Data":"3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e"}
Jul 17 07:18:44.774866 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:44.774473    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:18:44.795255 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:44.795195    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47" podStartSLOduration=1.410118464 podStartE2EDuration="5.795177756s" totalImagesPullingTime="4.385059292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:18:44.792973927 +0000 UTC m=+387.599171101" watchObservedRunningTime="2026-07-17 07:18:44.795177756 +0000 UTC m=+387.601374931"
Jul 17 07:18:45.911399 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:45.911368    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:45.911822 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:45.911418    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:45.916131 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:45.916108    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:46.789722 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:46.789661    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69bc96598-dpjrt"
Jul 17 07:18:55.783226 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:18:55.783191    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:19:15.321450 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:15.321412    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vzsfk"]
Jul 17 07:19:15.324983 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:15.324960    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vzsfk"
Jul 17 07:19:15.327370 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:15.327350    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2kklx\""
Jul 17 07:19:15.332934 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:15.332911    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vzsfk"]
Jul 17 07:19:15.457889 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:15.457856    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwdwn\" (UniqueName: \"kubernetes.io/projected/a13b517c-c5b2-4a22-968f-72f5623be323-kube-api-access-fwdwn\") pod \"authorino-75d556bd77-vzsfk\" (UID: \"a13b517c-c5b2-4a22-968f-72f5623be323\") " pod="kuadrant-system/authorino-75d556bd77-vzsfk"
Jul 17 07:19:15.559364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:15.559308    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwdwn\" (UniqueName: \"kubernetes.io/projected/a13b517c-c5b2-4a22-968f-72f5623be323-kube-api-access-fwdwn\") pod \"authorino-75d556bd77-vzsfk\" (UID: \"a13b517c-c5b2-4a22-968f-72f5623be323\") " pod="kuadrant-system/authorino-75d556bd77-vzsfk"
Jul 17 07:19:15.568275 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:15.568248    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwdwn\" (UniqueName: \"kubernetes.io/projected/a13b517c-c5b2-4a22-968f-72f5623be323-kube-api-access-fwdwn\") pod \"authorino-75d556bd77-vzsfk\" (UID: \"a13b517c-c5b2-4a22-968f-72f5623be323\") " pod="kuadrant-system/authorino-75d556bd77-vzsfk"
Jul 17 07:19:15.636094 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:15.636011    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vzsfk"
Jul 17 07:19:15.780915 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:15.780878    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vzsfk"]
Jul 17 07:19:15.784115 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:19:15.784086    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda13b517c_c5b2_4a22_968f_72f5623be323.slice/crio-8e9d423f42a8ff570fd381c3987c5925adfd00ac9661fdb90ed9fe19ddd89ff5 WatchSource:0}: Error finding container 8e9d423f42a8ff570fd381c3987c5925adfd00ac9661fdb90ed9fe19ddd89ff5: Status 404 returned error can't find the container with id 8e9d423f42a8ff570fd381c3987c5925adfd00ac9661fdb90ed9fe19ddd89ff5
Jul 17 07:19:15.919417 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:15.919336    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vzsfk" event={"ID":"a13b517c-c5b2-4a22-968f-72f5623be323","Type":"ContainerStarted","Data":"8e9d423f42a8ff570fd381c3987c5925adfd00ac9661fdb90ed9fe19ddd89ff5"}
Jul 17 07:19:19.947204 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:19.947167    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vzsfk" event={"ID":"a13b517c-c5b2-4a22-968f-72f5623be323","Type":"ContainerStarted","Data":"2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b"}
Jul 17 07:19:19.963923 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:19.963874    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vzsfk" podStartSLOduration=1.730526172 podStartE2EDuration="4.963858975s" totalImagesPullingTime="3.233332803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:19:19.962455432 +0000 UTC m=+422.768652608" watchObservedRunningTime="2026-07-17 07:19:19.963858975 +0000 UTC m=+422.770056151"
Jul 17 07:19:56.588854 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:56.588774    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vzsfk"]
Jul 17 07:19:56.589420 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:56.588986    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vzsfk" podUID="a13b517c-c5b2-4a22-968f-72f5623be323" containerName="authorino" containerID="cri-o://2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b" gracePeriod=30
Jul 17 07:19:56.825883 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:56.825854    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vzsfk"
Jul 17 07:19:56.946542 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:56.946454    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwdwn\" (UniqueName: \"kubernetes.io/projected/a13b517c-c5b2-4a22-968f-72f5623be323-kube-api-access-fwdwn\") pod \"a13b517c-c5b2-4a22-968f-72f5623be323\" (UID: \"a13b517c-c5b2-4a22-968f-72f5623be323\") "
Jul 17 07:19:56.948796 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:56.948767    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a13b517c-c5b2-4a22-968f-72f5623be323-kube-api-access-fwdwn" (OuterVolumeSpecName: "kube-api-access-fwdwn") pod "a13b517c-c5b2-4a22-968f-72f5623be323" (UID: "a13b517c-c5b2-4a22-968f-72f5623be323"). InnerVolumeSpecName "kube-api-access-fwdwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 07:19:57.047843 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:57.047814    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwdwn\" (UniqueName: \"kubernetes.io/projected/a13b517c-c5b2-4a22-968f-72f5623be323-kube-api-access-fwdwn\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:19:57.119763 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:57.119727    2546 generic.go:356] "Generic (PLEG): container finished" podID="a13b517c-c5b2-4a22-968f-72f5623be323" containerID="2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b" exitCode=0
Jul 17 07:19:57.119904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:57.119773    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vzsfk"
Jul 17 07:19:57.119904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:57.119781    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vzsfk" event={"ID":"a13b517c-c5b2-4a22-968f-72f5623be323","Type":"ContainerDied","Data":"2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b"}
Jul 17 07:19:57.119904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:57.119818    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vzsfk" event={"ID":"a13b517c-c5b2-4a22-968f-72f5623be323","Type":"ContainerDied","Data":"8e9d423f42a8ff570fd381c3987c5925adfd00ac9661fdb90ed9fe19ddd89ff5"}
Jul 17 07:19:57.119904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:57.119841    2546 scope.go:117] "RemoveContainer" containerID="2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b"
Jul 17 07:19:57.131366 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:57.131338    2546 scope.go:117] "RemoveContainer" containerID="2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b"
Jul 17 07:19:57.131925 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:19:57.131904    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b\": container with ID starting with 2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b not found: ID does not exist" containerID="2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b"
Jul 17 07:19:57.132042 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:57.131937    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b"} err="failed to get container status \"2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b\": rpc error: code = NotFound desc = could not find container \"2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b\": container with ID starting with 2dd06466effb917c6a9467446e7068af299683bd0dfb846f0136531dcdbe5e7b not found: ID does not exist"
Jul 17 07:19:57.143225 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:57.143200    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vzsfk"]
Jul 17 07:19:57.147158 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:57.147128    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vzsfk"]
Jul 17 07:19:57.909367 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:19:57.909333    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a13b517c-c5b2-4a22-968f-72f5623be323" path="/var/lib/kubelet/pods/a13b517c-c5b2-4a22-968f-72f5623be323/volumes"
Jul 17 07:20:01.423612 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.423583    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-775488c9d-2qc8t"]
Jul 17 07:20:01.423990 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.423948    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13b517c-c5b2-4a22-968f-72f5623be323" containerName="authorino"
Jul 17 07:20:01.423990 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.423959    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13b517c-c5b2-4a22-968f-72f5623be323" containerName="authorino"
Jul 17 07:20:01.424064 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.424036    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="a13b517c-c5b2-4a22-968f-72f5623be323" containerName="authorino"
Jul 17 07:20:01.426708 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.426690    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:01.429356 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.429331    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 07:20:01.429474 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.429337    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 07:20:01.429474 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.429454    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x65gb\""
Jul 17 07:20:01.439154 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.439128    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-775488c9d-2qc8t"]
Jul 17 07:20:01.490500 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.490464    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-webhook-cert\") pod \"maas-controller-775488c9d-2qc8t\" (UID: \"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb\") " pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:01.490653 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.490523    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmwmm\" (UniqueName: \"kubernetes.io/projected/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-kube-api-access-xmwmm\") pod \"maas-controller-775488c9d-2qc8t\" (UID: \"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb\") " pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:01.591825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.591778    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmwmm\" (UniqueName: \"kubernetes.io/projected/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-kube-api-access-xmwmm\") pod \"maas-controller-775488c9d-2qc8t\" (UID: \"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb\") " pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:01.591980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.591885    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-webhook-cert\") pod \"maas-controller-775488c9d-2qc8t\" (UID: \"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb\") " pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:01.592023 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:20:01.591991    2546 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 17 07:20:01.592072 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:20:01.592061    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-webhook-cert podName:75eab708-11a9-48a4-a0ca-8d3e19b9d0bb nodeName:}" failed. No retries permitted until 2026-07-17 07:20:02.092042143 +0000 UTC m=+464.898239299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-webhook-cert") pod "maas-controller-775488c9d-2qc8t" (UID: "75eab708-11a9-48a4-a0ca-8d3e19b9d0bb") : secret "maas-controller-webhook-cert" not found
Jul 17 07:20:01.601041 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:01.601016    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmwmm\" (UniqueName: \"kubernetes.io/projected/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-kube-api-access-xmwmm\") pod \"maas-controller-775488c9d-2qc8t\" (UID: \"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb\") " pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:02.097878 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:02.097842    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-webhook-cert\") pod \"maas-controller-775488c9d-2qc8t\" (UID: \"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb\") " pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:02.100228 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:02.100201    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-webhook-cert\") pod \"maas-controller-775488c9d-2qc8t\" (UID: \"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb\") " pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:02.336269 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:02.336236    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:02.469733 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:02.469703    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-775488c9d-2qc8t"]
Jul 17 07:20:03.150849 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:03.150804    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-775488c9d-2qc8t" event={"ID":"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb","Type":"ContainerStarted","Data":"8091890f9ef654835e7d82a4c5a54ef43f3c0d62842d1d80254944ae2d32bf19"}
Jul 17 07:20:05.163015 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:05.162918    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-775488c9d-2qc8t" event={"ID":"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb","Type":"ContainerStarted","Data":"6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7"}
Jul 17 07:20:05.163397 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:05.163105    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:05.185769 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:05.185721    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-775488c9d-2qc8t" podStartSLOduration=1.746406329 podStartE2EDuration="4.185705027s" totalImagesPullingTime="2.439298698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:20:05.184811006 +0000 UTC m=+467.991008192" watchObservedRunningTime="2026-07-17 07:20:05.185705027 +0000 UTC m=+467.991902203"
Jul 17 07:20:16.170165 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:16.170131    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:16.632219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:16.632184    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-775488c9d-2qc8t"]
Jul 17 07:20:16.632400 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:16.632353    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-775488c9d-2qc8t" podUID="75eab708-11a9-48a4-a0ca-8d3e19b9d0bb" containerName="manager" containerID="cri-o://6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7" gracePeriod=30
Jul 17 07:20:16.874768 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:16.874743    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:17.036764 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.036731    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-webhook-cert\") pod \"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb\" (UID: \"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb\") "
Jul 17 07:20:17.036932 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.036771    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmwmm\" (UniqueName: \"kubernetes.io/projected/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-kube-api-access-xmwmm\") pod \"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb\" (UID: \"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb\") "
Jul 17 07:20:17.039010 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.038975    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "75eab708-11a9-48a4-a0ca-8d3e19b9d0bb" (UID: "75eab708-11a9-48a4-a0ca-8d3e19b9d0bb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 07:20:17.039138 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.039013    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-kube-api-access-xmwmm" (OuterVolumeSpecName: "kube-api-access-xmwmm") pod "75eab708-11a9-48a4-a0ca-8d3e19b9d0bb" (UID: "75eab708-11a9-48a4-a0ca-8d3e19b9d0bb"). InnerVolumeSpecName "kube-api-access-xmwmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 07:20:17.138028 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.137996    2546 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-webhook-cert\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:20:17.138028 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.138023    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmwmm\" (UniqueName: \"kubernetes.io/projected/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb-kube-api-access-xmwmm\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:20:17.220941 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.220907    2546 generic.go:356] "Generic (PLEG): container finished" podID="75eab708-11a9-48a4-a0ca-8d3e19b9d0bb" containerID="6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7" exitCode=0
Jul 17 07:20:17.221382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.220952    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-775488c9d-2qc8t"
Jul 17 07:20:17.221382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.220974    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-775488c9d-2qc8t" event={"ID":"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb","Type":"ContainerDied","Data":"6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7"}
Jul 17 07:20:17.221382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.221015    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-775488c9d-2qc8t" event={"ID":"75eab708-11a9-48a4-a0ca-8d3e19b9d0bb","Type":"ContainerDied","Data":"8091890f9ef654835e7d82a4c5a54ef43f3c0d62842d1d80254944ae2d32bf19"}
Jul 17 07:20:17.221382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.221036    2546 scope.go:117] "RemoveContainer" containerID="6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7"
Jul 17 07:20:17.230080 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.230062    2546 scope.go:117] "RemoveContainer" containerID="6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7"
Jul 17 07:20:17.230322 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:20:17.230304    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7\": container with ID starting with 6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7 not found: ID does not exist" containerID="6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7"
Jul 17 07:20:17.230381 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.230329    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7"} err="failed to get container status \"6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7\": rpc error: code = NotFound desc = could not find container \"6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7\": container with ID starting with 6ab3fe90c3c28fb4129f3fde56610c8910711aeae7fa5b10e10a6085fbda05c7 not found: ID does not exist"
Jul 17 07:20:17.243404 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.243370    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-775488c9d-2qc8t"]
Jul 17 07:20:17.246063 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.246042    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-775488c9d-2qc8t"]
Jul 17 07:20:17.905093 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:17.905057    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75eab708-11a9-48a4-a0ca-8d3e19b9d0bb" path="/var/lib/kubelet/pods/75eab708-11a9-48a4-a0ca-8d3e19b9d0bb/volumes"
Jul 17 07:20:40.083330 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.083290    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-d6nbw"]
Jul 17 07:20:40.083820 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.083662    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75eab708-11a9-48a4-a0ca-8d3e19b9d0bb" containerName="manager"
Jul 17 07:20:40.083820 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.083686    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="75eab708-11a9-48a4-a0ca-8d3e19b9d0bb" containerName="manager"
Jul 17 07:20:40.083820 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.083758    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="75eab708-11a9-48a4-a0ca-8d3e19b9d0bb" containerName="manager"
Jul 17 07:20:40.086041 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.086024    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw"
Jul 17 07:20:40.089020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.088985    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5xnjd\""
Jul 17 07:20:40.089196 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.089176    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 07:20:40.097627 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.097601    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-d6nbw"]
Jul 17 07:20:40.154446 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.154414    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df5ef7e8-5135-463d-b389-cb50ab2056fd-plugins-config-volume\") pod \"payload-processing-5bf47cd988-d6nbw\" (UID: \"df5ef7e8-5135-463d-b389-cb50ab2056fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw"
Jul 17 07:20:40.154624 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.154469    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9tjq\" (UniqueName: \"kubernetes.io/projected/df5ef7e8-5135-463d-b389-cb50ab2056fd-kube-api-access-p9tjq\") pod \"payload-processing-5bf47cd988-d6nbw\" (UID: \"df5ef7e8-5135-463d-b389-cb50ab2056fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw"
Jul 17 07:20:40.255465 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.255421    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df5ef7e8-5135-463d-b389-cb50ab2056fd-plugins-config-volume\") pod \"payload-processing-5bf47cd988-d6nbw\" (UID: \"df5ef7e8-5135-463d-b389-cb50ab2056fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw"
Jul 17 07:20:40.255643 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.255483    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9tjq\" (UniqueName: \"kubernetes.io/projected/df5ef7e8-5135-463d-b389-cb50ab2056fd-kube-api-access-p9tjq\") pod \"payload-processing-5bf47cd988-d6nbw\" (UID: \"df5ef7e8-5135-463d-b389-cb50ab2056fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw"
Jul 17 07:20:40.256260 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.256240    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df5ef7e8-5135-463d-b389-cb50ab2056fd-plugins-config-volume\") pod \"payload-processing-5bf47cd988-d6nbw\" (UID: \"df5ef7e8-5135-463d-b389-cb50ab2056fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw"
Jul 17 07:20:40.285123 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.285087    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9tjq\" (UniqueName: \"kubernetes.io/projected/df5ef7e8-5135-463d-b389-cb50ab2056fd-kube-api-access-p9tjq\") pod \"payload-processing-5bf47cd988-d6nbw\" (UID: \"df5ef7e8-5135-463d-b389-cb50ab2056fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw"
Jul 17 07:20:40.397901 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.397813    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw"
Jul 17 07:20:40.531515 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:40.531480    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-d6nbw"]
Jul 17 07:20:40.534802 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:20:40.534752    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf5ef7e8_5135_463d_b389_cb50ab2056fd.slice/crio-4f6c2add98e4a1d72623e7acd3417de98541a7eef8421f2cbda8816c8f767bd9 WatchSource:0}: Error finding container 4f6c2add98e4a1d72623e7acd3417de98541a7eef8421f2cbda8816c8f767bd9: Status 404 returned error can't find the container with id 4f6c2add98e4a1d72623e7acd3417de98541a7eef8421f2cbda8816c8f767bd9
Jul 17 07:20:41.340006 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:41.339958    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw" event={"ID":"df5ef7e8-5135-463d-b389-cb50ab2056fd","Type":"ContainerStarted","Data":"4f6c2add98e4a1d72623e7acd3417de98541a7eef8421f2cbda8816c8f767bd9"}
Jul 17 07:20:42.346252 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:42.346216    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw" event={"ID":"df5ef7e8-5135-463d-b389-cb50ab2056fd","Type":"ContainerStarted","Data":"982227daa5fca61979502b8276684ac79f6c1897626dbd1f3dd5540a7aa73383"}
Jul 17 07:20:42.346777 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:42.346338    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw"
Jul 17 07:20:53.353610 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:53.353578    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw"
Jul 17 07:20:53.373037 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:20:53.372981    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-d6nbw" podStartSLOduration=11.952233423 podStartE2EDuration="13.372959698s" totalImagesPullingTime="1.420726275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:20:42.36399269 +0000 UTC m=+505.170189879" watchObservedRunningTime="2026-07-17 07:20:53.372959698 +0000 UTC m=+516.179156872"
Jul 17 07:21:37.826923 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.826889    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"]
Jul 17 07:21:37.831234 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.831211    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:37.834191 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.834171    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 07:21:37.834298 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.834171    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 07:21:37.835341 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.835324    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z7wkz\""
Jul 17 07:21:37.835418 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.835373    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 07:21:37.845906 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.845883    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"]
Jul 17 07:21:37.985684 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.985645    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42mks\" (UniqueName: \"kubernetes.io/projected/26797b83-d784-43cc-98e2-3b6ff6a6c98d-kube-api-access-42mks\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:37.985857 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.985738    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26797b83-d784-43cc-98e2-3b6ff6a6c98d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:37.985857 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.985759    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:37.985857 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.985774    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:37.985857 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.985817    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:37.985857 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:37.985852    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.086994 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.086897    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26797b83-d784-43cc-98e2-3b6ff6a6c98d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.086994 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.086933    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.086994 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.086952    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.087291 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.087059    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.087291 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.087101    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.087291 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.087235    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42mks\" (UniqueName: \"kubernetes.io/projected/26797b83-d784-43cc-98e2-3b6ff6a6c98d-kube-api-access-42mks\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.087446 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.087380    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.087504 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.087435    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.087504 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.087465    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.089329 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.089304    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26797b83-d784-43cc-98e2-3b6ff6a6c98d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.089600 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.089580    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26797b83-d784-43cc-98e2-3b6ff6a6c98d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.096801 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.096778    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42mks\" (UniqueName: \"kubernetes.io/projected/26797b83-d784-43cc-98e2-3b6ff6a6c98d-kube-api-access-42mks\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd\" (UID: \"26797b83-d784-43cc-98e2-3b6ff6a6c98d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.142874 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.142826    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:38.280197 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.280165    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"]
Jul 17 07:21:38.283779 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:21:38.283751    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26797b83_d784_43cc_98e2_3b6ff6a6c98d.slice/crio-3bc56b121b395f6fc71458e84ff96a681b4409cb9f67ee5cd31888edf4f1babf WatchSource:0}: Error finding container 3bc56b121b395f6fc71458e84ff96a681b4409cb9f67ee5cd31888edf4f1babf: Status 404 returned error can't find the container with id 3bc56b121b395f6fc71458e84ff96a681b4409cb9f67ee5cd31888edf4f1babf
Jul 17 07:21:38.614757 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:38.614714    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd" event={"ID":"26797b83-d784-43cc-98e2-3b6ff6a6c98d","Type":"ContainerStarted","Data":"3bc56b121b395f6fc71458e84ff96a681b4409cb9f67ee5cd31888edf4f1babf"}
Jul 17 07:21:39.621098 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:39.620988    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd" event={"ID":"26797b83-d784-43cc-98e2-3b6ff6a6c98d","Type":"ContainerStarted","Data":"f633a797131c4ea8bb8d9cd9a7bcf26a1d32fddcc868b99603088b414963d5f7"}
Jul 17 07:21:39.642750 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:39.642698    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd" podStartSLOduration=1.558800838 podStartE2EDuration="2.64265921s" totalImagesPullingTime="1.083858372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:21:39.641900923 +0000 UTC m=+562.448098099" watchObservedRunningTime="2026-07-17 07:21:39.64265921 +0000 UTC m=+562.448856463"
Jul 17 07:21:48.143006 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.142965    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:48.143601 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.143077    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:48.156534 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.156504    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:48.636733 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.636703    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"]
Jul 17 07:21:48.640678 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.640644    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.643439 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.643415    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 17 07:21:48.651587 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.651560    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"]
Jul 17 07:21:48.679143 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.679116    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd"
Jul 17 07:21:48.685306 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.685282    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.685426 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.685333    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.685426 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.685359    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.685426 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.685394    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.685541 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.685423    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.685584 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.685536    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h56h8\" (UniqueName: \"kubernetes.io/projected/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-kube-api-access-h56h8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.786173 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.786136    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h56h8\" (UniqueName: \"kubernetes.io/projected/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-kube-api-access-h56h8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.786342 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.786203    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.786342 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.786229    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.786342 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.786244    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.786342 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.786273    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.786342 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.786302    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.786615 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.786587    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.786784 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.786758    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.786784 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.786769    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.788524 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.788505    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.788725 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.788708    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.797049 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.797016    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h56h8\" (UniqueName: \"kubernetes.io/projected/828cb4f7-cb62-4fd2-99b4-bee41ec6112b-kube-api-access-h56h8\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh\" (UID: \"828cb4f7-cb62-4fd2-99b4-bee41ec6112b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:48.950202 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:48.950101    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:49.083552 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:49.083527    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"]
Jul 17 07:21:49.085026 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:21:49.084995    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod828cb4f7_cb62_4fd2_99b4_bee41ec6112b.slice/crio-abb71d6346381cb9241905418f8cb664e8926bde0c2d4c7fa810b8fd2d9147d6 WatchSource:0}: Error finding container abb71d6346381cb9241905418f8cb664e8926bde0c2d4c7fa810b8fd2d9147d6: Status 404 returned error can't find the container with id abb71d6346381cb9241905418f8cb664e8926bde0c2d4c7fa810b8fd2d9147d6
Jul 17 07:21:49.671004 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:49.670912    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh" event={"ID":"828cb4f7-cb62-4fd2-99b4-bee41ec6112b","Type":"ContainerStarted","Data":"5284448402f4f3cea22cd4dac71edac826385558d81f05e19941874268bf6864"}
Jul 17 07:21:49.671004 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:49.670953    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh" event={"ID":"828cb4f7-cb62-4fd2-99b4-bee41ec6112b","Type":"ContainerStarted","Data":"abb71d6346381cb9241905418f8cb664e8926bde0c2d4c7fa810b8fd2d9147d6"}
Jul 17 07:21:49.688072 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:49.688018    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh" podStartSLOduration=1.376540562 podStartE2EDuration="1.688002543s" totalImagesPullingTime="311.461981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:21:49.687063553 +0000 UTC m=+572.493260732" watchObservedRunningTime="2026-07-17 07:21:49.688002543 +0000 UTC m=+572.494199717"
Jul 17 07:21:58.951103 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:58.951066    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:58.951103 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:58.951111    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:58.963710 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:58.963686    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:21:59.733872 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:21:59.733842    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh"
Jul 17 07:22:37.568779 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.568739    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cbc987ffb-mh7m7"]
Jul 17 07:22:37.572392 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.572371    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cbc987ffb-mh7m7"
Jul 17 07:22:37.575710 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.575688    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2kklx\""
Jul 17 07:22:37.575823 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.575719    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 07:22:37.579949 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.579924    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cbc987ffb-mh7m7"]
Jul 17 07:22:37.650310 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.650277    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/061e93d7-6d96-4ec2-b941-3353df9ba2ef-tls-cert\") pod \"authorino-5cbc987ffb-mh7m7\" (UID: \"061e93d7-6d96-4ec2-b941-3353df9ba2ef\") " pod="kuadrant-system/authorino-5cbc987ffb-mh7m7"
Jul 17 07:22:37.650503 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.650338    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9p7t\" (UniqueName: \"kubernetes.io/projected/061e93d7-6d96-4ec2-b941-3353df9ba2ef-kube-api-access-d9p7t\") pod \"authorino-5cbc987ffb-mh7m7\" (UID: \"061e93d7-6d96-4ec2-b941-3353df9ba2ef\") " pod="kuadrant-system/authorino-5cbc987ffb-mh7m7"
Jul 17 07:22:37.751970 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.751929    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/061e93d7-6d96-4ec2-b941-3353df9ba2ef-tls-cert\") pod \"authorino-5cbc987ffb-mh7m7\" (UID: \"061e93d7-6d96-4ec2-b941-3353df9ba2ef\") " pod="kuadrant-system/authorino-5cbc987ffb-mh7m7"
Jul 17 07:22:37.752179 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.751983    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9p7t\" (UniqueName: \"kubernetes.io/projected/061e93d7-6d96-4ec2-b941-3353df9ba2ef-kube-api-access-d9p7t\") pod \"authorino-5cbc987ffb-mh7m7\" (UID: \"061e93d7-6d96-4ec2-b941-3353df9ba2ef\") " pod="kuadrant-system/authorino-5cbc987ffb-mh7m7"
Jul 17 07:22:37.754431 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.754405    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/061e93d7-6d96-4ec2-b941-3353df9ba2ef-tls-cert\") pod \"authorino-5cbc987ffb-mh7m7\" (UID: \"061e93d7-6d96-4ec2-b941-3353df9ba2ef\") " pod="kuadrant-system/authorino-5cbc987ffb-mh7m7"
Jul 17 07:22:37.760396 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.760376    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9p7t\" (UniqueName: \"kubernetes.io/projected/061e93d7-6d96-4ec2-b941-3353df9ba2ef-kube-api-access-d9p7t\") pod \"authorino-5cbc987ffb-mh7m7\" (UID: \"061e93d7-6d96-4ec2-b941-3353df9ba2ef\") " pod="kuadrant-system/authorino-5cbc987ffb-mh7m7"
Jul 17 07:22:37.882818 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:37.882730    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cbc987ffb-mh7m7"
Jul 17 07:22:38.037280 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:38.037255    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cbc987ffb-mh7m7"]
Jul 17 07:22:38.039202 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:22:38.039175    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod061e93d7_6d96_4ec2_b941_3353df9ba2ef.slice/crio-27673c7e69dea84c2a7a8771fc1ef394c95aa56c00778227e6f5cf1f210b343a WatchSource:0}: Error finding container 27673c7e69dea84c2a7a8771fc1ef394c95aa56c00778227e6f5cf1f210b343a: Status 404 returned error can't find the container with id 27673c7e69dea84c2a7a8771fc1ef394c95aa56c00778227e6f5cf1f210b343a
Jul 17 07:22:38.916805 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:38.916714    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cbc987ffb-mh7m7" event={"ID":"061e93d7-6d96-4ec2-b941-3353df9ba2ef","Type":"ContainerStarted","Data":"54419f2eb5bf03fb6f8bb09b35bbf61c5b829cfccf83a2e3168a257704d14367"}
Jul 17 07:22:38.916805 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:38.916768    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cbc987ffb-mh7m7" event={"ID":"061e93d7-6d96-4ec2-b941-3353df9ba2ef","Type":"ContainerStarted","Data":"27673c7e69dea84c2a7a8771fc1ef394c95aa56c00778227e6f5cf1f210b343a"}
Jul 17 07:22:38.934309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:22:38.934257    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cbc987ffb-mh7m7" podStartSLOduration=1.197088195 podStartE2EDuration="1.934240424s" totalImagesPullingTime="737.152229ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:22:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:22:38.933281026 +0000 UTC m=+621.739478227" watchObservedRunningTime="2026-07-17 07:22:38.934240424 +0000 UTC m=+621.740437598"
Jul 17 07:29:40.638926 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:40.638894    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"]
Jul 17 07:29:40.641644 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:40.639135    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47" podUID="f53d83ed-1fc7-456b-8ab9-6e0366828deb" containerName="manager" containerID="cri-o://3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e" gracePeriod=10
Jul 17 07:29:44.500790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:44.500764    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:29:44.636724 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:44.636619    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f53d83ed-1fc7-456b-8ab9-6e0366828deb-extensions-socket-volume\") pod \"f53d83ed-1fc7-456b-8ab9-6e0366828deb\" (UID: \"f53d83ed-1fc7-456b-8ab9-6e0366828deb\") "
Jul 17 07:29:44.636724 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:44.636662    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4qnh\" (UniqueName: \"kubernetes.io/projected/f53d83ed-1fc7-456b-8ab9-6e0366828deb-kube-api-access-d4qnh\") pod \"f53d83ed-1fc7-456b-8ab9-6e0366828deb\" (UID: \"f53d83ed-1fc7-456b-8ab9-6e0366828deb\") "
Jul 17 07:29:44.637001 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:44.636979    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f53d83ed-1fc7-456b-8ab9-6e0366828deb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f53d83ed-1fc7-456b-8ab9-6e0366828deb" (UID: "f53d83ed-1fc7-456b-8ab9-6e0366828deb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 07:29:44.638769 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:44.638746    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f53d83ed-1fc7-456b-8ab9-6e0366828deb-kube-api-access-d4qnh" (OuterVolumeSpecName: "kube-api-access-d4qnh") pod "f53d83ed-1fc7-456b-8ab9-6e0366828deb" (UID: "f53d83ed-1fc7-456b-8ab9-6e0366828deb"). InnerVolumeSpecName "kube-api-access-d4qnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 07:29:44.738066 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:44.738024    2546 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f53d83ed-1fc7-456b-8ab9-6e0366828deb-extensions-socket-volume\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:29:44.738066 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:44.738056    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4qnh\" (UniqueName: \"kubernetes.io/projected/f53d83ed-1fc7-456b-8ab9-6e0366828deb-kube-api-access-d4qnh\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:29:45.073577 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:45.073542    2546 generic.go:356] "Generic (PLEG): container finished" podID="f53d83ed-1fc7-456b-8ab9-6e0366828deb" containerID="3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e" exitCode=0
Jul 17 07:29:45.073803 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:45.073584    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"
Jul 17 07:29:45.073803 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:45.073598    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47" event={"ID":"f53d83ed-1fc7-456b-8ab9-6e0366828deb","Type":"ContainerDied","Data":"3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e"}
Jul 17 07:29:45.073803 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:45.073650    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47" event={"ID":"f53d83ed-1fc7-456b-8ab9-6e0366828deb","Type":"ContainerDied","Data":"377e124f630acef9501bdf936af3bbaf087dec37acf560a02a804c522a434da3"}
Jul 17 07:29:45.073803 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:45.073705    2546 scope.go:117] "RemoveContainer" containerID="3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e"
Jul 17 07:29:45.083630 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:45.083611    2546 scope.go:117] "RemoveContainer" containerID="3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e"
Jul 17 07:29:45.083909 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:29:45.083889    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e\": container with ID starting with 3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e not found: ID does not exist" containerID="3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e"
Jul 17 07:29:45.083955 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:45.083920    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e"} err="failed to get container status \"3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e\": rpc error: code = NotFound desc = could not find container \"3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e\": container with ID starting with 3acf20cf30129ad36977d31b04388e1fc4088f4659f90711be2a8f47d9ab6b4e not found: ID does not exist"
Jul 17 07:29:45.096584 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:45.096559    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"]
Jul 17 07:29:45.100701 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:45.100677    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kdg47"]
Jul 17 07:29:45.904445 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:29:45.904412    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f53d83ed-1fc7-456b-8ab9-6e0366828deb" path="/var/lib/kubelet/pods/f53d83ed-1fc7-456b-8ab9-6e0366828deb/volumes"
Jul 17 07:30:00.227017 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:00.226980    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7"]
Jul 17 07:30:00.227410 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:00.227367    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f53d83ed-1fc7-456b-8ab9-6e0366828deb" containerName="manager"
Jul 17 07:30:00.227410 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:00.227378    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f53d83ed-1fc7-456b-8ab9-6e0366828deb" containerName="manager"
Jul 17 07:30:00.227480 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:00.227447    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="f53d83ed-1fc7-456b-8ab9-6e0366828deb" containerName="manager"
Jul 17 07:30:00.232112 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:00.232093    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7"
Jul 17 07:30:00.237227 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:00.237206    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:30:00.241740 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:00.241721    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7"
Jul 17 07:30:00.259281 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:00.259248    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7"]
Jul 17 07:30:00.584426 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:00.584380    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7"]
Jul 17 07:30:00.586768 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:30:00.586726    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bf8c5c_8f9c_413f_a73f_c6d6a50610ed.slice/crio-a86fadd84d8ef0942326ad0b711a76b37dc2595dbfd4b2f09872293f634d24cb WatchSource:0}: Error finding container a86fadd84d8ef0942326ad0b711a76b37dc2595dbfd4b2f09872293f634d24cb: Status 404 returned error can't find the container with id a86fadd84d8ef0942326ad0b711a76b37dc2595dbfd4b2f09872293f634d24cb
Jul 17 07:30:00.588800 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:00.588781    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 07:30:01.153140 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:01.153105    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7" event={"ID":"f0bf8c5c-8f9c-413f-a73f-c6d6a50610ed","Type":"ContainerStarted","Data":"a86fadd84d8ef0942326ad0b711a76b37dc2595dbfd4b2f09872293f634d24cb"}
Jul 17 07:30:03.171325 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:03.171289    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7" event={"ID":"f0bf8c5c-8f9c-413f-a73f-c6d6a50610ed","Type":"ContainerStarted","Data":"12ed41985dcff23dcd6df78d057074702d0b04b560c3de695ec84e480ffc1f4a"}
Jul 17 07:30:03.188222 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:03.188168    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7" podStartSLOduration=1.037124064 podStartE2EDuration="3.188147404s" totalImagesPullingTime="2.15102334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:30:03.18754751 +0000 UTC m=+1065.993744686" watchObservedRunningTime="2026-07-17 07:30:03.188147404 +0000 UTC m=+1065.994344602"
Jul 17 07:30:04.179284 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:04.179192    2546 generic.go:356] "Generic (PLEG): container finished" podID="f0bf8c5c-8f9c-413f-a73f-c6d6a50610ed" containerID="12ed41985dcff23dcd6df78d057074702d0b04b560c3de695ec84e480ffc1f4a" exitCode=0
Jul 17 07:30:04.179284 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:04.179234    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7" event={"ID":"f0bf8c5c-8f9c-413f-a73f-c6d6a50610ed","Type":"ContainerDied","Data":"12ed41985dcff23dcd6df78d057074702d0b04b560c3de695ec84e480ffc1f4a"}
Jul 17 07:30:05.353580 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:05.353548    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7"
Jul 17 07:30:06.193650 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:06.193571    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7"
Jul 17 07:30:06.193650 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:06.193611    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737890-r2gr7" event={"ID":"f0bf8c5c-8f9c-413f-a73f-c6d6a50610ed","Type":"ContainerDied","Data":"a86fadd84d8ef0942326ad0b711a76b37dc2595dbfd4b2f09872293f634d24cb"}
Jul 17 07:30:06.193842 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:06.193658    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a86fadd84d8ef0942326ad0b711a76b37dc2595dbfd4b2f09872293f634d24cb"
Jul 17 07:30:41.822116 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.822079    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"]
Jul 17 07:30:41.822537 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.822494    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0bf8c5c-8f9c-413f-a73f-c6d6a50610ed" containerName="cleanup"
Jul 17 07:30:41.822537 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.822508    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bf8c5c-8f9c-413f-a73f-c6d6a50610ed" containerName="cleanup"
Jul 17 07:30:41.822633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.822621    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0bf8c5c-8f9c-413f-a73f-c6d6a50610ed" containerName="cleanup"
Jul 17 07:30:41.827533 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.827512    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"
Jul 17 07:30:41.830294 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.830272    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pvj5d\""
Jul 17 07:30:41.838710 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.838688    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"]
Jul 17 07:30:41.891703 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.891654    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/563d17bd-833a-4f3b-b75a-dc8bb3b073f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x6k72\" (UID: \"563d17bd-833a-4f3b-b75a-dc8bb3b073f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"
Jul 17 07:30:41.891875 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.891714    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mctm\" (UniqueName: \"kubernetes.io/projected/563d17bd-833a-4f3b-b75a-dc8bb3b073f0-kube-api-access-9mctm\") pod \"kuadrant-operator-controller-manager-86878c769f-x6k72\" (UID: \"563d17bd-833a-4f3b-b75a-dc8bb3b073f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"
Jul 17 07:30:41.992743 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.992696    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mctm\" (UniqueName: \"kubernetes.io/projected/563d17bd-833a-4f3b-b75a-dc8bb3b073f0-kube-api-access-9mctm\") pod \"kuadrant-operator-controller-manager-86878c769f-x6k72\" (UID: \"563d17bd-833a-4f3b-b75a-dc8bb3b073f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"
Jul 17 07:30:41.992921 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.992824    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/563d17bd-833a-4f3b-b75a-dc8bb3b073f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x6k72\" (UID: \"563d17bd-833a-4f3b-b75a-dc8bb3b073f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"
Jul 17 07:30:41.993222 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:41.993206    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/563d17bd-833a-4f3b-b75a-dc8bb3b073f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-x6k72\" (UID: \"563d17bd-833a-4f3b-b75a-dc8bb3b073f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"
Jul 17 07:30:42.002101 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:42.002071    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mctm\" (UniqueName: \"kubernetes.io/projected/563d17bd-833a-4f3b-b75a-dc8bb3b073f0-kube-api-access-9mctm\") pod \"kuadrant-operator-controller-manager-86878c769f-x6k72\" (UID: \"563d17bd-833a-4f3b-b75a-dc8bb3b073f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"
Jul 17 07:30:42.139092 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:42.139005    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"
Jul 17 07:30:42.275908 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:42.275846    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"]
Jul 17 07:30:42.278545 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:30:42.278515    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563d17bd_833a_4f3b_b75a_dc8bb3b073f0.slice/crio-3c43690770f5e2200794d6a720ca3f6435a136dd650c7c9c21965ac1845f11c4 WatchSource:0}: Error finding container 3c43690770f5e2200794d6a720ca3f6435a136dd650c7c9c21965ac1845f11c4: Status 404 returned error can't find the container with id 3c43690770f5e2200794d6a720ca3f6435a136dd650c7c9c21965ac1845f11c4
Jul 17 07:30:42.383076 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:42.383042    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72" event={"ID":"563d17bd-833a-4f3b-b75a-dc8bb3b073f0","Type":"ContainerStarted","Data":"4002af859359d69a68005a8b82167ea0c90821133274fc96691165b3bc7de650"}
Jul 17 07:30:42.383274 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:42.383101    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72" event={"ID":"563d17bd-833a-4f3b-b75a-dc8bb3b073f0","Type":"ContainerStarted","Data":"3c43690770f5e2200794d6a720ca3f6435a136dd650c7c9c21965ac1845f11c4"}
Jul 17 07:30:42.383274 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:42.383130    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"
Jul 17 07:30:42.419218 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:42.419108    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72" podStartSLOduration=1.41909182 podStartE2EDuration="1.41909182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:30:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:30:42.411512146 +0000 UTC m=+1105.217709321" watchObservedRunningTime="2026-07-17 07:30:42.41909182 +0000 UTC m=+1105.225288994"
Jul 17 07:30:53.389934 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:30:53.389901    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-x6k72"
Jul 17 07:36:48.027992 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:48.027951    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"]
Jul 17 07:36:48.031551 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:48.031531    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"
Jul 17 07:36:48.034025 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:48.034003    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:36:48.034139 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:48.034069    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:36:48.038153 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:48.038132    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"]
Jul 17 07:36:48.110023 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:48.109973    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01955456-d4a3-48cb-9965-dd436264f594-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf\" (UID: \"01955456-d4a3-48cb-9965-dd436264f594\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"
Jul 17 07:36:48.211549 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:48.211509    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01955456-d4a3-48cb-9965-dd436264f594-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf\" (UID: \"01955456-d4a3-48cb-9965-dd436264f594\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"
Jul 17 07:36:48.212236 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:48.212212    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01955456-d4a3-48cb-9965-dd436264f594-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf\" (UID: \"01955456-d4a3-48cb-9965-dd436264f594\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"
Jul 17 07:36:48.344601 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:48.344499    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"
Jul 17 07:36:48.475085 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:48.475059    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"]
Jul 17 07:36:48.478273 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:36:48.478240    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01955456_d4a3_48cb_9965_dd436264f594.slice/crio-fa4639f6d5d87bab4684d909e1f4314ac82c72594941a4ad79139fd65d194a48 WatchSource:0}: Error finding container fa4639f6d5d87bab4684d909e1f4314ac82c72594941a4ad79139fd65d194a48: Status 404 returned error can't find the container with id fa4639f6d5d87bab4684d909e1f4314ac82c72594941a4ad79139fd65d194a48
Jul 17 07:36:49.227898 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:49.227868    2546 generic.go:356] "Generic (PLEG): container finished" podID="01955456-d4a3-48cb-9965-dd436264f594" containerID="d4e7646a2b5808bd2ebefb41f93bb5cc3646416c4d940b4cff809141cf2043fd" exitCode=7
Jul 17 07:36:49.228240 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:49.227957    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf" event={"ID":"01955456-d4a3-48cb-9965-dd436264f594","Type":"ContainerDied","Data":"d4e7646a2b5808bd2ebefb41f93bb5cc3646416c4d940b4cff809141cf2043fd"}
Jul 17 07:36:49.228240 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:49.228012    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf" event={"ID":"01955456-d4a3-48cb-9965-dd436264f594","Type":"ContainerStarted","Data":"fa4639f6d5d87bab4684d909e1f4314ac82c72594941a4ad79139fd65d194a48"}
Jul 17 07:36:49.228240 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:49.228078    2546 scope.go:117] "RemoveContainer" containerID="d4e7646a2b5808bd2ebefb41f93bb5cc3646416c4d940b4cff809141cf2043fd"
Jul 17 07:36:50.234723 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:50.234606    2546 generic.go:356] "Generic (PLEG): container finished" podID="01955456-d4a3-48cb-9965-dd436264f594" containerID="251682204fb93a9d1f75bf60d8c90945aa4ed8cb31d74314cf0a23451e1c66d7" exitCode=7
Jul 17 07:36:50.234723 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:50.234696    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf" event={"ID":"01955456-d4a3-48cb-9965-dd436264f594","Type":"ContainerDied","Data":"251682204fb93a9d1f75bf60d8c90945aa4ed8cb31d74314cf0a23451e1c66d7"}
Jul 17 07:36:50.235239 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:50.234757    2546 scope.go:117] "RemoveContainer" containerID="d4e7646a2b5808bd2ebefb41f93bb5cc3646416c4d940b4cff809141cf2043fd"
Jul 17 07:36:50.235239 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:50.234969    2546 scope.go:117] "RemoveContainer" containerID="251682204fb93a9d1f75bf60d8c90945aa4ed8cb31d74314cf0a23451e1c66d7"
Jul 17 07:36:50.235239 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:36:50.235213    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf_odh-ai-gateway-infra(01955456-d4a3-48cb-9965-dd436264f594)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf" podUID="01955456-d4a3-48cb-9965-dd436264f594"
Jul 17 07:36:51.241266 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:36:51.241239    2546 scope.go:117] "RemoveContainer" containerID="251682204fb93a9d1f75bf60d8c90945aa4ed8cb31d74314cf0a23451e1c66d7"
Jul 17 07:36:51.241612 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:36:51.241457    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf_odh-ai-gateway-infra(01955456-d4a3-48cb-9965-dd436264f594)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf" podUID="01955456-d4a3-48cb-9965-dd436264f594"
Jul 17 07:37:01.899782 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:01.899751    2546 scope.go:117] "RemoveContainer" containerID="251682204fb93a9d1f75bf60d8c90945aa4ed8cb31d74314cf0a23451e1c66d7"
Jul 17 07:37:02.302214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:02.302178    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf" event={"ID":"01955456-d4a3-48cb-9965-dd436264f594","Type":"ContainerStarted","Data":"9956045212fab807c575855254415528c3d7a38b8db6aeb0137f0523138f8d7c"}
Jul 17 07:37:02.318344 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:02.318295    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf" podStartSLOduration=14.318281497 podStartE2EDuration="14.318281497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:36:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:37:02.317159584 +0000 UTC m=+1485.123356794" watchObservedRunningTime="2026-07-17 07:37:02.318281497 +0000 UTC m=+1485.124478673"
Jul 17 07:37:03.309040 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:03.309009    2546 generic.go:356] "Generic (PLEG): container finished" podID="01955456-d4a3-48cb-9965-dd436264f594" containerID="9956045212fab807c575855254415528c3d7a38b8db6aeb0137f0523138f8d7c" exitCode=7
Jul 17 07:37:03.309522 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:03.309084    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf" event={"ID":"01955456-d4a3-48cb-9965-dd436264f594","Type":"ContainerDied","Data":"9956045212fab807c575855254415528c3d7a38b8db6aeb0137f0523138f8d7c"}
Jul 17 07:37:03.309522 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:03.309145    2546 scope.go:117] "RemoveContainer" containerID="251682204fb93a9d1f75bf60d8c90945aa4ed8cb31d74314cf0a23451e1c66d7"
Jul 17 07:37:03.309522 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:03.309463    2546 scope.go:117] "RemoveContainer" containerID="9956045212fab807c575855254415528c3d7a38b8db6aeb0137f0523138f8d7c"
Jul 17 07:37:03.309762 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:37:03.309741    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf_odh-ai-gateway-infra(01955456-d4a3-48cb-9965-dd436264f594)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf" podUID="01955456-d4a3-48cb-9965-dd436264f594"
Jul 17 07:37:03.330545 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:03.330517    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"]
Jul 17 07:37:04.444558 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:04.444530    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"
Jul 17 07:37:04.472641 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:04.472612    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01955456-d4a3-48cb-9965-dd436264f594-maas-api-service-ca\") pod \"01955456-d4a3-48cb-9965-dd436264f594\" (UID: \"01955456-d4a3-48cb-9965-dd436264f594\") "
Jul 17 07:37:04.472983 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:04.472958    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01955456-d4a3-48cb-9965-dd436264f594-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "01955456-d4a3-48cb-9965-dd436264f594" (UID: "01955456-d4a3-48cb-9965-dd436264f594"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:37:04.574180 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:04.574075    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01955456-d4a3-48cb-9965-dd436264f594-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:37:05.321007 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:05.320978    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"
Jul 17 07:37:05.321180 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:05.320977    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf" event={"ID":"01955456-d4a3-48cb-9965-dd436264f594","Type":"ContainerDied","Data":"fa4639f6d5d87bab4684d909e1f4314ac82c72594941a4ad79139fd65d194a48"}
Jul 17 07:37:05.321180 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:05.321119    2546 scope.go:117] "RemoveContainer" containerID="9956045212fab807c575855254415528c3d7a38b8db6aeb0137f0523138f8d7c"
Jul 17 07:37:05.346472 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:05.346442    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"]
Jul 17 07:37:05.352127 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:05.352102    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-rqgzf"]
Jul 17 07:37:05.905378 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:05.905343    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01955456-d4a3-48cb-9965-dd436264f594" path="/var/lib/kubelet/pods/01955456-d4a3-48cb-9965-dd436264f594/volumes"
Jul 17 07:37:38.072008 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.071973    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"]
Jul 17 07:37:38.072428 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.072349    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01955456-d4a3-48cb-9965-dd436264f594" containerName="revoke-keys"
Jul 17 07:37:38.072428 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.072360    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="01955456-d4a3-48cb-9965-dd436264f594" containerName="revoke-keys"
Jul 17 07:37:38.072428 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.072373    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01955456-d4a3-48cb-9965-dd436264f594" containerName="revoke-keys"
Jul 17 07:37:38.072428 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.072379    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="01955456-d4a3-48cb-9965-dd436264f594" containerName="revoke-keys"
Jul 17 07:37:38.072560 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.072454    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="01955456-d4a3-48cb-9965-dd436264f594" containerName="revoke-keys"
Jul 17 07:37:38.072560 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.072463    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="01955456-d4a3-48cb-9965-dd436264f594" containerName="revoke-keys"
Jul 17 07:37:38.072560 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.072471    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="01955456-d4a3-48cb-9965-dd436264f594" containerName="revoke-keys"
Jul 17 07:37:38.076764 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.076743    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"
Jul 17 07:37:38.079486 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.079465    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:37:38.079605 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.079468    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:37:38.083373 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.083347    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"]
Jul 17 07:37:38.092197 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.092164    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9626a4-c558-40e4-a0d5-e145558f268b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv\" (UID: \"8b9626a4-c558-40e4-a0d5-e145558f268b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"
Jul 17 07:37:38.192755 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.192720    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9626a4-c558-40e4-a0d5-e145558f268b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv\" (UID: \"8b9626a4-c558-40e4-a0d5-e145558f268b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"
Jul 17 07:37:38.193451 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.193426    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9626a4-c558-40e4-a0d5-e145558f268b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv\" (UID: \"8b9626a4-c558-40e4-a0d5-e145558f268b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"
Jul 17 07:37:38.389431 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.389346    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"
Jul 17 07:37:38.520637 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:38.520609    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"]
Jul 17 07:37:38.522607 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:37:38.522582    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9626a4_c558_40e4_a0d5_e145558f268b.slice/crio-702524f69ab3db02abd619134bb3a00200f2e61f2a30b93e48df2760f064b0e0 WatchSource:0}: Error finding container 702524f69ab3db02abd619134bb3a00200f2e61f2a30b93e48df2760f064b0e0: Status 404 returned error can't find the container with id 702524f69ab3db02abd619134bb3a00200f2e61f2a30b93e48df2760f064b0e0
Jul 17 07:37:39.488334 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:39.488244    2546 generic.go:356] "Generic (PLEG): container finished" podID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerID="46ef0df3c22fd3242e7f93cd027eb07b86aaed2158b9121d04e839f772257f9f" exitCode=7
Jul 17 07:37:39.488334 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:39.488302    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv" event={"ID":"8b9626a4-c558-40e4-a0d5-e145558f268b","Type":"ContainerDied","Data":"46ef0df3c22fd3242e7f93cd027eb07b86aaed2158b9121d04e839f772257f9f"}
Jul 17 07:37:39.488873 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:39.488354    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv" event={"ID":"8b9626a4-c558-40e4-a0d5-e145558f268b","Type":"ContainerStarted","Data":"702524f69ab3db02abd619134bb3a00200f2e61f2a30b93e48df2760f064b0e0"}
Jul 17 07:37:39.488873 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:39.488575    2546 scope.go:117] "RemoveContainer" containerID="46ef0df3c22fd3242e7f93cd027eb07b86aaed2158b9121d04e839f772257f9f"
Jul 17 07:37:40.495646 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:40.495562    2546 generic.go:356] "Generic (PLEG): container finished" podID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerID="43cf09e29df4e07bdd7eba59947e9ff742109d40bca496aa71029769eb6484b4" exitCode=7
Jul 17 07:37:40.495646 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:40.495620    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv" event={"ID":"8b9626a4-c558-40e4-a0d5-e145558f268b","Type":"ContainerDied","Data":"43cf09e29df4e07bdd7eba59947e9ff742109d40bca496aa71029769eb6484b4"}
Jul 17 07:37:40.496114 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:40.495693    2546 scope.go:117] "RemoveContainer" containerID="46ef0df3c22fd3242e7f93cd027eb07b86aaed2158b9121d04e839f772257f9f"
Jul 17 07:37:40.496114 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:40.495915    2546 scope.go:117] "RemoveContainer" containerID="43cf09e29df4e07bdd7eba59947e9ff742109d40bca496aa71029769eb6484b4"
Jul 17 07:37:40.496179 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:37:40.496114    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv_odh-ai-gateway-infra(8b9626a4-c558-40e4-a0d5-e145558f268b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b"
Jul 17 07:37:41.503531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:41.503499    2546 scope.go:117] "RemoveContainer" containerID="43cf09e29df4e07bdd7eba59947e9ff742109d40bca496aa71029769eb6484b4"
Jul 17 07:37:41.503918 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:37:41.503701    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv_odh-ai-gateway-infra(8b9626a4-c558-40e4-a0d5-e145558f268b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b"
Jul 17 07:37:55.898985 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:55.898943    2546 scope.go:117] "RemoveContainer" containerID="43cf09e29df4e07bdd7eba59947e9ff742109d40bca496aa71029769eb6484b4"
Jul 17 07:37:56.579249 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:56.579215    2546 generic.go:356] "Generic (PLEG): container finished" podID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerID="c7a99e35d1c3fd9faa297592f8658ef950bcae62b00fbd2b5d80df2ad45a36d3" exitCode=7
Jul 17 07:37:56.579414 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:56.579291    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv" event={"ID":"8b9626a4-c558-40e4-a0d5-e145558f268b","Type":"ContainerDied","Data":"c7a99e35d1c3fd9faa297592f8658ef950bcae62b00fbd2b5d80df2ad45a36d3"}
Jul 17 07:37:56.579414 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:56.579357    2546 scope.go:117] "RemoveContainer" containerID="43cf09e29df4e07bdd7eba59947e9ff742109d40bca496aa71029769eb6484b4"
Jul 17 07:37:56.579653 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:56.579636    2546 scope.go:117] "RemoveContainer" containerID="c7a99e35d1c3fd9faa297592f8658ef950bcae62b00fbd2b5d80df2ad45a36d3"
Jul 17 07:37:56.579905 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:37:56.579885    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv_odh-ai-gateway-infra(8b9626a4-c558-40e4-a0d5-e145558f268b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b"
Jul 17 07:37:57.606169 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:57.606137    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"]
Jul 17 07:37:57.746023 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:57.746000    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"
Jul 17 07:37:57.874312 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:57.874231    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9626a4-c558-40e4-a0d5-e145558f268b-maas-api-service-ca\") pod \"8b9626a4-c558-40e4-a0d5-e145558f268b\" (UID: \"8b9626a4-c558-40e4-a0d5-e145558f268b\") "
Jul 17 07:37:57.874591 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:57.874569    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b9626a4-c558-40e4-a0d5-e145558f268b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b9626a4-c558-40e4-a0d5-e145558f268b" (UID: "8b9626a4-c558-40e4-a0d5-e145558f268b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:37:57.976065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:57.976027    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9626a4-c558-40e4-a0d5-e145558f268b-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:37:58.590777 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:58.590749    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"
Jul 17 07:37:58.590777 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:58.590766    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv" event={"ID":"8b9626a4-c558-40e4-a0d5-e145558f268b","Type":"ContainerDied","Data":"702524f69ab3db02abd619134bb3a00200f2e61f2a30b93e48df2760f064b0e0"}
Jul 17 07:37:58.591007 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:58.590823    2546 scope.go:117] "RemoveContainer" containerID="c7a99e35d1c3fd9faa297592f8658ef950bcae62b00fbd2b5d80df2ad45a36d3"
Jul 17 07:37:58.608300 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:58.608275    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"]
Jul 17 07:37:58.615871 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:58.615846    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-btjvv"]
Jul 17 07:37:59.904976 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:37:59.904944    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b" path="/var/lib/kubelet/pods/8b9626a4-c558-40e4-a0d5-e145558f268b/volumes"
Jul 17 07:38:38.117575 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.117541    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"]
Jul 17 07:38:38.118099 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.117966    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerName="revoke-keys"
Jul 17 07:38:38.118099 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.117984    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerName="revoke-keys"
Jul 17 07:38:38.118099 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.118008    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerName="revoke-keys"
Jul 17 07:38:38.118099 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.118026    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerName="revoke-keys"
Jul 17 07:38:38.118099 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.118051    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01955456-d4a3-48cb-9965-dd436264f594" containerName="revoke-keys"
Jul 17 07:38:38.118099 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.118059    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="01955456-d4a3-48cb-9965-dd436264f594" containerName="revoke-keys"
Jul 17 07:38:38.118308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.118172    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerName="revoke-keys"
Jul 17 07:38:38.118308 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.118184    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerName="revoke-keys"
Jul 17 07:38:38.122531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.122513    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"
Jul 17 07:38:38.125005 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.124985    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:38:38.125083 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.124985    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:38:38.130299 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.130276    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"]
Jul 17 07:38:38.257547 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.257511    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f6c739b-c94a-4240-9040-c491ef079759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx\" (UID: \"5f6c739b-c94a-4240-9040-c491ef079759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"
Jul 17 07:38:38.358408 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.358376    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f6c739b-c94a-4240-9040-c491ef079759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx\" (UID: \"5f6c739b-c94a-4240-9040-c491ef079759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"
Jul 17 07:38:38.359031 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.359011    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f6c739b-c94a-4240-9040-c491ef079759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx\" (UID: \"5f6c739b-c94a-4240-9040-c491ef079759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"
Jul 17 07:38:38.434437 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.434365    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"
Jul 17 07:38:38.565708 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.565678    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"]
Jul 17 07:38:38.568128 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:38:38.568101    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6c739b_c94a_4240_9040_c491ef079759.slice/crio-38212511d27dff49a2c6f07ce2243a73e9e5449820ad216934475a7ff58989d2 WatchSource:0}: Error finding container 38212511d27dff49a2c6f07ce2243a73e9e5449820ad216934475a7ff58989d2: Status 404 returned error can't find the container with id 38212511d27dff49a2c6f07ce2243a73e9e5449820ad216934475a7ff58989d2
Jul 17 07:38:38.788865 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:38.788836    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx" event={"ID":"5f6c739b-c94a-4240-9040-c491ef079759","Type":"ContainerStarted","Data":"38212511d27dff49a2c6f07ce2243a73e9e5449820ad216934475a7ff58989d2"}
Jul 17 07:38:39.795391 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:39.795355    2546 generic.go:356] "Generic (PLEG): container finished" podID="5f6c739b-c94a-4240-9040-c491ef079759" containerID="1c7aaa29e4060961458eb247867f022d1cb54e822f8af880cf4b7597767fa957" exitCode=7
Jul 17 07:38:39.795817 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:39.795442    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx" event={"ID":"5f6c739b-c94a-4240-9040-c491ef079759","Type":"ContainerDied","Data":"1c7aaa29e4060961458eb247867f022d1cb54e822f8af880cf4b7597767fa957"}
Jul 17 07:38:39.795817 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:39.795610    2546 scope.go:117] "RemoveContainer" containerID="1c7aaa29e4060961458eb247867f022d1cb54e822f8af880cf4b7597767fa957"
Jul 17 07:38:40.802400 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:40.802362    2546 generic.go:356] "Generic (PLEG): container finished" podID="5f6c739b-c94a-4240-9040-c491ef079759" containerID="95991150a5056b375cdb8523353c4a18353ef57707ebc999f6db720d82d723a3" exitCode=7
Jul 17 07:38:40.802873 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:40.802421    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx" event={"ID":"5f6c739b-c94a-4240-9040-c491ef079759","Type":"ContainerDied","Data":"95991150a5056b375cdb8523353c4a18353ef57707ebc999f6db720d82d723a3"}
Jul 17 07:38:40.802873 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:40.802483    2546 scope.go:117] "RemoveContainer" containerID="1c7aaa29e4060961458eb247867f022d1cb54e822f8af880cf4b7597767fa957"
Jul 17 07:38:40.802873 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:40.802699    2546 scope.go:117] "RemoveContainer" containerID="95991150a5056b375cdb8523353c4a18353ef57707ebc999f6db720d82d723a3"
Jul 17 07:38:40.803008 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:38:40.802944    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx_odh-ai-gateway-infra(5f6c739b-c94a-4240-9040-c491ef079759)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx" podUID="5f6c739b-c94a-4240-9040-c491ef079759"
Jul 17 07:38:41.809858 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:41.809827    2546 scope.go:117] "RemoveContainer" containerID="95991150a5056b375cdb8523353c4a18353ef57707ebc999f6db720d82d723a3"
Jul 17 07:38:41.810244 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:38:41.810036    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx_odh-ai-gateway-infra(5f6c739b-c94a-4240-9040-c491ef079759)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx" podUID="5f6c739b-c94a-4240-9040-c491ef079759"
Jul 17 07:38:54.899424 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:54.899384    2546 scope.go:117] "RemoveContainer" containerID="95991150a5056b375cdb8523353c4a18353ef57707ebc999f6db720d82d723a3"
Jul 17 07:38:55.892897 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:55.892858    2546 generic.go:356] "Generic (PLEG): container finished" podID="5f6c739b-c94a-4240-9040-c491ef079759" containerID="0b071d0b78ef85a57652d3530ce99757693853ac86f92e0f2b1ea3a3d3713a99" exitCode=7
Jul 17 07:38:55.893078 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:55.892910    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx" event={"ID":"5f6c739b-c94a-4240-9040-c491ef079759","Type":"ContainerDied","Data":"0b071d0b78ef85a57652d3530ce99757693853ac86f92e0f2b1ea3a3d3713a99"}
Jul 17 07:38:55.893078 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:55.892999    2546 scope.go:117] "RemoveContainer" containerID="95991150a5056b375cdb8523353c4a18353ef57707ebc999f6db720d82d723a3"
Jul 17 07:38:55.893263 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:55.893248    2546 scope.go:117] "RemoveContainer" containerID="0b071d0b78ef85a57652d3530ce99757693853ac86f92e0f2b1ea3a3d3713a99"
Jul 17 07:38:55.893483 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:38:55.893462    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx_odh-ai-gateway-infra(5f6c739b-c94a-4240-9040-c491ef079759)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx" podUID="5f6c739b-c94a-4240-9040-c491ef079759"
Jul 17 07:38:56.920124 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:56.920089    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"]
Jul 17 07:38:57.054134 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:57.054110    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"
Jul 17 07:38:57.135242 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:57.135204    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f6c739b-c94a-4240-9040-c491ef079759-maas-api-service-ca\") pod \"5f6c739b-c94a-4240-9040-c491ef079759\" (UID: \"5f6c739b-c94a-4240-9040-c491ef079759\") "
Jul 17 07:38:57.135635 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:57.135611    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f6c739b-c94a-4240-9040-c491ef079759-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5f6c739b-c94a-4240-9040-c491ef079759" (UID: "5f6c739b-c94a-4240-9040-c491ef079759"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:38:57.236137 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:57.236048    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f6c739b-c94a-4240-9040-c491ef079759-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:38:57.905563 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:57.905536    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"
Jul 17 07:38:57.905769 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:57.905566    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx" event={"ID":"5f6c739b-c94a-4240-9040-c491ef079759","Type":"ContainerDied","Data":"38212511d27dff49a2c6f07ce2243a73e9e5449820ad216934475a7ff58989d2"}
Jul 17 07:38:57.905769 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:57.905612    2546 scope.go:117] "RemoveContainer" containerID="0b071d0b78ef85a57652d3530ce99757693853ac86f92e0f2b1ea3a3d3713a99"
Jul 17 07:38:57.933309 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:57.933277    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"]
Jul 17 07:38:57.942141 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:57.940060    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-d4ttx"]
Jul 17 07:38:59.906056 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:38:59.906024    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f6c739b-c94a-4240-9040-c491ef079759" path="/var/lib/kubelet/pods/5f6c739b-c94a-4240-9040-c491ef079759/volumes"
Jul 17 07:39:28.158854 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.158818    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"]
Jul 17 07:39:28.159321 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.159212    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f6c739b-c94a-4240-9040-c491ef079759" containerName="revoke-keys"
Jul 17 07:39:28.159321 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.159224    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f6c739b-c94a-4240-9040-c491ef079759" containerName="revoke-keys"
Jul 17 07:39:28.159321 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.159233    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f6c739b-c94a-4240-9040-c491ef079759" containerName="revoke-keys"
Jul 17 07:39:28.159321 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.159239    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f6c739b-c94a-4240-9040-c491ef079759" containerName="revoke-keys"
Jul 17 07:39:28.159321 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.159257    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerName="revoke-keys"
Jul 17 07:39:28.159321 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.159262    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerName="revoke-keys"
Jul 17 07:39:28.159553 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.159330    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f6c739b-c94a-4240-9040-c491ef079759" containerName="revoke-keys"
Jul 17 07:39:28.159553 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.159341    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f6c739b-c94a-4240-9040-c491ef079759" containerName="revoke-keys"
Jul 17 07:39:28.159553 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.159348    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b9626a4-c558-40e4-a0d5-e145558f268b" containerName="revoke-keys"
Jul 17 07:39:28.159553 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.159354    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f6c739b-c94a-4240-9040-c491ef079759" containerName="revoke-keys"
Jul 17 07:39:28.163468 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.163451    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"
Jul 17 07:39:28.166317 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.166292    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:39:28.166489 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.166300    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:39:28.169821 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.169801    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"]
Jul 17 07:39:28.334499 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.334461    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f05422e-d7dd-4308-ab1f-c6b98f09ad9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-p2859\" (UID: \"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"
Jul 17 07:39:28.436105 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.436008    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f05422e-d7dd-4308-ab1f-c6b98f09ad9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-p2859\" (UID: \"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"
Jul 17 07:39:28.436636 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.436614    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f05422e-d7dd-4308-ab1f-c6b98f09ad9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-p2859\" (UID: \"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"
Jul 17 07:39:28.475947 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.475915    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"
Jul 17 07:39:28.610459 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:28.610424    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"]
Jul 17 07:39:28.613428 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:39:28.613397    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f05422e_d7dd_4308_ab1f_c6b98f09ad9a.slice/crio-172ea40e8f684c47b9eb9c7df410e50ead43215a5788525c1a89b5931bc1ef5b WatchSource:0}: Error finding container 172ea40e8f684c47b9eb9c7df410e50ead43215a5788525c1a89b5931bc1ef5b: Status 404 returned error can't find the container with id 172ea40e8f684c47b9eb9c7df410e50ead43215a5788525c1a89b5931bc1ef5b
Jul 17 07:39:29.062701 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:29.062569    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859" event={"ID":"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a","Type":"ContainerStarted","Data":"4374ae2f4c0d55eabbaf9f22eda884935d0ad8ed3015f6024b4150a2fb98a826"}
Jul 17 07:39:29.062701 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:29.062632    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859" event={"ID":"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a","Type":"ContainerStarted","Data":"172ea40e8f684c47b9eb9c7df410e50ead43215a5788525c1a89b5931bc1ef5b"}
Jul 17 07:39:29.080314 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:29.080265    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859" podStartSLOduration=1.080249939 podStartE2EDuration="1.080249939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:39:29.078586215 +0000 UTC m=+1631.884783401" watchObservedRunningTime="2026-07-17 07:39:29.080249939 +0000 UTC m=+1631.886447146"
Jul 17 07:39:30.069306 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:30.069272    2546 generic.go:356] "Generic (PLEG): container finished" podID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerID="4374ae2f4c0d55eabbaf9f22eda884935d0ad8ed3015f6024b4150a2fb98a826" exitCode=7
Jul 17 07:39:30.069732 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:30.069359    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859" event={"ID":"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a","Type":"ContainerDied","Data":"4374ae2f4c0d55eabbaf9f22eda884935d0ad8ed3015f6024b4150a2fb98a826"}
Jul 17 07:39:30.069732 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:30.069554    2546 scope.go:117] "RemoveContainer" containerID="4374ae2f4c0d55eabbaf9f22eda884935d0ad8ed3015f6024b4150a2fb98a826"
Jul 17 07:39:31.075495 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:31.075455    2546 generic.go:356] "Generic (PLEG): container finished" podID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerID="d4c32a60dac5e0286468bb662922ff1303cdcdac5a7e9faae21c5cce58b29e56" exitCode=7
Jul 17 07:39:31.075999 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:31.075541    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859" event={"ID":"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a","Type":"ContainerDied","Data":"d4c32a60dac5e0286468bb662922ff1303cdcdac5a7e9faae21c5cce58b29e56"}
Jul 17 07:39:31.075999 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:31.075597    2546 scope.go:117] "RemoveContainer" containerID="4374ae2f4c0d55eabbaf9f22eda884935d0ad8ed3015f6024b4150a2fb98a826"
Jul 17 07:39:31.075999 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:31.075894    2546 scope.go:117] "RemoveContainer" containerID="d4c32a60dac5e0286468bb662922ff1303cdcdac5a7e9faae21c5cce58b29e56"
Jul 17 07:39:31.082201 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:39:31.076474    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-p2859_odh-ai-gateway-infra(7f05422e-d7dd-4308-ab1f-c6b98f09ad9a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a"
Jul 17 07:39:32.082193 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:32.082163    2546 scope.go:117] "RemoveContainer" containerID="d4c32a60dac5e0286468bb662922ff1303cdcdac5a7e9faae21c5cce58b29e56"
Jul 17 07:39:32.082604 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:39:32.082366    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-p2859_odh-ai-gateway-infra(7f05422e-d7dd-4308-ab1f-c6b98f09ad9a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a"
Jul 17 07:39:43.898785 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:43.898751    2546 scope.go:117] "RemoveContainer" containerID="d4c32a60dac5e0286468bb662922ff1303cdcdac5a7e9faae21c5cce58b29e56"
Jul 17 07:39:44.145160 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:44.145127    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859" event={"ID":"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a","Type":"ContainerStarted","Data":"6e2074154a6c7f482469ea257b8fe5cfe57f8dc4a99bdda760810474602ccd04"}
Jul 17 07:39:45.152089 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:45.152051    2546 generic.go:356] "Generic (PLEG): container finished" podID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerID="6e2074154a6c7f482469ea257b8fe5cfe57f8dc4a99bdda760810474602ccd04" exitCode=7
Jul 17 07:39:45.152515 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:45.152118    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859" event={"ID":"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a","Type":"ContainerDied","Data":"6e2074154a6c7f482469ea257b8fe5cfe57f8dc4a99bdda760810474602ccd04"}
Jul 17 07:39:45.152515 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:45.152179    2546 scope.go:117] "RemoveContainer" containerID="d4c32a60dac5e0286468bb662922ff1303cdcdac5a7e9faae21c5cce58b29e56"
Jul 17 07:39:45.152515 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:45.152420    2546 scope.go:117] "RemoveContainer" containerID="6e2074154a6c7f482469ea257b8fe5cfe57f8dc4a99bdda760810474602ccd04"
Jul 17 07:39:45.152696 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:39:45.152651    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-p2859_odh-ai-gateway-infra(7f05422e-d7dd-4308-ab1f-c6b98f09ad9a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a"
Jul 17 07:39:45.175052 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:45.175023    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"]
Jul 17 07:39:46.294236 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:46.294204    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"
Jul 17 07:39:46.411212 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:46.411094    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f05422e-d7dd-4308-ab1f-c6b98f09ad9a-maas-api-service-ca\") pod \"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a\" (UID: \"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a\") "
Jul 17 07:39:46.411453 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:46.411432    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f05422e-d7dd-4308-ab1f-c6b98f09ad9a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" (UID: "7f05422e-d7dd-4308-ab1f-c6b98f09ad9a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:39:46.512567 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:46.512532    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f05422e-d7dd-4308-ab1f-c6b98f09ad9a-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:39:47.165562 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:47.165531    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"
Jul 17 07:39:47.165562 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:47.165547    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859" event={"ID":"7f05422e-d7dd-4308-ab1f-c6b98f09ad9a","Type":"ContainerDied","Data":"172ea40e8f684c47b9eb9c7df410e50ead43215a5788525c1a89b5931bc1ef5b"}
Jul 17 07:39:47.165818 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:47.165601    2546 scope.go:117] "RemoveContainer" containerID="6e2074154a6c7f482469ea257b8fe5cfe57f8dc4a99bdda760810474602ccd04"
Jul 17 07:39:47.186724 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:47.186697    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"]
Jul 17 07:39:47.191462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:47.191429    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-p2859"]
Jul 17 07:39:47.906686 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:39:47.906639    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" path="/var/lib/kubelet/pods/7f05422e-d7dd-4308-ab1f-c6b98f09ad9a/volumes"
Jul 17 07:40:01.070909 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.070870    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"]
Jul 17 07:40:01.071500 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.071481    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerName="revoke-keys"
Jul 17 07:40:01.071549 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.071503    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerName="revoke-keys"
Jul 17 07:40:01.071549 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.071514    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f6c739b-c94a-4240-9040-c491ef079759" containerName="revoke-keys"
Jul 17 07:40:01.071549 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.071522    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f6c739b-c94a-4240-9040-c491ef079759" containerName="revoke-keys"
Jul 17 07:40:01.071549 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.071537    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerName="revoke-keys"
Jul 17 07:40:01.071549 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.071546    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerName="revoke-keys"
Jul 17 07:40:01.071717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.071560    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerName="revoke-keys"
Jul 17 07:40:01.071717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.071568    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerName="revoke-keys"
Jul 17 07:40:01.071717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.071657    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerName="revoke-keys"
Jul 17 07:40:01.071717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.071685    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerName="revoke-keys"
Jul 17 07:40:01.071717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.071698    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f05422e-d7dd-4308-ab1f-c6b98f09ad9a" containerName="revoke-keys"
Jul 17 07:40:01.076330 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.076311    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"
Jul 17 07:40:01.079327 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.079094    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:40:01.080004 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.079983    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:40:01.081782 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.081759    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"]
Jul 17 07:40:01.262210 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.262171    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d701872b-f5ce-478b-9dbb-3b4e03bf07d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx\" (UID: \"d701872b-f5ce-478b-9dbb-3b4e03bf07d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"
Jul 17 07:40:01.362711 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.362589    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d701872b-f5ce-478b-9dbb-3b4e03bf07d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx\" (UID: \"d701872b-f5ce-478b-9dbb-3b4e03bf07d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"
Jul 17 07:40:01.363300 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.363279    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d701872b-f5ce-478b-9dbb-3b4e03bf07d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx\" (UID: \"d701872b-f5ce-478b-9dbb-3b4e03bf07d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"
Jul 17 07:40:01.390167 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.390120    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"
Jul 17 07:40:01.536563 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:01.536538    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"]
Jul 17 07:40:01.539031 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:40:01.539002    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd701872b_f5ce_478b_9dbb_3b4e03bf07d3.slice/crio-64b8b8da7a92051b1dfd622d11e9fa5fd756587435a7328b4505d60128b9fef6 WatchSource:0}: Error finding container 64b8b8da7a92051b1dfd622d11e9fa5fd756587435a7328b4505d60128b9fef6: Status 404 returned error can't find the container with id 64b8b8da7a92051b1dfd622d11e9fa5fd756587435a7328b4505d60128b9fef6
Jul 17 07:40:02.255005 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:02.254968    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx" event={"ID":"d701872b-f5ce-478b-9dbb-3b4e03bf07d3","Type":"ContainerStarted","Data":"843fd5b096ed116c3a495ef5ee2de6d66ab607a8940b639620e64d6b9da4c33b"}
Jul 17 07:40:02.255399 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:02.255019    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx" event={"ID":"d701872b-f5ce-478b-9dbb-3b4e03bf07d3","Type":"ContainerStarted","Data":"64b8b8da7a92051b1dfd622d11e9fa5fd756587435a7328b4505d60128b9fef6"}
Jul 17 07:40:02.273083 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:02.273036    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx" podStartSLOduration=1.273017483 podStartE2EDuration="1.273017483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:40:02.272109373 +0000 UTC m=+1665.078306548" watchObservedRunningTime="2026-07-17 07:40:02.273017483 +0000 UTC m=+1665.079214657"
Jul 17 07:40:03.262407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:03.262374    2546 generic.go:356] "Generic (PLEG): container finished" podID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerID="843fd5b096ed116c3a495ef5ee2de6d66ab607a8940b639620e64d6b9da4c33b" exitCode=7
Jul 17 07:40:03.262407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:03.262410    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx" event={"ID":"d701872b-f5ce-478b-9dbb-3b4e03bf07d3","Type":"ContainerDied","Data":"843fd5b096ed116c3a495ef5ee2de6d66ab607a8940b639620e64d6b9da4c33b"}
Jul 17 07:40:03.262843 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:03.262643    2546 scope.go:117] "RemoveContainer" containerID="843fd5b096ed116c3a495ef5ee2de6d66ab607a8940b639620e64d6b9da4c33b"
Jul 17 07:40:04.269919 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:04.269884    2546 generic.go:356] "Generic (PLEG): container finished" podID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerID="1b09994285b6079cf389fa4cea9841876237f81ab15b298581bef1d0c4c7862c" exitCode=7
Jul 17 07:40:04.270328 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:04.269950    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx" event={"ID":"d701872b-f5ce-478b-9dbb-3b4e03bf07d3","Type":"ContainerDied","Data":"1b09994285b6079cf389fa4cea9841876237f81ab15b298581bef1d0c4c7862c"}
Jul 17 07:40:04.270328 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:04.270002    2546 scope.go:117] "RemoveContainer" containerID="843fd5b096ed116c3a495ef5ee2de6d66ab607a8940b639620e64d6b9da4c33b"
Jul 17 07:40:04.270328 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:04.270223    2546 scope.go:117] "RemoveContainer" containerID="1b09994285b6079cf389fa4cea9841876237f81ab15b298581bef1d0c4c7862c"
Jul 17 07:40:04.270508 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:40:04.270486    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx_odh-ai-gateway-infra(d701872b-f5ce-478b-9dbb-3b4e03bf07d3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3"
Jul 17 07:40:05.277054 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:05.277029    2546 scope.go:117] "RemoveContainer" containerID="1b09994285b6079cf389fa4cea9841876237f81ab15b298581bef1d0c4c7862c"
Jul 17 07:40:05.277442 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:40:05.277210    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx_odh-ai-gateway-infra(d701872b-f5ce-478b-9dbb-3b4e03bf07d3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3"
Jul 17 07:40:17.902449 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:17.902419    2546 scope.go:117] "RemoveContainer" containerID="1b09994285b6079cf389fa4cea9841876237f81ab15b298581bef1d0c4c7862c"
Jul 17 07:40:18.202809 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:18.202775    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"]
Jul 17 07:40:18.206253 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:18.206234    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"
Jul 17 07:40:18.214510 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:18.214484    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"]
Jul 17 07:40:18.324599 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:18.324558    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e30948-50e7-4dd3-8600-9248a7e573cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt\" (UID: \"61e30948-50e7-4dd3-8600-9248a7e573cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"
Jul 17 07:40:18.346124 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:18.346084    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx" event={"ID":"d701872b-f5ce-478b-9dbb-3b4e03bf07d3","Type":"ContainerStarted","Data":"63bbcf95bdb83dce3dd33904ff62a6c290c88cfb0fc257791e3d09341f4f7bb7"}
Jul 17 07:40:18.425744 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:18.425709    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e30948-50e7-4dd3-8600-9248a7e573cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt\" (UID: \"61e30948-50e7-4dd3-8600-9248a7e573cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"
Jul 17 07:40:18.426428 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:18.426367    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e30948-50e7-4dd3-8600-9248a7e573cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt\" (UID: \"61e30948-50e7-4dd3-8600-9248a7e573cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"
Jul 17 07:40:18.518608 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:18.518576    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"
Jul 17 07:40:18.655447 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:18.655378    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"]
Jul 17 07:40:18.657889 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:40:18.657863    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e30948_50e7_4dd3_8600_9248a7e573cb.slice/crio-ffb6198a8b1613995b26727eeac1fe225f776efd5508c25f74fb6c25ecfba106 WatchSource:0}: Error finding container ffb6198a8b1613995b26727eeac1fe225f776efd5508c25f74fb6c25ecfba106: Status 404 returned error can't find the container with id ffb6198a8b1613995b26727eeac1fe225f776efd5508c25f74fb6c25ecfba106
Jul 17 07:40:19.352550 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:19.352515    2546 generic.go:356] "Generic (PLEG): container finished" podID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerID="63bbcf95bdb83dce3dd33904ff62a6c290c88cfb0fc257791e3d09341f4f7bb7" exitCode=7
Jul 17 07:40:19.352989 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:19.352584    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx" event={"ID":"d701872b-f5ce-478b-9dbb-3b4e03bf07d3","Type":"ContainerDied","Data":"63bbcf95bdb83dce3dd33904ff62a6c290c88cfb0fc257791e3d09341f4f7bb7"}
Jul 17 07:40:19.352989 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:19.352642    2546 scope.go:117] "RemoveContainer" containerID="1b09994285b6079cf389fa4cea9841876237f81ab15b298581bef1d0c4c7862c"
Jul 17 07:40:19.352989 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:19.352905    2546 scope.go:117] "RemoveContainer" containerID="63bbcf95bdb83dce3dd33904ff62a6c290c88cfb0fc257791e3d09341f4f7bb7"
Jul 17 07:40:19.353179 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:40:19.353160    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx_odh-ai-gateway-infra(d701872b-f5ce-478b-9dbb-3b4e03bf07d3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3"
Jul 17 07:40:19.354261 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:19.354240    2546 generic.go:356] "Generic (PLEG): container finished" podID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerID="362f4ac66923bf8b5ba55a469ea10b48bd97ff1b1c1a98e0c7f79e74e9823e52" exitCode=6
Jul 17 07:40:19.354338 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:19.354277    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt" event={"ID":"61e30948-50e7-4dd3-8600-9248a7e573cb","Type":"ContainerDied","Data":"362f4ac66923bf8b5ba55a469ea10b48bd97ff1b1c1a98e0c7f79e74e9823e52"}
Jul 17 07:40:19.354338 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:19.354315    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt" event={"ID":"61e30948-50e7-4dd3-8600-9248a7e573cb","Type":"ContainerStarted","Data":"ffb6198a8b1613995b26727eeac1fe225f776efd5508c25f74fb6c25ecfba106"}
Jul 17 07:40:19.354503 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:19.354491    2546 scope.go:117] "RemoveContainer" containerID="362f4ac66923bf8b5ba55a469ea10b48bd97ff1b1c1a98e0c7f79e74e9823e52"
Jul 17 07:40:19.378729 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:19.378707    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"]
Jul 17 07:40:20.361086 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:20.361000    2546 generic.go:356] "Generic (PLEG): container finished" podID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerID="cbe1685d467f8aeba9a1629c6f0e43ad9280e530f3c3a99294ad0369043549e2" exitCode=6
Jul 17 07:40:20.361555 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:20.361080    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt" event={"ID":"61e30948-50e7-4dd3-8600-9248a7e573cb","Type":"ContainerDied","Data":"cbe1685d467f8aeba9a1629c6f0e43ad9280e530f3c3a99294ad0369043549e2"}
Jul 17 07:40:20.361555 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:20.361141    2546 scope.go:117] "RemoveContainer" containerID="362f4ac66923bf8b5ba55a469ea10b48bd97ff1b1c1a98e0c7f79e74e9823e52"
Jul 17 07:40:20.361555 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:20.361377    2546 scope.go:117] "RemoveContainer" containerID="cbe1685d467f8aeba9a1629c6f0e43ad9280e530f3c3a99294ad0369043549e2"
Jul 17 07:40:20.361761 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:40:20.361638    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt_odh-ai-gateway-infra(61e30948-50e7-4dd3-8600-9248a7e573cb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb"
Jul 17 07:40:20.500318 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:20.500293    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"
Jul 17 07:40:20.647791 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:20.647709    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d701872b-f5ce-478b-9dbb-3b4e03bf07d3-maas-api-service-ca\") pod \"d701872b-f5ce-478b-9dbb-3b4e03bf07d3\" (UID: \"d701872b-f5ce-478b-9dbb-3b4e03bf07d3\") "
Jul 17 07:40:20.648097 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:20.648074    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d701872b-f5ce-478b-9dbb-3b4e03bf07d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d701872b-f5ce-478b-9dbb-3b4e03bf07d3" (UID: "d701872b-f5ce-478b-9dbb-3b4e03bf07d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:40:20.749109 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:20.749060    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d701872b-f5ce-478b-9dbb-3b4e03bf07d3-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:40:21.368948 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:21.368920    2546 scope.go:117] "RemoveContainer" containerID="cbe1685d467f8aeba9a1629c6f0e43ad9280e530f3c3a99294ad0369043549e2"
Jul 17 07:40:21.369380 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:40:21.369167    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt_odh-ai-gateway-infra(61e30948-50e7-4dd3-8600-9248a7e573cb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb"
Jul 17 07:40:21.369947 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:21.369931    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"
Jul 17 07:40:21.370019 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:21.369961    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx" event={"ID":"d701872b-f5ce-478b-9dbb-3b4e03bf07d3","Type":"ContainerDied","Data":"64b8b8da7a92051b1dfd622d11e9fa5fd756587435a7328b4505d60128b9fef6"}
Jul 17 07:40:21.370019 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:21.370016    2546 scope.go:117] "RemoveContainer" containerID="63bbcf95bdb83dce3dd33904ff62a6c290c88cfb0fc257791e3d09341f4f7bb7"
Jul 17 07:40:21.398820 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:21.398792    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"]
Jul 17 07:40:21.403838 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:21.403816    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-mp8kx"]
Jul 17 07:40:21.905219 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:21.905187    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" path="/var/lib/kubelet/pods/d701872b-f5ce-478b-9dbb-3b4e03bf07d3/volumes"
Jul 17 07:40:31.899354 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:31.899316    2546 scope.go:117] "RemoveContainer" containerID="cbe1685d467f8aeba9a1629c6f0e43ad9280e530f3c3a99294ad0369043549e2"
Jul 17 07:40:32.430452 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:32.430369    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt" event={"ID":"61e30948-50e7-4dd3-8600-9248a7e573cb","Type":"ContainerStarted","Data":"78bf28a750a8852dbf8467d920b9b9b4c877efe9884d1b748b086a63d1bdb87f"}
Jul 17 07:40:32.449207 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:32.449146    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt" podStartSLOduration=14.449130204 podStartE2EDuration="14.449130204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:40:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:40:32.447351554 +0000 UTC m=+1695.253548729" watchObservedRunningTime="2026-07-17 07:40:32.449130204 +0000 UTC m=+1695.255327378"
Jul 17 07:40:33.437134 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:33.437100    2546 generic.go:356] "Generic (PLEG): container finished" podID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerID="78bf28a750a8852dbf8467d920b9b9b4c877efe9884d1b748b086a63d1bdb87f" exitCode=6
Jul 17 07:40:33.437565 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:33.437143    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt" event={"ID":"61e30948-50e7-4dd3-8600-9248a7e573cb","Type":"ContainerDied","Data":"78bf28a750a8852dbf8467d920b9b9b4c877efe9884d1b748b086a63d1bdb87f"}
Jul 17 07:40:33.437565 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:33.437191    2546 scope.go:117] "RemoveContainer" containerID="cbe1685d467f8aeba9a1629c6f0e43ad9280e530f3c3a99294ad0369043549e2"
Jul 17 07:40:33.437565 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:33.437499    2546 scope.go:117] "RemoveContainer" containerID="78bf28a750a8852dbf8467d920b9b9b4c877efe9884d1b748b086a63d1bdb87f"
Jul 17 07:40:33.437787 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:40:33.437768    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt_odh-ai-gateway-infra(61e30948-50e7-4dd3-8600-9248a7e573cb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb"
Jul 17 07:40:33.467214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:33.467177    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"]
Jul 17 07:40:34.579791 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:34.579763    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"
Jul 17 07:40:34.684999 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:34.684963    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e30948-50e7-4dd3-8600-9248a7e573cb-maas-api-service-ca\") pod \"61e30948-50e7-4dd3-8600-9248a7e573cb\" (UID: \"61e30948-50e7-4dd3-8600-9248a7e573cb\") "
Jul 17 07:40:34.685366 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:34.685342    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61e30948-50e7-4dd3-8600-9248a7e573cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "61e30948-50e7-4dd3-8600-9248a7e573cb" (UID: "61e30948-50e7-4dd3-8600-9248a7e573cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:40:34.786195 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:34.786161    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e30948-50e7-4dd3-8600-9248a7e573cb-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:40:35.449568 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:35.449531    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt" event={"ID":"61e30948-50e7-4dd3-8600-9248a7e573cb","Type":"ContainerDied","Data":"ffb6198a8b1613995b26727eeac1fe225f776efd5508c25f74fb6c25ecfba106"}
Jul 17 07:40:35.449568 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:35.449552    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"
Jul 17 07:40:35.449859 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:35.449591    2546 scope.go:117] "RemoveContainer" containerID="78bf28a750a8852dbf8467d920b9b9b4c877efe9884d1b748b086a63d1bdb87f"
Jul 17 07:40:35.471697 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:35.471652    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"]
Jul 17 07:40:35.476941 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:35.476917    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-r5qvt"]
Jul 17 07:40:35.906692 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:40:35.906633    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb" path="/var/lib/kubelet/pods/61e30948-50e7-4dd3-8600-9248a7e573cb/volumes"
Jul 17 07:41:01.129003 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.128965    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"]
Jul 17 07:41:01.129462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129349    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerName="revoke-keys"
Jul 17 07:41:01.129462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129359    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerName="revoke-keys"
Jul 17 07:41:01.129462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129370    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerName="revoke-keys"
Jul 17 07:41:01.129462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129375    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerName="revoke-keys"
Jul 17 07:41:01.129462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129386    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerName="revoke-keys"
Jul 17 07:41:01.129462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129391    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerName="revoke-keys"
Jul 17 07:41:01.129462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129398    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerName="revoke-keys"
Jul 17 07:41:01.129462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129403    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerName="revoke-keys"
Jul 17 07:41:01.129462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129412    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerName="revoke-keys"
Jul 17 07:41:01.129462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129417    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerName="revoke-keys"
Jul 17 07:41:01.129796 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129484    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerName="revoke-keys"
Jul 17 07:41:01.129796 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129489    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerName="revoke-keys"
Jul 17 07:41:01.129796 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129495    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerName="revoke-keys"
Jul 17 07:41:01.129796 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129503    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerName="revoke-keys"
Jul 17 07:41:01.129796 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.129509    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="d701872b-f5ce-478b-9dbb-3b4e03bf07d3" containerName="revoke-keys"
Jul 17 07:41:01.132662 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.132644    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"
Jul 17 07:41:01.136911 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.136891    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:41:01.136911 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.136899    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:41:01.149574 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.149537    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"]
Jul 17 07:41:01.245229 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.245188    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f9542f-6ff5-4acd-b27c-4c183ed60f66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-qb42n\" (UID: \"50f9542f-6ff5-4acd-b27c-4c183ed60f66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"
Jul 17 07:41:01.346190 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.346150    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f9542f-6ff5-4acd-b27c-4c183ed60f66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-qb42n\" (UID: \"50f9542f-6ff5-4acd-b27c-4c183ed60f66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"
Jul 17 07:41:01.346982 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.346961    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f9542f-6ff5-4acd-b27c-4c183ed60f66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-qb42n\" (UID: \"50f9542f-6ff5-4acd-b27c-4c183ed60f66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"
Jul 17 07:41:01.443077 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.442994    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"
Jul 17 07:41:01.582050 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:01.582025    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"]
Jul 17 07:41:01.583333 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:41:01.583307    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f9542f_6ff5_4acd_b27c_4c183ed60f66.slice/crio-a17fd79e95bb2961ae4dc7aa23b0f09cf5d82681157f30af02912d18fd5a3c51 WatchSource:0}: Error finding container a17fd79e95bb2961ae4dc7aa23b0f09cf5d82681157f30af02912d18fd5a3c51: Status 404 returned error can't find the container with id a17fd79e95bb2961ae4dc7aa23b0f09cf5d82681157f30af02912d18fd5a3c51
Jul 17 07:41:02.586894 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:02.586854    2546 generic.go:356] "Generic (PLEG): container finished" podID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerID="f6c6b6ad4d317b28f039070dd6045b45275ee183d6eb47c45bd9f64f7dbdad27" exitCode=7
Jul 17 07:41:02.587266 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:02.586922    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n" event={"ID":"50f9542f-6ff5-4acd-b27c-4c183ed60f66","Type":"ContainerDied","Data":"f6c6b6ad4d317b28f039070dd6045b45275ee183d6eb47c45bd9f64f7dbdad27"}
Jul 17 07:41:02.587266 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:02.587006    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n" event={"ID":"50f9542f-6ff5-4acd-b27c-4c183ed60f66","Type":"ContainerStarted","Data":"a17fd79e95bb2961ae4dc7aa23b0f09cf5d82681157f30af02912d18fd5a3c51"}
Jul 17 07:41:02.587266 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:02.587247    2546 scope.go:117] "RemoveContainer" containerID="f6c6b6ad4d317b28f039070dd6045b45275ee183d6eb47c45bd9f64f7dbdad27"
Jul 17 07:41:03.593738 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:03.593633    2546 generic.go:356] "Generic (PLEG): container finished" podID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerID="a4659423956f6663ee6a567edbdec503aa7cc10c47c530e55d839606543f3995" exitCode=7
Jul 17 07:41:03.593738 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:03.593702    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n" event={"ID":"50f9542f-6ff5-4acd-b27c-4c183ed60f66","Type":"ContainerDied","Data":"a4659423956f6663ee6a567edbdec503aa7cc10c47c530e55d839606543f3995"}
Jul 17 07:41:03.594175 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:03.593777    2546 scope.go:117] "RemoveContainer" containerID="f6c6b6ad4d317b28f039070dd6045b45275ee183d6eb47c45bd9f64f7dbdad27"
Jul 17 07:41:03.594175 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:03.593975    2546 scope.go:117] "RemoveContainer" containerID="a4659423956f6663ee6a567edbdec503aa7cc10c47c530e55d839606543f3995"
Jul 17 07:41:03.594258 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:41:03.594204    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-qb42n_odh-ai-gateway-infra(50f9542f-6ff5-4acd-b27c-4c183ed60f66)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66"
Jul 17 07:41:04.600978 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:04.600948    2546 scope.go:117] "RemoveContainer" containerID="a4659423956f6663ee6a567edbdec503aa7cc10c47c530e55d839606543f3995"
Jul 17 07:41:04.601371 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:41:04.601149    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-qb42n_odh-ai-gateway-infra(50f9542f-6ff5-4acd-b27c-4c183ed60f66)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66"
Jul 17 07:41:19.899626 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:19.899596    2546 scope.go:117] "RemoveContainer" containerID="a4659423956f6663ee6a567edbdec503aa7cc10c47c530e55d839606543f3995"
Jul 17 07:41:20.682939 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:20.682907    2546 generic.go:356] "Generic (PLEG): container finished" podID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerID="8284f17221666360e4ac58edca8aaef0998551b72e50d5d0581fa7e64ee7cc4d" exitCode=6
Jul 17 07:41:20.683111 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:20.682983    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n" event={"ID":"50f9542f-6ff5-4acd-b27c-4c183ed60f66","Type":"ContainerDied","Data":"8284f17221666360e4ac58edca8aaef0998551b72e50d5d0581fa7e64ee7cc4d"}
Jul 17 07:41:20.683111 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:20.683049    2546 scope.go:117] "RemoveContainer" containerID="a4659423956f6663ee6a567edbdec503aa7cc10c47c530e55d839606543f3995"
Jul 17 07:41:20.683335 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:20.683317    2546 scope.go:117] "RemoveContainer" containerID="8284f17221666360e4ac58edca8aaef0998551b72e50d5d0581fa7e64ee7cc4d"
Jul 17 07:41:20.683583 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:41:20.683563    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-qb42n_odh-ai-gateway-infra(50f9542f-6ff5-4acd-b27c-4c183ed60f66)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66"
Jul 17 07:41:21.717527 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:21.717490    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"]
Jul 17 07:41:21.855327 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:21.855298    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"
Jul 17 07:41:21.945197 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:21.945165    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f9542f-6ff5-4acd-b27c-4c183ed60f66-maas-api-service-ca\") pod \"50f9542f-6ff5-4acd-b27c-4c183ed60f66\" (UID: \"50f9542f-6ff5-4acd-b27c-4c183ed60f66\") "
Jul 17 07:41:21.945538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:21.945517    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f9542f-6ff5-4acd-b27c-4c183ed60f66-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "50f9542f-6ff5-4acd-b27c-4c183ed60f66" (UID: "50f9542f-6ff5-4acd-b27c-4c183ed60f66"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:41:22.046473 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:22.046432    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50f9542f-6ff5-4acd-b27c-4c183ed60f66-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:41:22.695072 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:22.695036    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n" event={"ID":"50f9542f-6ff5-4acd-b27c-4c183ed60f66","Type":"ContainerDied","Data":"a17fd79e95bb2961ae4dc7aa23b0f09cf5d82681157f30af02912d18fd5a3c51"}
Jul 17 07:41:22.695257 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:22.695097    2546 scope.go:117] "RemoveContainer" containerID="8284f17221666360e4ac58edca8aaef0998551b72e50d5d0581fa7e64ee7cc4d"
Jul 17 07:41:22.695257 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:22.695051    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"
Jul 17 07:41:22.718584 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:22.718556    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"]
Jul 17 07:41:22.724808 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:22.724786    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-qb42n"]
Jul 17 07:41:23.904682 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:41:23.904644    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" path="/var/lib/kubelet/pods/50f9542f-6ff5-4acd-b27c-4c183ed60f66/volumes"
Jul 17 07:42:14.965924 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.965835    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"]
Jul 17 07:42:14.966391 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.966261    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerName="revoke-keys"
Jul 17 07:42:14.966391 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.966275    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerName="revoke-keys"
Jul 17 07:42:14.966391 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.966284    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerName="revoke-keys"
Jul 17 07:42:14.966391 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.966289    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerName="revoke-keys"
Jul 17 07:42:14.966391 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.966298    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerName="revoke-keys"
Jul 17 07:42:14.966391 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.966304    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerName="revoke-keys"
Jul 17 07:42:14.966391 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.966311    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerName="revoke-keys"
Jul 17 07:42:14.966391 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.966316    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerName="revoke-keys"
Jul 17 07:42:14.966391 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.966396    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerName="revoke-keys"
Jul 17 07:42:14.966729 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.966403    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e30948-50e7-4dd3-8600-9248a7e573cb" containerName="revoke-keys"
Jul 17 07:42:14.966729 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.966416    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerName="revoke-keys"
Jul 17 07:42:14.969293 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.969277    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"
Jul 17 07:42:14.972414 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.972386    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:42:14.972414 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.972408    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:42:14.980054 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:14.980026    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"]
Jul 17 07:42:15.048608 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:15.048571    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b\" (UID: \"0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"
Jul 17 07:42:15.149717 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:15.149687    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b\" (UID: \"0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"
Jul 17 07:42:15.150254 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:15.150234    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b\" (UID: \"0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"
Jul 17 07:42:15.280873 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:15.280841    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"
Jul 17 07:42:15.416541 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:15.416455    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"]
Jul 17 07:42:15.420132 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:42:15.420105    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9bf617_8ad1_4119_810c_5e7f4d1d9f3f.slice/crio-571991f8275aa7f5a1d9462308adf3cdabbb39c860d76b8b683a9de5dbcef050 WatchSource:0}: Error finding container 571991f8275aa7f5a1d9462308adf3cdabbb39c860d76b8b683a9de5dbcef050: Status 404 returned error can't find the container with id 571991f8275aa7f5a1d9462308adf3cdabbb39c860d76b8b683a9de5dbcef050
Jul 17 07:42:15.958574 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:15.958466    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b" event={"ID":"0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f","Type":"ContainerStarted","Data":"a958159e8e6f28adfbd4e6a7a469e6581bc0a07edef9214ef5ce54fc322a3ef5"}
Jul 17 07:42:15.958574 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:15.958533    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b" event={"ID":"0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f","Type":"ContainerStarted","Data":"571991f8275aa7f5a1d9462308adf3cdabbb39c860d76b8b683a9de5dbcef050"}
Jul 17 07:42:15.975747 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:15.975699    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b" podStartSLOduration=1.975658258 podStartE2EDuration="1.975658258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:42:15.97532511 +0000 UTC m=+1798.781522282" watchObservedRunningTime="2026-07-17 07:42:15.975658258 +0000 UTC m=+1798.781855470"
Jul 17 07:42:16.965378 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:16.965342    2546 generic.go:356] "Generic (PLEG): container finished" podID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerID="a958159e8e6f28adfbd4e6a7a469e6581bc0a07edef9214ef5ce54fc322a3ef5" exitCode=7
Jul 17 07:42:16.965569 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:16.965421    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b" event={"ID":"0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f","Type":"ContainerDied","Data":"a958159e8e6f28adfbd4e6a7a469e6581bc0a07edef9214ef5ce54fc322a3ef5"}
Jul 17 07:42:16.965636 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:16.965597    2546 scope.go:117] "RemoveContainer" containerID="a958159e8e6f28adfbd4e6a7a469e6581bc0a07edef9214ef5ce54fc322a3ef5"
Jul 17 07:42:17.971457 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:17.971427    2546 generic.go:356] "Generic (PLEG): container finished" podID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerID="2b8a83faf20228ab6d41eddbdcd860f46a76acef2608877240e65ba39c7ccc35" exitCode=7
Jul 17 07:42:17.971916 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:17.971511    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b" event={"ID":"0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f","Type":"ContainerDied","Data":"2b8a83faf20228ab6d41eddbdcd860f46a76acef2608877240e65ba39c7ccc35"}
Jul 17 07:42:17.971916 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:17.971574    2546 scope.go:117] "RemoveContainer" containerID="a958159e8e6f28adfbd4e6a7a469e6581bc0a07edef9214ef5ce54fc322a3ef5"
Jul 17 07:42:17.971916 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:17.971845    2546 scope.go:117] "RemoveContainer" containerID="2b8a83faf20228ab6d41eddbdcd860f46a76acef2608877240e65ba39c7ccc35"
Jul 17 07:42:17.972066 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:42:17.972049    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b_odh-ai-gateway-infra(0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f"
Jul 17 07:42:18.978044 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:18.978016    2546 scope.go:117] "RemoveContainer" containerID="2b8a83faf20228ab6d41eddbdcd860f46a76acef2608877240e65ba39c7ccc35"
Jul 17 07:42:18.978451 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:42:18.978241    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b_odh-ai-gateway-infra(0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f"
Jul 17 07:42:33.899562 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:33.899526    2546 scope.go:117] "RemoveContainer" containerID="2b8a83faf20228ab6d41eddbdcd860f46a76acef2608877240e65ba39c7ccc35"
Jul 17 07:42:35.059131 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:35.059094    2546 generic.go:356] "Generic (PLEG): container finished" podID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerID="243970d299d33c45caa42db2def1050bb1f1cd55040f486cc90989fd800aa145" exitCode=7
Jul 17 07:42:35.059589 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:35.059172    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b" event={"ID":"0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f","Type":"ContainerDied","Data":"243970d299d33c45caa42db2def1050bb1f1cd55040f486cc90989fd800aa145"}
Jul 17 07:42:35.059589 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:35.059244    2546 scope.go:117] "RemoveContainer" containerID="2b8a83faf20228ab6d41eddbdcd860f46a76acef2608877240e65ba39c7ccc35"
Jul 17 07:42:35.059589 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:35.059522    2546 scope.go:117] "RemoveContainer" containerID="243970d299d33c45caa42db2def1050bb1f1cd55040f486cc90989fd800aa145"
Jul 17 07:42:35.059821 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:42:35.059799    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b_odh-ai-gateway-infra(0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f"
Jul 17 07:42:36.087225 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:36.087178    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"]
Jul 17 07:42:36.228077 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:36.228050    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"
Jul 17 07:42:36.360420 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:36.360335    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f-maas-api-service-ca\") pod \"0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f\" (UID: \"0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f\") "
Jul 17 07:42:36.360722 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:36.360698    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" (UID: "0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:42:36.461477 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:36.461438    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:42:37.072949 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:37.072921    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"
Jul 17 07:42:37.073124 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:37.072944    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b" event={"ID":"0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f","Type":"ContainerDied","Data":"571991f8275aa7f5a1d9462308adf3cdabbb39c860d76b8b683a9de5dbcef050"}
Jul 17 07:42:37.073124 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:37.073032    2546 scope.go:117] "RemoveContainer" containerID="243970d299d33c45caa42db2def1050bb1f1cd55040f486cc90989fd800aa145"
Jul 17 07:42:37.107369 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:37.107333    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"]
Jul 17 07:42:37.117423 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:37.117390    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5gk6b"]
Jul 17 07:42:37.905598 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:42:37.905562    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" path="/var/lib/kubelet/pods/0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f/volumes"
Jul 17 07:43:15.014529 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.014492    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"]
Jul 17 07:43:15.015056 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.014895    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerName="revoke-keys"
Jul 17 07:43:15.015056 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.014908    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerName="revoke-keys"
Jul 17 07:43:15.015056 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.014929    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerName="revoke-keys"
Jul 17 07:43:15.015056 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.014935    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerName="revoke-keys"
Jul 17 07:43:15.015056 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.014997    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="50f9542f-6ff5-4acd-b27c-4c183ed60f66" containerName="revoke-keys"
Jul 17 07:43:15.015056 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.015006    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerName="revoke-keys"
Jul 17 07:43:15.015056 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.015012    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerName="revoke-keys"
Jul 17 07:43:15.015056 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.015022    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerName="revoke-keys"
Jul 17 07:43:15.017893 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.017874    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"
Jul 17 07:43:15.020578 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.020556    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:43:15.020719 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.020605    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:43:15.026592 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.026568    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"]
Jul 17 07:43:15.043683 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.043633    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fe31e2-a90c-4fa2-84fd-58cc1d505d18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4\" (UID: \"66fe31e2-a90c-4fa2-84fd-58cc1d505d18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"
Jul 17 07:43:15.145110 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.145072    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fe31e2-a90c-4fa2-84fd-58cc1d505d18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4\" (UID: \"66fe31e2-a90c-4fa2-84fd-58cc1d505d18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"
Jul 17 07:43:15.145740 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.145721    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fe31e2-a90c-4fa2-84fd-58cc1d505d18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4\" (UID: \"66fe31e2-a90c-4fa2-84fd-58cc1d505d18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"
Jul 17 07:43:15.329900 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.329867    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"
Jul 17 07:43:15.459759 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:15.459702    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"]
Jul 17 07:43:15.462029 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:43:15.462001    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fe31e2_a90c_4fa2_84fd_58cc1d505d18.slice/crio-e1b47f73fe4495c7ee19ad997d7f86979468e8462455040a1d5deef7de2576f9 WatchSource:0}: Error finding container e1b47f73fe4495c7ee19ad997d7f86979468e8462455040a1d5deef7de2576f9: Status 404 returned error can't find the container with id e1b47f73fe4495c7ee19ad997d7f86979468e8462455040a1d5deef7de2576f9
Jul 17 07:43:16.265839 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:16.265809    2546 generic.go:356] "Generic (PLEG): container finished" podID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerID="f0465814d7d5e48620facc78808286760d2eb16a8449c7ef3540546f064532b0" exitCode=7
Jul 17 07:43:16.266203 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:16.265883    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4" event={"ID":"66fe31e2-a90c-4fa2-84fd-58cc1d505d18","Type":"ContainerDied","Data":"f0465814d7d5e48620facc78808286760d2eb16a8449c7ef3540546f064532b0"}
Jul 17 07:43:16.266203 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:16.265935    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4" event={"ID":"66fe31e2-a90c-4fa2-84fd-58cc1d505d18","Type":"ContainerStarted","Data":"e1b47f73fe4495c7ee19ad997d7f86979468e8462455040a1d5deef7de2576f9"}
Jul 17 07:43:16.266203 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:16.266086    2546 scope.go:117] "RemoveContainer" containerID="f0465814d7d5e48620facc78808286760d2eb16a8449c7ef3540546f064532b0"
Jul 17 07:43:17.272439 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:17.272392    2546 generic.go:356] "Generic (PLEG): container finished" podID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerID="df7378a131926cf6fb34a368715e4c3d271fef5164465431fd417162cdae5087" exitCode=7
Jul 17 07:43:17.273123 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:17.272458    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4" event={"ID":"66fe31e2-a90c-4fa2-84fd-58cc1d505d18","Type":"ContainerDied","Data":"df7378a131926cf6fb34a368715e4c3d271fef5164465431fd417162cdae5087"}
Jul 17 07:43:17.273123 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:17.272524    2546 scope.go:117] "RemoveContainer" containerID="f0465814d7d5e48620facc78808286760d2eb16a8449c7ef3540546f064532b0"
Jul 17 07:43:17.273123 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:17.272773    2546 scope.go:117] "RemoveContainer" containerID="df7378a131926cf6fb34a368715e4c3d271fef5164465431fd417162cdae5087"
Jul 17 07:43:17.273123 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:43:17.273049    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4_odh-ai-gateway-infra(66fe31e2-a90c-4fa2-84fd-58cc1d505d18)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18"
Jul 17 07:43:18.279881 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:18.279848    2546 scope.go:117] "RemoveContainer" containerID="df7378a131926cf6fb34a368715e4c3d271fef5164465431fd417162cdae5087"
Jul 17 07:43:18.280302 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:43:18.280090    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4_odh-ai-gateway-infra(66fe31e2-a90c-4fa2-84fd-58cc1d505d18)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18"
Jul 17 07:43:32.898859 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:32.898828    2546 scope.go:117] "RemoveContainer" containerID="df7378a131926cf6fb34a368715e4c3d271fef5164465431fd417162cdae5087"
Jul 17 07:43:33.351566 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:33.351532    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4" event={"ID":"66fe31e2-a90c-4fa2-84fd-58cc1d505d18","Type":"ContainerStarted","Data":"8ece199fd6b6e0814ac03781d75b4392b2d25ae467f25bfa19536634b029c558"}
Jul 17 07:43:33.369617 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:33.369564    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4" podStartSLOduration=19.369545228 podStartE2EDuration="19.369545228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:43:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:43:33.369015712 +0000 UTC m=+1876.175212911" watchObservedRunningTime="2026-07-17 07:43:33.369545228 +0000 UTC m=+1876.175742407"
Jul 17 07:43:34.357863 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:34.357824    2546 generic.go:356] "Generic (PLEG): container finished" podID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerID="8ece199fd6b6e0814ac03781d75b4392b2d25ae467f25bfa19536634b029c558" exitCode=7
Jul 17 07:43:34.358255 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:34.357895    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4" event={"ID":"66fe31e2-a90c-4fa2-84fd-58cc1d505d18","Type":"ContainerDied","Data":"8ece199fd6b6e0814ac03781d75b4392b2d25ae467f25bfa19536634b029c558"}
Jul 17 07:43:34.358255 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:34.357958    2546 scope.go:117] "RemoveContainer" containerID="df7378a131926cf6fb34a368715e4c3d271fef5164465431fd417162cdae5087"
Jul 17 07:43:34.358376 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:34.358314    2546 scope.go:117] "RemoveContainer" containerID="8ece199fd6b6e0814ac03781d75b4392b2d25ae467f25bfa19536634b029c558"
Jul 17 07:43:34.358527 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:43:34.358506    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4_odh-ai-gateway-infra(66fe31e2-a90c-4fa2-84fd-58cc1d505d18)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18"
Jul 17 07:43:34.380722 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:34.380692    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"]
Jul 17 07:43:35.499074 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:35.499053    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"
Jul 17 07:43:35.650051 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:35.649975    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fe31e2-a90c-4fa2-84fd-58cc1d505d18-maas-api-service-ca\") pod \"66fe31e2-a90c-4fa2-84fd-58cc1d505d18\" (UID: \"66fe31e2-a90c-4fa2-84fd-58cc1d505d18\") "
Jul 17 07:43:35.650328 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:35.650309    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66fe31e2-a90c-4fa2-84fd-58cc1d505d18-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "66fe31e2-a90c-4fa2-84fd-58cc1d505d18" (UID: "66fe31e2-a90c-4fa2-84fd-58cc1d505d18"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:43:35.751018 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:35.750980    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66fe31e2-a90c-4fa2-84fd-58cc1d505d18-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:43:36.370592 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:36.370563    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"
Jul 17 07:43:36.370592 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:36.370568    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4" event={"ID":"66fe31e2-a90c-4fa2-84fd-58cc1d505d18","Type":"ContainerDied","Data":"e1b47f73fe4495c7ee19ad997d7f86979468e8462455040a1d5deef7de2576f9"}
Jul 17 07:43:36.370871 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:36.370636    2546 scope.go:117] "RemoveContainer" containerID="8ece199fd6b6e0814ac03781d75b4392b2d25ae467f25bfa19536634b029c558"
Jul 17 07:43:36.386921 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:36.386896    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"]
Jul 17 07:43:36.392897 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:36.392873    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-4s2z4"]
Jul 17 07:43:37.906102 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:37.906074    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" path="/var/lib/kubelet/pods/66fe31e2-a90c-4fa2-84fd-58cc1d505d18/volumes"
Jul 17 07:43:51.270588 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.270506    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"]
Jul 17 07:43:51.271045 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.270923    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerName="revoke-keys"
Jul 17 07:43:51.271045 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.270938    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerName="revoke-keys"
Jul 17 07:43:51.271045 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.270952    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerName="revoke-keys"
Jul 17 07:43:51.271045 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.270959    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9bf617-8ad1-4119-810c-5e7f4d1d9f3f" containerName="revoke-keys"
Jul 17 07:43:51.271045 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.270968    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerName="revoke-keys"
Jul 17 07:43:51.271045 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.270973    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerName="revoke-keys"
Jul 17 07:43:51.271045 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.270981    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerName="revoke-keys"
Jul 17 07:43:51.271045 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.270986    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerName="revoke-keys"
Jul 17 07:43:51.271318 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.271077    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerName="revoke-keys"
Jul 17 07:43:51.271318 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.271087    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerName="revoke-keys"
Jul 17 07:43:51.271318 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.271099    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="66fe31e2-a90c-4fa2-84fd-58cc1d505d18" containerName="revoke-keys"
Jul 17 07:43:51.274050 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.274031    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"
Jul 17 07:43:51.276470 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.276447    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:43:51.276591 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.276447    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:43:51.280299 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.280275    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"]
Jul 17 07:43:51.297104 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.297071    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f80cd34-e90b-45c7-990f-8ebff51fc64c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-87xgx\" (UID: \"4f80cd34-e90b-45c7-990f-8ebff51fc64c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"
Jul 17 07:43:51.398103 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.398062    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f80cd34-e90b-45c7-990f-8ebff51fc64c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-87xgx\" (UID: \"4f80cd34-e90b-45c7-990f-8ebff51fc64c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"
Jul 17 07:43:51.398679 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.398647    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f80cd34-e90b-45c7-990f-8ebff51fc64c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-87xgx\" (UID: \"4f80cd34-e90b-45c7-990f-8ebff51fc64c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"
Jul 17 07:43:51.586609 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.586514    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"
Jul 17 07:43:51.718380 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:51.718353    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"]
Jul 17 07:43:51.720545 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:43:51.720516    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f80cd34_e90b_45c7_990f_8ebff51fc64c.slice/crio-85a27d1bd1f2ceffcda28ad75566d5163c58a2bbcd94c8b7b803cb0b6aadad9f WatchSource:0}: Error finding container 85a27d1bd1f2ceffcda28ad75566d5163c58a2bbcd94c8b7b803cb0b6aadad9f: Status 404 returned error can't find the container with id 85a27d1bd1f2ceffcda28ad75566d5163c58a2bbcd94c8b7b803cb0b6aadad9f
Jul 17 07:43:52.449944 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:52.449910    2546 generic.go:356] "Generic (PLEG): container finished" podID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerID="e8a95465c861b49b9a3c7ad11f3fc2973449abb35ef0db1e807e3030609ef52d" exitCode=6
Jul 17 07:43:52.450333 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:52.449955    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx" event={"ID":"4f80cd34-e90b-45c7-990f-8ebff51fc64c","Type":"ContainerDied","Data":"e8a95465c861b49b9a3c7ad11f3fc2973449abb35ef0db1e807e3030609ef52d"}
Jul 17 07:43:52.450333 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:52.450015    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx" event={"ID":"4f80cd34-e90b-45c7-990f-8ebff51fc64c","Type":"ContainerStarted","Data":"85a27d1bd1f2ceffcda28ad75566d5163c58a2bbcd94c8b7b803cb0b6aadad9f"}
Jul 17 07:43:52.450333 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:52.450236    2546 scope.go:117] "RemoveContainer" containerID="e8a95465c861b49b9a3c7ad11f3fc2973449abb35ef0db1e807e3030609ef52d"
Jul 17 07:43:53.457966 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:53.457875    2546 generic.go:356] "Generic (PLEG): container finished" podID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerID="9983f1334136f57a19c1d29506eae2ca8fcf34e67915c8b61d4f7921fafa4468" exitCode=6
Jul 17 07:43:53.457966 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:53.457955    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx" event={"ID":"4f80cd34-e90b-45c7-990f-8ebff51fc64c","Type":"ContainerDied","Data":"9983f1334136f57a19c1d29506eae2ca8fcf34e67915c8b61d4f7921fafa4468"}
Jul 17 07:43:53.458453 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:53.458013    2546 scope.go:117] "RemoveContainer" containerID="e8a95465c861b49b9a3c7ad11f3fc2973449abb35ef0db1e807e3030609ef52d"
Jul 17 07:43:53.458453 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:53.458297    2546 scope.go:117] "RemoveContainer" containerID="9983f1334136f57a19c1d29506eae2ca8fcf34e67915c8b61d4f7921fafa4468"
Jul 17 07:43:53.458577 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:43:53.458556    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-87xgx_odh-ai-gateway-infra(4f80cd34-e90b-45c7-990f-8ebff51fc64c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c"
Jul 17 07:43:54.464828 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:43:54.464800    2546 scope.go:117] "RemoveContainer" containerID="9983f1334136f57a19c1d29506eae2ca8fcf34e67915c8b61d4f7921fafa4468"
Jul 17 07:43:54.465199 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:43:54.465012    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-87xgx_odh-ai-gateway-infra(4f80cd34-e90b-45c7-990f-8ebff51fc64c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c"
Jul 17 07:44:08.899539 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:08.899507    2546 scope.go:117] "RemoveContainer" containerID="9983f1334136f57a19c1d29506eae2ca8fcf34e67915c8b61d4f7921fafa4468"
Jul 17 07:44:09.542327 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:09.542297    2546 generic.go:356] "Generic (PLEG): container finished" podID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerID="e31cd8a5c26916f0a24ce1917768e4db56086ea019a3c163f457590557050c81" exitCode=6
Jul 17 07:44:09.542475 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:09.542370    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx" event={"ID":"4f80cd34-e90b-45c7-990f-8ebff51fc64c","Type":"ContainerDied","Data":"e31cd8a5c26916f0a24ce1917768e4db56086ea019a3c163f457590557050c81"}
Jul 17 07:44:09.542475 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:09.542445    2546 scope.go:117] "RemoveContainer" containerID="9983f1334136f57a19c1d29506eae2ca8fcf34e67915c8b61d4f7921fafa4468"
Jul 17 07:44:09.542841 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:09.542824    2546 scope.go:117] "RemoveContainer" containerID="e31cd8a5c26916f0a24ce1917768e4db56086ea019a3c163f457590557050c81"
Jul 17 07:44:09.543076 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:44:09.543051    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-87xgx_odh-ai-gateway-infra(4f80cd34-e90b-45c7-990f-8ebff51fc64c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c"
Jul 17 07:44:10.570675 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:10.570630    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"]
Jul 17 07:44:10.701223 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:10.701195    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"
Jul 17 07:44:10.787951 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:10.787920    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f80cd34-e90b-45c7-990f-8ebff51fc64c-maas-api-service-ca\") pod \"4f80cd34-e90b-45c7-990f-8ebff51fc64c\" (UID: \"4f80cd34-e90b-45c7-990f-8ebff51fc64c\") "
Jul 17 07:44:10.788263 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:10.788240    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f80cd34-e90b-45c7-990f-8ebff51fc64c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f80cd34-e90b-45c7-990f-8ebff51fc64c" (UID: "4f80cd34-e90b-45c7-990f-8ebff51fc64c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:44:10.889438 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:10.889352    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f80cd34-e90b-45c7-990f-8ebff51fc64c-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:44:11.555107 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:11.555080    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"
Jul 17 07:44:11.555272 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:11.555122    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx" event={"ID":"4f80cd34-e90b-45c7-990f-8ebff51fc64c","Type":"ContainerDied","Data":"85a27d1bd1f2ceffcda28ad75566d5163c58a2bbcd94c8b7b803cb0b6aadad9f"}
Jul 17 07:44:11.555272 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:11.555183    2546 scope.go:117] "RemoveContainer" containerID="e31cd8a5c26916f0a24ce1917768e4db56086ea019a3c163f457590557050c81"
Jul 17 07:44:11.577031 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:11.577005    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"]
Jul 17 07:44:11.582971 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:11.582944    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-87xgx"]
Jul 17 07:44:11.904624 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:44:11.904544    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" path="/var/lib/kubelet/pods/4f80cd34-e90b-45c7-990f-8ebff51fc64c/volumes"
Jul 17 07:45:00.189823 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.189790    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw"]
Jul 17 07:45:00.190281 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.190177    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerName="revoke-keys"
Jul 17 07:45:00.190281 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.190188    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerName="revoke-keys"
Jul 17 07:45:00.190281 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.190196    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerName="revoke-keys"
Jul 17 07:45:00.190281 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.190202    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerName="revoke-keys"
Jul 17 07:45:00.190281 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.190270    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerName="revoke-keys"
Jul 17 07:45:00.190281 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.190279    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerName="revoke-keys"
Jul 17 07:45:00.190281 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.190286    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerName="revoke-keys"
Jul 17 07:45:00.193388 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.193370    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw"
Jul 17 07:45:00.202905 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.202882    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:45:00.212937 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.212899    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw"
Jul 17 07:45:00.215602 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.215575    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw"]
Jul 17 07:45:00.362857 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.362827    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw"]
Jul 17 07:45:00.366644 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:45:00.366614    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667b0130_213b_4a6d_9eba_f93e5d63c42b.slice/crio-4c3641bd169f06697f8a3e279b46a6a797751176e2b537ab1c0933e71f9aa781 WatchSource:0}: Error finding container 4c3641bd169f06697f8a3e279b46a6a797751176e2b537ab1c0933e71f9aa781: Status 404 returned error can't find the container with id 4c3641bd169f06697f8a3e279b46a6a797751176e2b537ab1c0933e71f9aa781
Jul 17 07:45:00.793198 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.793159    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw" event={"ID":"667b0130-213b-4a6d-9eba-f93e5d63c42b","Type":"ContainerStarted","Data":"7d6f8e833ea765e9cbb86431cac10e4378de8195d08f90ba44f7ab183f0ec249"}
Jul 17 07:45:00.793403 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.793212    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw" event={"ID":"667b0130-213b-4a6d-9eba-f93e5d63c42b","Type":"ContainerStarted","Data":"4c3641bd169f06697f8a3e279b46a6a797751176e2b537ab1c0933e71f9aa781"}
Jul 17 07:45:00.819612 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:00.819560    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw" podStartSLOduration=0.819540544 podStartE2EDuration="819.540544ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:45:00.817961289 +0000 UTC m=+1963.624158463" watchObservedRunningTime="2026-07-17 07:45:00.819540544 +0000 UTC m=+1963.625737718"
Jul 17 07:45:01.799937 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:01.799900    2546 generic.go:356] "Generic (PLEG): container finished" podID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerID="7d6f8e833ea765e9cbb86431cac10e4378de8195d08f90ba44f7ab183f0ec249" exitCode=7
Jul 17 07:45:01.800414 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:01.799995    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw" event={"ID":"667b0130-213b-4a6d-9eba-f93e5d63c42b","Type":"ContainerDied","Data":"7d6f8e833ea765e9cbb86431cac10e4378de8195d08f90ba44f7ab183f0ec249"}
Jul 17 07:45:01.800414 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:01.800159    2546 scope.go:117] "RemoveContainer" containerID="7d6f8e833ea765e9cbb86431cac10e4378de8195d08f90ba44f7ab183f0ec249"
Jul 17 07:45:02.807180 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:02.807147    2546 generic.go:356] "Generic (PLEG): container finished" podID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerID="0a751c7850db9a92028b5e260a2ec5bd6fd9c927dcc87c0c0c98a04a071ab8a1" exitCode=7
Jul 17 07:45:02.807587 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:02.807226    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw" event={"ID":"667b0130-213b-4a6d-9eba-f93e5d63c42b","Type":"ContainerDied","Data":"0a751c7850db9a92028b5e260a2ec5bd6fd9c927dcc87c0c0c98a04a071ab8a1"}
Jul 17 07:45:02.807587 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:02.807293    2546 scope.go:117] "RemoveContainer" containerID="7d6f8e833ea765e9cbb86431cac10e4378de8195d08f90ba44f7ab183f0ec249"
Jul 17 07:45:02.807587 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:02.807454    2546 scope.go:117] "RemoveContainer" containerID="0a751c7850db9a92028b5e260a2ec5bd6fd9c927dcc87c0c0c98a04a071ab8a1"
Jul 17 07:45:02.807770 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:45:02.807718    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw_odh-ai-gateway-infra(667b0130-213b-4a6d-9eba-f93e5d63c42b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b"
Jul 17 07:45:03.813700 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:03.813658    2546 scope.go:117] "RemoveContainer" containerID="0a751c7850db9a92028b5e260a2ec5bd6fd9c927dcc87c0c0c98a04a071ab8a1"
Jul 17 07:45:03.814096 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:45:03.813900    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw_odh-ai-gateway-infra(667b0130-213b-4a6d-9eba-f93e5d63c42b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b"
Jul 17 07:45:15.899315 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:15.899223    2546 scope.go:117] "RemoveContainer" containerID="0a751c7850db9a92028b5e260a2ec5bd6fd9c927dcc87c0c0c98a04a071ab8a1"
Jul 17 07:45:16.878353 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:16.878316    2546 generic.go:356] "Generic (PLEG): container finished" podID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerID="00338dfeaeaa3e3003bbc6dd661287cd0ccfc1702ab45bb9fda22c54c1524850" exitCode=7
Jul 17 07:45:16.878533 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:16.878384    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw" event={"ID":"667b0130-213b-4a6d-9eba-f93e5d63c42b","Type":"ContainerDied","Data":"00338dfeaeaa3e3003bbc6dd661287cd0ccfc1702ab45bb9fda22c54c1524850"}
Jul 17 07:45:16.878533 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:16.878454    2546 scope.go:117] "RemoveContainer" containerID="0a751c7850db9a92028b5e260a2ec5bd6fd9c927dcc87c0c0c98a04a071ab8a1"
Jul 17 07:45:16.878801 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:16.878784    2546 scope.go:117] "RemoveContainer" containerID="00338dfeaeaa3e3003bbc6dd661287cd0ccfc1702ab45bb9fda22c54c1524850"
Jul 17 07:45:16.879061 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:45:16.879043    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw_odh-ai-gateway-infra(667b0130-213b-4a6d-9eba-f93e5d63c42b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b"
Jul 17 07:45:17.929074 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:17.929041    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw"]
Jul 17 07:45:18.068615 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:18.068592    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw"
Jul 17 07:45:18.890481 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:18.890450    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw"
Jul 17 07:45:18.890481 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:18.890468    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw" event={"ID":"667b0130-213b-4a6d-9eba-f93e5d63c42b","Type":"ContainerDied","Data":"4c3641bd169f06697f8a3e279b46a6a797751176e2b537ab1c0933e71f9aa781"}
Jul 17 07:45:18.890750 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:18.890530    2546 scope.go:117] "RemoveContainer" containerID="00338dfeaeaa3e3003bbc6dd661287cd0ccfc1702ab45bb9fda22c54c1524850"
Jul 17 07:45:18.911582 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:18.911557    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw"]
Jul 17 07:45:18.915679 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:18.915644    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-370a9d5a-29737905-9x9hw"]
Jul 17 07:45:19.904615 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:19.904580    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b" path="/var/lib/kubelet/pods/667b0130-213b-4a6d-9eba-f93e5d63c42b/volumes"
Jul 17 07:45:48.602491 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.602454    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"]
Jul 17 07:45:48.602997 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.602862    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerName="cleanup"
Jul 17 07:45:48.602997 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.602874    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerName="cleanup"
Jul 17 07:45:48.602997 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.602884    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerName="cleanup"
Jul 17 07:45:48.602997 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.602889    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerName="cleanup"
Jul 17 07:45:48.602997 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.602924    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerName="revoke-keys"
Jul 17 07:45:48.602997 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.602929    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f80cd34-e90b-45c7-990f-8ebff51fc64c" containerName="revoke-keys"
Jul 17 07:45:48.602997 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.602986    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerName="cleanup"
Jul 17 07:45:48.602997 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.602998    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerName="cleanup"
Jul 17 07:45:48.606057 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.606040    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"
Jul 17 07:45:48.608469 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.608452    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:45:48.608548 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.608455    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:45:48.613800 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.613751    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"]
Jul 17 07:45:48.713866 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.713822    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eed15c2-75de-4687-b533-968c756c6c71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr\" (UID: \"7eed15c2-75de-4687-b533-968c756c6c71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"
Jul 17 07:45:48.815202 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.815161    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eed15c2-75de-4687-b533-968c756c6c71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr\" (UID: \"7eed15c2-75de-4687-b533-968c756c6c71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"
Jul 17 07:45:48.815872 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.815849    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eed15c2-75de-4687-b533-968c756c6c71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr\" (UID: \"7eed15c2-75de-4687-b533-968c756c6c71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"
Jul 17 07:45:48.918553 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:48.918473    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"
Jul 17 07:45:49.052344 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:49.052316    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"]
Jul 17 07:45:49.054088 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:45:49.054062    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eed15c2_75de_4687_b533_968c756c6c71.slice/crio-1e3f83ed52a454a7ef3b279e734510a3ef3eb72d6fa709e02be90c0c368298c7 WatchSource:0}: Error finding container 1e3f83ed52a454a7ef3b279e734510a3ef3eb72d6fa709e02be90c0c368298c7: Status 404 returned error can't find the container with id 1e3f83ed52a454a7ef3b279e734510a3ef3eb72d6fa709e02be90c0c368298c7
Jul 17 07:45:50.048499 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:50.048465    2546 generic.go:356] "Generic (PLEG): container finished" podID="7eed15c2-75de-4687-b533-968c756c6c71" containerID="94b6d888398314c272d7eabdd200b48d271ca9fcc279d279fe2b4ec0b85e3fa5" exitCode=6
Jul 17 07:45:50.048895 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:50.048513    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr" event={"ID":"7eed15c2-75de-4687-b533-968c756c6c71","Type":"ContainerDied","Data":"94b6d888398314c272d7eabdd200b48d271ca9fcc279d279fe2b4ec0b85e3fa5"}
Jul 17 07:45:50.048895 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:50.048551    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr" event={"ID":"7eed15c2-75de-4687-b533-968c756c6c71","Type":"ContainerStarted","Data":"1e3f83ed52a454a7ef3b279e734510a3ef3eb72d6fa709e02be90c0c368298c7"}
Jul 17 07:45:50.048895 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:50.048743    2546 scope.go:117] "RemoveContainer" containerID="94b6d888398314c272d7eabdd200b48d271ca9fcc279d279fe2b4ec0b85e3fa5"
Jul 17 07:45:51.056006 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:51.055920    2546 generic.go:356] "Generic (PLEG): container finished" podID="7eed15c2-75de-4687-b533-968c756c6c71" containerID="5269e2865839c6c14293ee6f50b27a4db43a11c4fd4fba1ab96aa8eb56f47dd4" exitCode=6
Jul 17 07:45:51.056418 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:51.056002    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr" event={"ID":"7eed15c2-75de-4687-b533-968c756c6c71","Type":"ContainerDied","Data":"5269e2865839c6c14293ee6f50b27a4db43a11c4fd4fba1ab96aa8eb56f47dd4"}
Jul 17 07:45:51.056418 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:51.056060    2546 scope.go:117] "RemoveContainer" containerID="94b6d888398314c272d7eabdd200b48d271ca9fcc279d279fe2b4ec0b85e3fa5"
Jul 17 07:45:51.056418 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:51.056281    2546 scope.go:117] "RemoveContainer" containerID="5269e2865839c6c14293ee6f50b27a4db43a11c4fd4fba1ab96aa8eb56f47dd4"
Jul 17 07:45:51.056580 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:45:51.056515    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr_odh-ai-gateway-infra(7eed15c2-75de-4687-b533-968c756c6c71)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr" podUID="7eed15c2-75de-4687-b533-968c756c6c71"
Jul 17 07:45:52.063553 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:45:52.063472    2546 scope.go:117] "RemoveContainer" containerID="5269e2865839c6c14293ee6f50b27a4db43a11c4fd4fba1ab96aa8eb56f47dd4"
Jul 17 07:45:52.063920 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:45:52.063700    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr_odh-ai-gateway-infra(7eed15c2-75de-4687-b533-968c756c6c71)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr" podUID="7eed15c2-75de-4687-b533-968c756c6c71"
Jul 17 07:46:03.899245 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:03.899210    2546 scope.go:117] "RemoveContainer" containerID="5269e2865839c6c14293ee6f50b27a4db43a11c4fd4fba1ab96aa8eb56f47dd4"
Jul 17 07:46:05.128105 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:05.128069    2546 generic.go:356] "Generic (PLEG): container finished" podID="7eed15c2-75de-4687-b533-968c756c6c71" containerID="bf87b03bc6e0db901404821511aca9854cf9fc5a87dee564c8d0bd2632dc0590" exitCode=6
Jul 17 07:46:05.128538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:05.128143    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr" event={"ID":"7eed15c2-75de-4687-b533-968c756c6c71","Type":"ContainerDied","Data":"bf87b03bc6e0db901404821511aca9854cf9fc5a87dee564c8d0bd2632dc0590"}
Jul 17 07:46:05.128538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:05.128199    2546 scope.go:117] "RemoveContainer" containerID="5269e2865839c6c14293ee6f50b27a4db43a11c4fd4fba1ab96aa8eb56f47dd4"
Jul 17 07:46:05.128538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:05.128501    2546 scope.go:117] "RemoveContainer" containerID="bf87b03bc6e0db901404821511aca9854cf9fc5a87dee564c8d0bd2632dc0590"
Jul 17 07:46:05.128835 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:46:05.128802    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr_odh-ai-gateway-infra(7eed15c2-75de-4687-b533-968c756c6c71)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr" podUID="7eed15c2-75de-4687-b533-968c756c6c71"
Jul 17 07:46:06.158756 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:06.158722    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"]
Jul 17 07:46:06.295065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:06.295032    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"
Jul 17 07:46:06.381386 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:06.381355    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eed15c2-75de-4687-b533-968c756c6c71-maas-api-service-ca\") pod \"7eed15c2-75de-4687-b533-968c756c6c71\" (UID: \"7eed15c2-75de-4687-b533-968c756c6c71\") "
Jul 17 07:46:06.381749 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:06.381727    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eed15c2-75de-4687-b533-968c756c6c71-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7eed15c2-75de-4687-b533-968c756c6c71" (UID: "7eed15c2-75de-4687-b533-968c756c6c71"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:46:06.482713 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:06.482601    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eed15c2-75de-4687-b533-968c756c6c71-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:46:07.141185 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:07.141154    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"
Jul 17 07:46:07.141373 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:07.141181    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr" event={"ID":"7eed15c2-75de-4687-b533-968c756c6c71","Type":"ContainerDied","Data":"1e3f83ed52a454a7ef3b279e734510a3ef3eb72d6fa709e02be90c0c368298c7"}
Jul 17 07:46:07.141373 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:07.141240    2546 scope.go:117] "RemoveContainer" containerID="bf87b03bc6e0db901404821511aca9854cf9fc5a87dee564c8d0bd2632dc0590"
Jul 17 07:46:07.163005 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:07.162970    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"]
Jul 17 07:46:07.169286 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:07.169260    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-9kqwr"]
Jul 17 07:46:07.906520 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:07.906488    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eed15c2-75de-4687-b533-968c756c6c71" path="/var/lib/kubelet/pods/7eed15c2-75de-4687-b533-968c756c6c71/volumes"
Jul 17 07:46:31.417168 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.417130    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"]
Jul 17 07:46:31.417817 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.417777    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eed15c2-75de-4687-b533-968c756c6c71" containerName="revoke-keys"
Jul 17 07:46:31.417817 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.417819    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eed15c2-75de-4687-b533-968c756c6c71" containerName="revoke-keys"
Jul 17 07:46:31.417992 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.417832    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerName="cleanup"
Jul 17 07:46:31.417992 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.417861    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerName="cleanup"
Jul 17 07:46:31.417992 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.417882    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eed15c2-75de-4687-b533-968c756c6c71" containerName="revoke-keys"
Jul 17 07:46:31.417992 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.417890    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eed15c2-75de-4687-b533-968c756c6c71" containerName="revoke-keys"
Jul 17 07:46:31.418191 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.418023    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="667b0130-213b-4a6d-9eba-f93e5d63c42b" containerName="cleanup"
Jul 17 07:46:31.418191 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.418039    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eed15c2-75de-4687-b533-968c756c6c71" containerName="revoke-keys"
Jul 17 07:46:31.418191 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.418049    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eed15c2-75de-4687-b533-968c756c6c71" containerName="revoke-keys"
Jul 17 07:46:31.418191 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.418059    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eed15c2-75de-4687-b533-968c756c6c71" containerName="revoke-keys"
Jul 17 07:46:31.421246 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.421225    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"
Jul 17 07:46:31.423502 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.423482    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:46:31.423598 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.423482    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:46:31.429380 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.429357    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"]
Jul 17 07:46:31.534998 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.534957    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/294902eb-b2b7-4478-9c40-479b01160659-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8\" (UID: \"294902eb-b2b7-4478-9c40-479b01160659\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"
Jul 17 07:46:31.635578 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.635537    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/294902eb-b2b7-4478-9c40-479b01160659-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8\" (UID: \"294902eb-b2b7-4478-9c40-479b01160659\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"
Jul 17 07:46:31.636199 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.636176    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/294902eb-b2b7-4478-9c40-479b01160659-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8\" (UID: \"294902eb-b2b7-4478-9c40-479b01160659\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"
Jul 17 07:46:31.732652 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.732564    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"
Jul 17 07:46:31.865572 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:31.865547    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"]
Jul 17 07:46:31.868112 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:46:31.868083    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294902eb_b2b7_4478_9c40_479b01160659.slice/crio-704ff38da9fa10a61652643f47ff13b04449465b5981f6d79d62da7649b08659 WatchSource:0}: Error finding container 704ff38da9fa10a61652643f47ff13b04449465b5981f6d79d62da7649b08659: Status 404 returned error can't find the container with id 704ff38da9fa10a61652643f47ff13b04449465b5981f6d79d62da7649b08659
Jul 17 07:46:32.265066 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:32.265027    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8" event={"ID":"294902eb-b2b7-4478-9c40-479b01160659","Type":"ContainerStarted","Data":"2b4afedba2e9c84de2e77fffe4437481a7abeb6579e01cc428764cd4a6c4402b"}
Jul 17 07:46:32.265245 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:32.265084    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8" event={"ID":"294902eb-b2b7-4478-9c40-479b01160659","Type":"ContainerStarted","Data":"704ff38da9fa10a61652643f47ff13b04449465b5981f6d79d62da7649b08659"}
Jul 17 07:46:32.283752 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:32.283703    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8" podStartSLOduration=1.2836875509999999 podStartE2EDuration="1.283687551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:46:32.281799773 +0000 UTC m=+2055.087996947" watchObservedRunningTime="2026-07-17 07:46:32.283687551 +0000 UTC m=+2055.089884720"
Jul 17 07:46:33.271786 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:33.271752    2546 generic.go:356] "Generic (PLEG): container finished" podID="294902eb-b2b7-4478-9c40-479b01160659" containerID="2b4afedba2e9c84de2e77fffe4437481a7abeb6579e01cc428764cd4a6c4402b" exitCode=6
Jul 17 07:46:33.272200 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:33.271835    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8" event={"ID":"294902eb-b2b7-4478-9c40-479b01160659","Type":"ContainerDied","Data":"2b4afedba2e9c84de2e77fffe4437481a7abeb6579e01cc428764cd4a6c4402b"}
Jul 17 07:46:33.272200 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:33.272008    2546 scope.go:117] "RemoveContainer" containerID="2b4afedba2e9c84de2e77fffe4437481a7abeb6579e01cc428764cd4a6c4402b"
Jul 17 07:46:34.278987 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:34.278956    2546 generic.go:356] "Generic (PLEG): container finished" podID="294902eb-b2b7-4478-9c40-479b01160659" containerID="a52f8765e9a6dc7c225538be87e29f31ecd04d9138eb0c595473e4cb46e919d2" exitCode=6
Jul 17 07:46:34.279462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:34.279042    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8" event={"ID":"294902eb-b2b7-4478-9c40-479b01160659","Type":"ContainerDied","Data":"a52f8765e9a6dc7c225538be87e29f31ecd04d9138eb0c595473e4cb46e919d2"}
Jul 17 07:46:34.279462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:34.279120    2546 scope.go:117] "RemoveContainer" containerID="2b4afedba2e9c84de2e77fffe4437481a7abeb6579e01cc428764cd4a6c4402b"
Jul 17 07:46:34.279462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:34.279326    2546 scope.go:117] "RemoveContainer" containerID="a52f8765e9a6dc7c225538be87e29f31ecd04d9138eb0c595473e4cb46e919d2"
Jul 17 07:46:34.279617 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:46:34.279540    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8_odh-ai-gateway-infra(294902eb-b2b7-4478-9c40-479b01160659)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8" podUID="294902eb-b2b7-4478-9c40-479b01160659"
Jul 17 07:46:35.285992 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:35.285959    2546 scope.go:117] "RemoveContainer" containerID="a52f8765e9a6dc7c225538be87e29f31ecd04d9138eb0c595473e4cb46e919d2"
Jul 17 07:46:35.286470 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:46:35.286141    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8_odh-ai-gateway-infra(294902eb-b2b7-4478-9c40-479b01160659)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8" podUID="294902eb-b2b7-4478-9c40-479b01160659"
Jul 17 07:46:49.899091 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:49.899055    2546 scope.go:117] "RemoveContainer" containerID="a52f8765e9a6dc7c225538be87e29f31ecd04d9138eb0c595473e4cb46e919d2"
Jul 17 07:46:50.361063 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:50.361026    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8" event={"ID":"294902eb-b2b7-4478-9c40-479b01160659","Type":"ContainerStarted","Data":"6485957b8ba3eecdb8eb0dc3e7f445e289aa564fbbe9dc4b46eae22ec33da234"}
Jul 17 07:46:51.368859 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:51.368828    2546 generic.go:356] "Generic (PLEG): container finished" podID="294902eb-b2b7-4478-9c40-479b01160659" containerID="6485957b8ba3eecdb8eb0dc3e7f445e289aa564fbbe9dc4b46eae22ec33da234" exitCode=6
Jul 17 07:46:51.369272 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:51.368904    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8" event={"ID":"294902eb-b2b7-4478-9c40-479b01160659","Type":"ContainerDied","Data":"6485957b8ba3eecdb8eb0dc3e7f445e289aa564fbbe9dc4b46eae22ec33da234"}
Jul 17 07:46:51.369272 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:51.368974    2546 scope.go:117] "RemoveContainer" containerID="a52f8765e9a6dc7c225538be87e29f31ecd04d9138eb0c595473e4cb46e919d2"
Jul 17 07:46:51.369272 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:51.369225    2546 scope.go:117] "RemoveContainer" containerID="6485957b8ba3eecdb8eb0dc3e7f445e289aa564fbbe9dc4b46eae22ec33da234"
Jul 17 07:46:51.369515 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:46:51.369494    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8_odh-ai-gateway-infra(294902eb-b2b7-4478-9c40-479b01160659)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8" podUID="294902eb-b2b7-4478-9c40-479b01160659"
Jul 17 07:46:51.398186 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:51.398158    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"]
Jul 17 07:46:52.507867 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:52.507844    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"
Jul 17 07:46:52.540247 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:52.540210    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/294902eb-b2b7-4478-9c40-479b01160659-maas-api-service-ca\") pod \"294902eb-b2b7-4478-9c40-479b01160659\" (UID: \"294902eb-b2b7-4478-9c40-479b01160659\") "
Jul 17 07:46:52.540579 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:52.540552    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/294902eb-b2b7-4478-9c40-479b01160659-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "294902eb-b2b7-4478-9c40-479b01160659" (UID: "294902eb-b2b7-4478-9c40-479b01160659"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:46:52.641879 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:52.641805    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/294902eb-b2b7-4478-9c40-479b01160659-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:46:53.381560 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:53.381527    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8" event={"ID":"294902eb-b2b7-4478-9c40-479b01160659","Type":"ContainerDied","Data":"704ff38da9fa10a61652643f47ff13b04449465b5981f6d79d62da7649b08659"}
Jul 17 07:46:53.381756 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:53.381586    2546 scope.go:117] "RemoveContainer" containerID="6485957b8ba3eecdb8eb0dc3e7f445e289aa564fbbe9dc4b46eae22ec33da234"
Jul 17 07:46:53.381756 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:53.381534    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"
Jul 17 07:46:53.407734 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:53.407709    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"]
Jul 17 07:46:53.414771 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:53.412279    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-rz9h8"]
Jul 17 07:46:53.904951 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:46:53.904916    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="294902eb-b2b7-4478-9c40-479b01160659" path="/var/lib/kubelet/pods/294902eb-b2b7-4478-9c40-479b01160659/volumes"
Jul 17 07:48:28.749099 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.749005    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"]
Jul 17 07:48:28.749715 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.749616    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294902eb-b2b7-4478-9c40-479b01160659" containerName="revoke-keys"
Jul 17 07:48:28.749715 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.749637    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="294902eb-b2b7-4478-9c40-479b01160659" containerName="revoke-keys"
Jul 17 07:48:28.749715 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.749656    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eed15c2-75de-4687-b533-968c756c6c71" containerName="revoke-keys"
Jul 17 07:48:28.749715 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.749684    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eed15c2-75de-4687-b533-968c756c6c71" containerName="revoke-keys"
Jul 17 07:48:28.749715 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.749696    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294902eb-b2b7-4478-9c40-479b01160659" containerName="revoke-keys"
Jul 17 07:48:28.749715 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.749705    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="294902eb-b2b7-4478-9c40-479b01160659" containerName="revoke-keys"
Jul 17 07:48:28.750036 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.749836    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="294902eb-b2b7-4478-9c40-479b01160659" containerName="revoke-keys"
Jul 17 07:48:28.750036 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.749851    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="294902eb-b2b7-4478-9c40-479b01160659" containerName="revoke-keys"
Jul 17 07:48:28.750036 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.749865    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="294902eb-b2b7-4478-9c40-479b01160659" containerName="revoke-keys"
Jul 17 07:48:28.752845 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.752823    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"
Jul 17 07:48:28.755648 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.755628    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:48:28.755774 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.755702    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:48:28.761136 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.761107    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"]
Jul 17 07:48:28.873017 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.872977    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe8eca9c-d45d-4474-8ce9-c986106a15ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx\" (UID: \"fe8eca9c-d45d-4474-8ce9-c986106a15ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"
Jul 17 07:48:28.973659 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.973616    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe8eca9c-d45d-4474-8ce9-c986106a15ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx\" (UID: \"fe8eca9c-d45d-4474-8ce9-c986106a15ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"
Jul 17 07:48:28.974249 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:28.974229    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe8eca9c-d45d-4474-8ce9-c986106a15ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx\" (UID: \"fe8eca9c-d45d-4474-8ce9-c986106a15ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"
Jul 17 07:48:29.064722 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:29.064685    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"
Jul 17 07:48:29.194780 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:29.194756    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"]
Jul 17 07:48:29.196910 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:48:29.196872    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe8eca9c_d45d_4474_8ce9_c986106a15ac.slice/crio-5c4c113f989bd4e1f0a371693552d41452757ddac225d4656010aecee18a5dc1 WatchSource:0}: Error finding container 5c4c113f989bd4e1f0a371693552d41452757ddac225d4656010aecee18a5dc1: Status 404 returned error can't find the container with id 5c4c113f989bd4e1f0a371693552d41452757ddac225d4656010aecee18a5dc1
Jul 17 07:48:29.854006 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:29.853969    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx" event={"ID":"fe8eca9c-d45d-4474-8ce9-c986106a15ac","Type":"ContainerStarted","Data":"43635e1fd275b3a131c1432569830f261f64c1cdea2d29bdd9c8cc378b903cfd"}
Jul 17 07:48:29.854421 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:29.854024    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx" event={"ID":"fe8eca9c-d45d-4474-8ce9-c986106a15ac","Type":"ContainerStarted","Data":"5c4c113f989bd4e1f0a371693552d41452757ddac225d4656010aecee18a5dc1"}
Jul 17 07:48:29.873280 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:29.873221    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx" podStartSLOduration=1.873196769 podStartE2EDuration="1.873196769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:48:29.871795452 +0000 UTC m=+2172.677992627" watchObservedRunningTime="2026-07-17 07:48:29.873196769 +0000 UTC m=+2172.679393937"
Jul 17 07:48:30.859942 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:30.859909    2546 generic.go:356] "Generic (PLEG): container finished" podID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerID="43635e1fd275b3a131c1432569830f261f64c1cdea2d29bdd9c8cc378b903cfd" exitCode=6
Jul 17 07:48:30.860338 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:30.859987    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx" event={"ID":"fe8eca9c-d45d-4474-8ce9-c986106a15ac","Type":"ContainerDied","Data":"43635e1fd275b3a131c1432569830f261f64c1cdea2d29bdd9c8cc378b903cfd"}
Jul 17 07:48:30.860338 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:30.860218    2546 scope.go:117] "RemoveContainer" containerID="43635e1fd275b3a131c1432569830f261f64c1cdea2d29bdd9c8cc378b903cfd"
Jul 17 07:48:31.866726 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:31.866622    2546 generic.go:356] "Generic (PLEG): container finished" podID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerID="f0e2ee7906f729bf778f2fb3b363f678475c149f7e24ea63b520a4e9293bb4a9" exitCode=6
Jul 17 07:48:31.867159 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:31.866716    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx" event={"ID":"fe8eca9c-d45d-4474-8ce9-c986106a15ac","Type":"ContainerDied","Data":"f0e2ee7906f729bf778f2fb3b363f678475c149f7e24ea63b520a4e9293bb4a9"}
Jul 17 07:48:31.867159 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:31.866779    2546 scope.go:117] "RemoveContainer" containerID="43635e1fd275b3a131c1432569830f261f64c1cdea2d29bdd9c8cc378b903cfd"
Jul 17 07:48:31.867159 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:31.866992    2546 scope.go:117] "RemoveContainer" containerID="f0e2ee7906f729bf778f2fb3b363f678475c149f7e24ea63b520a4e9293bb4a9"
Jul 17 07:48:31.867279 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:48:31.867230    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx_odh-ai-gateway-infra(fe8eca9c-d45d-4474-8ce9-c986106a15ac)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac"
Jul 17 07:48:32.873586 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:32.873559    2546 scope.go:117] "RemoveContainer" containerID="f0e2ee7906f729bf778f2fb3b363f678475c149f7e24ea63b520a4e9293bb4a9"
Jul 17 07:48:32.874033 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:48:32.873781    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx_odh-ai-gateway-infra(fe8eca9c-d45d-4474-8ce9-c986106a15ac)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac"
Jul 17 07:48:46.899269 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:46.899238    2546 scope.go:117] "RemoveContainer" containerID="f0e2ee7906f729bf778f2fb3b363f678475c149f7e24ea63b520a4e9293bb4a9"
Jul 17 07:48:47.950779 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:47.950745    2546 generic.go:356] "Generic (PLEG): container finished" podID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerID="48a901ef4a76eb626169fff5ceea68fe1cf96ac9a7672626c331aa0945bd48f3" exitCode=6
Jul 17 07:48:47.951227 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:47.950811    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx" event={"ID":"fe8eca9c-d45d-4474-8ce9-c986106a15ac","Type":"ContainerDied","Data":"48a901ef4a76eb626169fff5ceea68fe1cf96ac9a7672626c331aa0945bd48f3"}
Jul 17 07:48:47.951227 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:47.950869    2546 scope.go:117] "RemoveContainer" containerID="f0e2ee7906f729bf778f2fb3b363f678475c149f7e24ea63b520a4e9293bb4a9"
Jul 17 07:48:47.951359 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:47.951226    2546 scope.go:117] "RemoveContainer" containerID="48a901ef4a76eb626169fff5ceea68fe1cf96ac9a7672626c331aa0945bd48f3"
Jul 17 07:48:47.951500 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:48:47.951474    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx_odh-ai-gateway-infra(fe8eca9c-d45d-4474-8ce9-c986106a15ac)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac"
Jul 17 07:48:48.976808 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:48.976767    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"]
Jul 17 07:48:49.109374 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:49.109346    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"
Jul 17 07:48:49.166214 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:49.166178    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe8eca9c-d45d-4474-8ce9-c986106a15ac-maas-api-service-ca\") pod \"fe8eca9c-d45d-4474-8ce9-c986106a15ac\" (UID: \"fe8eca9c-d45d-4474-8ce9-c986106a15ac\") "
Jul 17 07:48:49.166534 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:49.166510    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe8eca9c-d45d-4474-8ce9-c986106a15ac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe8eca9c-d45d-4474-8ce9-c986106a15ac" (UID: "fe8eca9c-d45d-4474-8ce9-c986106a15ac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:48:49.267528 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:49.267504    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe8eca9c-d45d-4474-8ce9-c986106a15ac-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:48:49.964022 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:49.963990    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx" event={"ID":"fe8eca9c-d45d-4474-8ce9-c986106a15ac","Type":"ContainerDied","Data":"5c4c113f989bd4e1f0a371693552d41452757ddac225d4656010aecee18a5dc1"}
Jul 17 07:48:49.964022 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:49.964004    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"
Jul 17 07:48:49.964264 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:49.964048    2546 scope.go:117] "RemoveContainer" containerID="48a901ef4a76eb626169fff5ceea68fe1cf96ac9a7672626c331aa0945bd48f3"
Jul 17 07:48:49.981368 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:49.981340    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"]
Jul 17 07:48:49.997509 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:49.997486    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-twvrx"]
Jul 17 07:48:51.904636 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:48:51.904589    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" path="/var/lib/kubelet/pods/fe8eca9c-d45d-4474-8ce9-c986106a15ac/volumes"
Jul 17 07:49:23.343130 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.343086    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"]
Jul 17 07:49:23.343594 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.343555    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerName="revoke-keys"
Jul 17 07:49:23.343594 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.343569    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerName="revoke-keys"
Jul 17 07:49:23.343594 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.343580    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerName="revoke-keys"
Jul 17 07:49:23.343594 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.343586    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerName="revoke-keys"
Jul 17 07:49:23.343756 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.343607    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294902eb-b2b7-4478-9c40-479b01160659" containerName="revoke-keys"
Jul 17 07:49:23.343756 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.343614    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="294902eb-b2b7-4478-9c40-479b01160659" containerName="revoke-keys"
Jul 17 07:49:23.343756 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.343688    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerName="revoke-keys"
Jul 17 07:49:23.343756 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.343700    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerName="revoke-keys"
Jul 17 07:49:23.346718 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.346698    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"
Jul 17 07:49:23.349307 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.349285    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:49:23.349402 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.349306    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:49:23.353615 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.353588    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"]
Jul 17 07:49:23.409754 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.409719    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f8df69-984c-4b36-9f10-d5a14d856fd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz\" (UID: \"45f8df69-984c-4b36-9f10-d5a14d856fd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"
Jul 17 07:49:23.510736 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.510696    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f8df69-984c-4b36-9f10-d5a14d856fd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz\" (UID: \"45f8df69-984c-4b36-9f10-d5a14d856fd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"
Jul 17 07:49:23.511304 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.511283    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f8df69-984c-4b36-9f10-d5a14d856fd3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz\" (UID: \"45f8df69-984c-4b36-9f10-d5a14d856fd3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"
Jul 17 07:49:23.658930 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.658838    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"
Jul 17 07:49:23.787052 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:23.786925    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"]
Jul 17 07:49:23.789351 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:49:23.789325    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f8df69_984c_4b36_9f10_d5a14d856fd3.slice/crio-5ca541478b142626ae32adb6aec475a975c2efb2d7aad5665220d4422faef9ce WatchSource:0}: Error finding container 5ca541478b142626ae32adb6aec475a975c2efb2d7aad5665220d4422faef9ce: Status 404 returned error can't find the container with id 5ca541478b142626ae32adb6aec475a975c2efb2d7aad5665220d4422faef9ce
Jul 17 07:49:24.137872 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:24.137832    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz" event={"ID":"45f8df69-984c-4b36-9f10-d5a14d856fd3","Type":"ContainerStarted","Data":"41e48b2273ef072cdbeccc745d891278ea76bddc00b5c848ca084f03562dc8c8"}
Jul 17 07:49:24.138043 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:24.137895    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz" event={"ID":"45f8df69-984c-4b36-9f10-d5a14d856fd3","Type":"ContainerStarted","Data":"5ca541478b142626ae32adb6aec475a975c2efb2d7aad5665220d4422faef9ce"}
Jul 17 07:49:24.155203 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:24.155153    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz" podStartSLOduration=1.155137735 podStartE2EDuration="1.155137735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:49:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:49:24.153997401 +0000 UTC m=+2226.960194578" watchObservedRunningTime="2026-07-17 07:49:24.155137735 +0000 UTC m=+2226.961334931"
Jul 17 07:49:25.144708 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:25.144643    2546 generic.go:356] "Generic (PLEG): container finished" podID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerID="41e48b2273ef072cdbeccc745d891278ea76bddc00b5c848ca084f03562dc8c8" exitCode=7
Jul 17 07:49:25.145089 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:25.144730    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz" event={"ID":"45f8df69-984c-4b36-9f10-d5a14d856fd3","Type":"ContainerDied","Data":"41e48b2273ef072cdbeccc745d891278ea76bddc00b5c848ca084f03562dc8c8"}
Jul 17 07:49:25.145089 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:25.144940    2546 scope.go:117] "RemoveContainer" containerID="41e48b2273ef072cdbeccc745d891278ea76bddc00b5c848ca084f03562dc8c8"
Jul 17 07:49:26.151520 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:26.151431    2546 generic.go:356] "Generic (PLEG): container finished" podID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerID="82b6269084abb5c5790acd20910a92fb0e24bfb7cc6c079fbd7c9715f1cede52" exitCode=7
Jul 17 07:49:26.151520 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:26.151501    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz" event={"ID":"45f8df69-984c-4b36-9f10-d5a14d856fd3","Type":"ContainerDied","Data":"82b6269084abb5c5790acd20910a92fb0e24bfb7cc6c079fbd7c9715f1cede52"}
Jul 17 07:49:26.152017 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:26.151572    2546 scope.go:117] "RemoveContainer" containerID="41e48b2273ef072cdbeccc745d891278ea76bddc00b5c848ca084f03562dc8c8"
Jul 17 07:49:26.152017 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:26.151761    2546 scope.go:117] "RemoveContainer" containerID="82b6269084abb5c5790acd20910a92fb0e24bfb7cc6c079fbd7c9715f1cede52"
Jul 17 07:49:26.152017 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:49:26.151990    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz_odh-ai-gateway-infra(45f8df69-984c-4b36-9f10-d5a14d856fd3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3"
Jul 17 07:49:27.159290 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:27.159260    2546 scope.go:117] "RemoveContainer" containerID="82b6269084abb5c5790acd20910a92fb0e24bfb7cc6c079fbd7c9715f1cede52"
Jul 17 07:49:27.159730 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:49:27.159474    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz_odh-ai-gateway-infra(45f8df69-984c-4b36-9f10-d5a14d856fd3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3"
Jul 17 07:49:40.898937 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:40.898862    2546 scope.go:117] "RemoveContainer" containerID="82b6269084abb5c5790acd20910a92fb0e24bfb7cc6c079fbd7c9715f1cede52"
Jul 17 07:49:41.229598 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:41.229553    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz" event={"ID":"45f8df69-984c-4b36-9f10-d5a14d856fd3","Type":"ContainerStarted","Data":"38f2854dfae47c382a2570a362f843770c588e7b25debaf84f794128d629ed8b"}
Jul 17 07:49:42.236599 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:42.236563    2546 generic.go:356] "Generic (PLEG): container finished" podID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerID="38f2854dfae47c382a2570a362f843770c588e7b25debaf84f794128d629ed8b" exitCode=7
Jul 17 07:49:42.237055 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:42.236632    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz" event={"ID":"45f8df69-984c-4b36-9f10-d5a14d856fd3","Type":"ContainerDied","Data":"38f2854dfae47c382a2570a362f843770c588e7b25debaf84f794128d629ed8b"}
Jul 17 07:49:42.237055 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:42.236728    2546 scope.go:117] "RemoveContainer" containerID="82b6269084abb5c5790acd20910a92fb0e24bfb7cc6c079fbd7c9715f1cede52"
Jul 17 07:49:42.237055 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:42.236979    2546 scope.go:117] "RemoveContainer" containerID="38f2854dfae47c382a2570a362f843770c588e7b25debaf84f794128d629ed8b"
Jul 17 07:49:42.237231 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:49:42.237213    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz_odh-ai-gateway-infra(45f8df69-984c-4b36-9f10-d5a14d856fd3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3"
Jul 17 07:49:42.261948 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:42.261923    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"]
Jul 17 07:49:43.386546 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:43.386519    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"
Jul 17 07:49:43.502729 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:43.502601    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f8df69-984c-4b36-9f10-d5a14d856fd3-maas-api-service-ca\") pod \"45f8df69-984c-4b36-9f10-d5a14d856fd3\" (UID: \"45f8df69-984c-4b36-9f10-d5a14d856fd3\") "
Jul 17 07:49:43.503003 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:43.502978    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f8df69-984c-4b36-9f10-d5a14d856fd3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "45f8df69-984c-4b36-9f10-d5a14d856fd3" (UID: "45f8df69-984c-4b36-9f10-d5a14d856fd3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:49:43.603690 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:43.603632    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f8df69-984c-4b36-9f10-d5a14d856fd3-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:49:44.249445 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:44.249369    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"
Jul 17 07:49:44.249616 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:44.249373    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz" event={"ID":"45f8df69-984c-4b36-9f10-d5a14d856fd3","Type":"ContainerDied","Data":"5ca541478b142626ae32adb6aec475a975c2efb2d7aad5665220d4422faef9ce"}
Jul 17 07:49:44.249616 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:44.249503    2546 scope.go:117] "RemoveContainer" containerID="38f2854dfae47c382a2570a362f843770c588e7b25debaf84f794128d629ed8b"
Jul 17 07:49:44.267472 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:44.267448    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"]
Jul 17 07:49:44.274953 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:44.274932    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gjcjz"]
Jul 17 07:49:45.373496 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.373457    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"]
Jul 17 07:49:45.374068 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.374047    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerName="revoke-keys"
Jul 17 07:49:45.374150 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.374070    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerName="revoke-keys"
Jul 17 07:49:45.374150 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.374087    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerName="revoke-keys"
Jul 17 07:49:45.374150 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.374096    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerName="revoke-keys"
Jul 17 07:49:45.374150 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.374113    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerName="revoke-keys"
Jul 17 07:49:45.374150 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.374122    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerName="revoke-keys"
Jul 17 07:49:45.374150 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.374134    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerName="revoke-keys"
Jul 17 07:49:45.374150 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.374142    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerName="revoke-keys"
Jul 17 07:49:45.374503 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.374229    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerName="revoke-keys"
Jul 17 07:49:45.374503 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.374243    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe8eca9c-d45d-4474-8ce9-c986106a15ac" containerName="revoke-keys"
Jul 17 07:49:45.374503 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.374252    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerName="revoke-keys"
Jul 17 07:49:45.378633 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.378607    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"
Jul 17 07:49:45.381515 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.381488    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:49:45.381646 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.381521    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:49:45.387112 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.387079    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"]
Jul 17 07:49:45.522045 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.522008    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04e625f-d17d-4042-bf90-b0696c62cff4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz\" (UID: \"b04e625f-d17d-4042-bf90-b0696c62cff4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"
Jul 17 07:49:45.622799 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.622758    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04e625f-d17d-4042-bf90-b0696c62cff4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz\" (UID: \"b04e625f-d17d-4042-bf90-b0696c62cff4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"
Jul 17 07:49:45.623392 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.623369    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04e625f-d17d-4042-bf90-b0696c62cff4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz\" (UID: \"b04e625f-d17d-4042-bf90-b0696c62cff4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"
Jul 17 07:49:45.692036 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.691954    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"
Jul 17 07:49:45.825248 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.825016    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"]
Jul 17 07:49:45.904597 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:45.904562    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3" path="/var/lib/kubelet/pods/45f8df69-984c-4b36-9f10-d5a14d856fd3/volumes"
Jul 17 07:49:46.261978 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:46.261938    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz" event={"ID":"b04e625f-d17d-4042-bf90-b0696c62cff4","Type":"ContainerStarted","Data":"fa8d0b917c8e44f10b120bcd651710ee26d80a92a74251a3bbf88f47b93b933b"}
Jul 17 07:49:46.262162 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:46.261996    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz" event={"ID":"b04e625f-d17d-4042-bf90-b0696c62cff4","Type":"ContainerStarted","Data":"19240ba7c2ada7d9e98c1f481996ded48f190086ce9ea2516f2b89e1acf50937"}
Jul 17 07:49:46.278616 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:46.278565    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz" podStartSLOduration=1.278549363 podStartE2EDuration="1.278549363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:49:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:49:46.277279163 +0000 UTC m=+2249.083476341" watchObservedRunningTime="2026-07-17 07:49:46.278549363 +0000 UTC m=+2249.084746538"
Jul 17 07:49:47.268553 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:47.268520    2546 generic.go:356] "Generic (PLEG): container finished" podID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerID="fa8d0b917c8e44f10b120bcd651710ee26d80a92a74251a3bbf88f47b93b933b" exitCode=6
Jul 17 07:49:47.268961 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:47.268572    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz" event={"ID":"b04e625f-d17d-4042-bf90-b0696c62cff4","Type":"ContainerDied","Data":"fa8d0b917c8e44f10b120bcd651710ee26d80a92a74251a3bbf88f47b93b933b"}
Jul 17 07:49:47.268961 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:47.268788    2546 scope.go:117] "RemoveContainer" containerID="fa8d0b917c8e44f10b120bcd651710ee26d80a92a74251a3bbf88f47b93b933b"
Jul 17 07:49:48.275687 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:48.275631    2546 generic.go:356] "Generic (PLEG): container finished" podID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerID="8eda78c5b2d6c8fc82c7bf0afbac4b7999a79070859bf7625c16bd2577218d11" exitCode=6
Jul 17 07:49:48.276107 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:48.275698    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz" event={"ID":"b04e625f-d17d-4042-bf90-b0696c62cff4","Type":"ContainerDied","Data":"8eda78c5b2d6c8fc82c7bf0afbac4b7999a79070859bf7625c16bd2577218d11"}
Jul 17 07:49:48.276107 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:48.275781    2546 scope.go:117] "RemoveContainer" containerID="fa8d0b917c8e44f10b120bcd651710ee26d80a92a74251a3bbf88f47b93b933b"
Jul 17 07:49:48.276107 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:48.276017    2546 scope.go:117] "RemoveContainer" containerID="8eda78c5b2d6c8fc82c7bf0afbac4b7999a79070859bf7625c16bd2577218d11"
Jul 17 07:49:48.276252 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:49:48.276233    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz_odh-ai-gateway-infra(b04e625f-d17d-4042-bf90-b0696c62cff4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4"
Jul 17 07:49:49.282504 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:49:49.282475    2546 scope.go:117] "RemoveContainer" containerID="8eda78c5b2d6c8fc82c7bf0afbac4b7999a79070859bf7625c16bd2577218d11"
Jul 17 07:49:49.282987 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:49:49.282690    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz_odh-ai-gateway-infra(b04e625f-d17d-4042-bf90-b0696c62cff4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4"
Jul 17 07:50:02.898573 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:02.898541    2546 scope.go:117] "RemoveContainer" containerID="8eda78c5b2d6c8fc82c7bf0afbac4b7999a79070859bf7625c16bd2577218d11"
Jul 17 07:50:03.352723 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:03.352686    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz" event={"ID":"b04e625f-d17d-4042-bf90-b0696c62cff4","Type":"ContainerStarted","Data":"e3bc60553debe6ad856120c00c06685c8014f52bdd6be8e6964626fbbbba3556"}
Jul 17 07:50:04.359355 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:04.359322    2546 generic.go:356] "Generic (PLEG): container finished" podID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerID="e3bc60553debe6ad856120c00c06685c8014f52bdd6be8e6964626fbbbba3556" exitCode=6
Jul 17 07:50:04.359810 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:04.359387    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz" event={"ID":"b04e625f-d17d-4042-bf90-b0696c62cff4","Type":"ContainerDied","Data":"e3bc60553debe6ad856120c00c06685c8014f52bdd6be8e6964626fbbbba3556"}
Jul 17 07:50:04.359810 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:04.359447    2546 scope.go:117] "RemoveContainer" containerID="8eda78c5b2d6c8fc82c7bf0afbac4b7999a79070859bf7625c16bd2577218d11"
Jul 17 07:50:04.359810 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:04.359785    2546 scope.go:117] "RemoveContainer" containerID="e3bc60553debe6ad856120c00c06685c8014f52bdd6be8e6964626fbbbba3556"
Jul 17 07:50:04.360031 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:50:04.360015    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz_odh-ai-gateway-infra(b04e625f-d17d-4042-bf90-b0696c62cff4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4"
Jul 17 07:50:04.386899 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:04.386861    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"]
Jul 17 07:50:05.503123 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:05.503101    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"
Jul 17 07:50:05.605356 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:05.605321    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04e625f-d17d-4042-bf90-b0696c62cff4-maas-api-service-ca\") pod \"b04e625f-d17d-4042-bf90-b0696c62cff4\" (UID: \"b04e625f-d17d-4042-bf90-b0696c62cff4\") "
Jul 17 07:50:05.605772 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:05.605752    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b04e625f-d17d-4042-bf90-b0696c62cff4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b04e625f-d17d-4042-bf90-b0696c62cff4" (UID: "b04e625f-d17d-4042-bf90-b0696c62cff4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:50:05.707187 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:05.707102    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04e625f-d17d-4042-bf90-b0696c62cff4-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:50:06.372902 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:06.372873    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"
Jul 17 07:50:06.373073 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:06.372906    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz" event={"ID":"b04e625f-d17d-4042-bf90-b0696c62cff4","Type":"ContainerDied","Data":"19240ba7c2ada7d9e98c1f481996ded48f190086ce9ea2516f2b89e1acf50937"}
Jul 17 07:50:06.373073 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:06.372967    2546 scope.go:117] "RemoveContainer" containerID="e3bc60553debe6ad856120c00c06685c8014f52bdd6be8e6964626fbbbba3556"
Jul 17 07:50:06.393869 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:06.393840    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"]
Jul 17 07:50:06.400705 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:06.399065    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-5slvz"]
Jul 17 07:50:07.905177 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:07.905143    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4" path="/var/lib/kubelet/pods/b04e625f-d17d-4042-bf90-b0696c62cff4/volumes"
Jul 17 07:50:18.849959 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.849923    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"]
Jul 17 07:50:18.850372 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.850309    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerName="revoke-keys"
Jul 17 07:50:18.850372 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.850320    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerName="revoke-keys"
Jul 17 07:50:18.850372 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.850330    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerName="revoke-keys"
Jul 17 07:50:18.850372 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.850336    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerName="revoke-keys"
Jul 17 07:50:18.850535 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.850406    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerName="revoke-keys"
Jul 17 07:50:18.850535 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.850415    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerName="revoke-keys"
Jul 17 07:50:18.850535 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.850421    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="45f8df69-984c-4b36-9f10-d5a14d856fd3" containerName="revoke-keys"
Jul 17 07:50:18.854826 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.854808    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"
Jul 17 07:50:18.859747 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.859731    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:50:18.860153 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.860134    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:50:18.874408 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.874380    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"]
Jul 17 07:50:18.929738 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:18.929699    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e641bc80-5380-4097-8615-425fd4b76edf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn\" (UID: \"e641bc80-5380-4097-8615-425fd4b76edf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"
Jul 17 07:50:19.031156 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:19.031108    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e641bc80-5380-4097-8615-425fd4b76edf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn\" (UID: \"e641bc80-5380-4097-8615-425fd4b76edf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"
Jul 17 07:50:19.031781 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:19.031761    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e641bc80-5380-4097-8615-425fd4b76edf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn\" (UID: \"e641bc80-5380-4097-8615-425fd4b76edf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"
Jul 17 07:50:19.165306 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:19.165214    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"
Jul 17 07:50:19.296817 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:19.296794    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"]
Jul 17 07:50:19.299467 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:50:19.299442    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode641bc80_5380_4097_8615_425fd4b76edf.slice/crio-4459df435e216618308b75156948b6603afc1d505c0ff1a7bbdc67d8e48cd581 WatchSource:0}: Error finding container 4459df435e216618308b75156948b6603afc1d505c0ff1a7bbdc67d8e48cd581: Status 404 returned error can't find the container with id 4459df435e216618308b75156948b6603afc1d505c0ff1a7bbdc67d8e48cd581
Jul 17 07:50:19.438928 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:19.438839    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn" event={"ID":"e641bc80-5380-4097-8615-425fd4b76edf","Type":"ContainerStarted","Data":"4459df435e216618308b75156948b6603afc1d505c0ff1a7bbdc67d8e48cd581"}
Jul 17 07:50:20.445862 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:20.445826    2546 generic.go:356] "Generic (PLEG): container finished" podID="e641bc80-5380-4097-8615-425fd4b76edf" containerID="b847a1302d77f5025d331cbe9776a4e458347bacff93b6025dc5969621a89718" exitCode=6
Jul 17 07:50:20.446341 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:20.445908    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn" event={"ID":"e641bc80-5380-4097-8615-425fd4b76edf","Type":"ContainerDied","Data":"b847a1302d77f5025d331cbe9776a4e458347bacff93b6025dc5969621a89718"}
Jul 17 07:50:20.446341 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:20.446110    2546 scope.go:117] "RemoveContainer" containerID="b847a1302d77f5025d331cbe9776a4e458347bacff93b6025dc5969621a89718"
Jul 17 07:50:21.453015 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:21.452921    2546 generic.go:356] "Generic (PLEG): container finished" podID="e641bc80-5380-4097-8615-425fd4b76edf" containerID="a594e27ad7c4f6388dab8ac6e84ffec0b16c9bf8c96d7525e9d49fe4760c28c5" exitCode=6
Jul 17 07:50:21.453482 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:21.453027    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn" event={"ID":"e641bc80-5380-4097-8615-425fd4b76edf","Type":"ContainerDied","Data":"a594e27ad7c4f6388dab8ac6e84ffec0b16c9bf8c96d7525e9d49fe4760c28c5"}
Jul 17 07:50:21.453482 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:21.453092    2546 scope.go:117] "RemoveContainer" containerID="b847a1302d77f5025d331cbe9776a4e458347bacff93b6025dc5969621a89718"
Jul 17 07:50:21.453482 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:21.453210    2546 scope.go:117] "RemoveContainer" containerID="a594e27ad7c4f6388dab8ac6e84ffec0b16c9bf8c96d7525e9d49fe4760c28c5"
Jul 17 07:50:21.453482 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:50:21.453453    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn_odh-ai-gateway-infra(e641bc80-5380-4097-8615-425fd4b76edf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn" podUID="e641bc80-5380-4097-8615-425fd4b76edf"
Jul 17 07:50:22.459165 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:22.459139    2546 scope.go:117] "RemoveContainer" containerID="a594e27ad7c4f6388dab8ac6e84ffec0b16c9bf8c96d7525e9d49fe4760c28c5"
Jul 17 07:50:22.459569 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:50:22.459379    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn_odh-ai-gateway-infra(e641bc80-5380-4097-8615-425fd4b76edf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn" podUID="e641bc80-5380-4097-8615-425fd4b76edf"
Jul 17 07:50:35.899476 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:35.899442    2546 scope.go:117] "RemoveContainer" containerID="a594e27ad7c4f6388dab8ac6e84ffec0b16c9bf8c96d7525e9d49fe4760c28c5"
Jul 17 07:50:36.533482 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:36.533445    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn" event={"ID":"e641bc80-5380-4097-8615-425fd4b76edf","Type":"ContainerStarted","Data":"e4aac9f6cfc2359ba5b5fb348ad49eaf703f7e1d3294efb05b9178aac9ba70cb"}
Jul 17 07:50:36.552588 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:36.552534    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn" podStartSLOduration=18.552516703 podStartE2EDuration="18.552516703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:50:36.550779136 +0000 UTC m=+2299.356976367" watchObservedRunningTime="2026-07-17 07:50:36.552516703 +0000 UTC m=+2299.358713878"
Jul 17 07:50:37.539877 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:37.539840    2546 generic.go:356] "Generic (PLEG): container finished" podID="e641bc80-5380-4097-8615-425fd4b76edf" containerID="e4aac9f6cfc2359ba5b5fb348ad49eaf703f7e1d3294efb05b9178aac9ba70cb" exitCode=6
Jul 17 07:50:37.540337 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:37.539913    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn" event={"ID":"e641bc80-5380-4097-8615-425fd4b76edf","Type":"ContainerDied","Data":"e4aac9f6cfc2359ba5b5fb348ad49eaf703f7e1d3294efb05b9178aac9ba70cb"}
Jul 17 07:50:37.540337 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:37.539974    2546 scope.go:117] "RemoveContainer" containerID="a594e27ad7c4f6388dab8ac6e84ffec0b16c9bf8c96d7525e9d49fe4760c28c5"
Jul 17 07:50:37.540337 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:37.540272    2546 scope.go:117] "RemoveContainer" containerID="e4aac9f6cfc2359ba5b5fb348ad49eaf703f7e1d3294efb05b9178aac9ba70cb"
Jul 17 07:50:37.540525 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:50:37.540506    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn_odh-ai-gateway-infra(e641bc80-5380-4097-8615-425fd4b76edf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn" podUID="e641bc80-5380-4097-8615-425fd4b76edf"
Jul 17 07:50:37.566720 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:37.566655    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"]
Jul 17 07:50:38.686063 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:38.686032    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"
Jul 17 07:50:38.825953 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:38.825860    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e641bc80-5380-4097-8615-425fd4b76edf-maas-api-service-ca\") pod \"e641bc80-5380-4097-8615-425fd4b76edf\" (UID: \"e641bc80-5380-4097-8615-425fd4b76edf\") "
Jul 17 07:50:38.826256 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:38.826232    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e641bc80-5380-4097-8615-425fd4b76edf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e641bc80-5380-4097-8615-425fd4b76edf" (UID: "e641bc80-5380-4097-8615-425fd4b76edf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:50:38.926955 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:38.926915    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e641bc80-5380-4097-8615-425fd4b76edf-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:50:39.552992 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:39.552966    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"
Jul 17 07:50:39.552992 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:39.552972    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn" event={"ID":"e641bc80-5380-4097-8615-425fd4b76edf","Type":"ContainerDied","Data":"4459df435e216618308b75156948b6603afc1d505c0ff1a7bbdc67d8e48cd581"}
Jul 17 07:50:39.553244 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:39.553043    2546 scope.go:117] "RemoveContainer" containerID="e4aac9f6cfc2359ba5b5fb348ad49eaf703f7e1d3294efb05b9178aac9ba70cb"
Jul 17 07:50:39.577213 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:39.577180    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"]
Jul 17 07:50:39.584732 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:39.584703    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b9hgn"]
Jul 17 07:50:39.904923 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:50:39.904839    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e641bc80-5380-4097-8615-425fd4b76edf" path="/var/lib/kubelet/pods/e641bc80-5380-4097-8615-425fd4b76edf/volumes"
Jul 17 07:51:23.446054 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446016    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"]
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446385    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e641bc80-5380-4097-8615-425fd4b76edf" containerName="revoke-keys"
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446396    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e641bc80-5380-4097-8615-425fd4b76edf" containerName="revoke-keys"
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446412    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e641bc80-5380-4097-8615-425fd4b76edf" containerName="revoke-keys"
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446418    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e641bc80-5380-4097-8615-425fd4b76edf" containerName="revoke-keys"
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446426    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e641bc80-5380-4097-8615-425fd4b76edf" containerName="revoke-keys"
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446432    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e641bc80-5380-4097-8615-425fd4b76edf" containerName="revoke-keys"
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446446    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerName="revoke-keys"
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446451    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerName="revoke-keys"
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446516    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e641bc80-5380-4097-8615-425fd4b76edf" containerName="revoke-keys"
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446524    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e641bc80-5380-4097-8615-425fd4b76edf" containerName="revoke-keys"
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446532    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04e625f-d17d-4042-bf90-b0696c62cff4" containerName="revoke-keys"
Jul 17 07:51:23.446604 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.446538    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e641bc80-5380-4097-8615-425fd4b76edf" containerName="revoke-keys"
Jul 17 07:51:23.449434 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.449417    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"
Jul 17 07:51:23.452111 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.452084    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:51:23.452239 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.452197    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:51:23.458460 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.458432    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"]
Jul 17 07:51:23.547189 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.547148    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e37852f-de77-42ef-82f6-2c10a249725f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7\" (UID: \"4e37852f-de77-42ef-82f6-2c10a249725f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"
Jul 17 07:51:23.648591 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.648545    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e37852f-de77-42ef-82f6-2c10a249725f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7\" (UID: \"4e37852f-de77-42ef-82f6-2c10a249725f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"
Jul 17 07:51:23.649182 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.649163    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e37852f-de77-42ef-82f6-2c10a249725f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7\" (UID: \"4e37852f-de77-42ef-82f6-2c10a249725f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"
Jul 17 07:51:23.760607 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.760520    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"
Jul 17 07:51:23.897061 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:23.897037    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"]
Jul 17 07:51:23.898959 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:51:23.898929    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e37852f_de77_42ef_82f6_2c10a249725f.slice/crio-d3eca34eb94c054f8068a3d81ff192ddbcd26cc711fce090fab82fe765d75207 WatchSource:0}: Error finding container d3eca34eb94c054f8068a3d81ff192ddbcd26cc711fce090fab82fe765d75207: Status 404 returned error can't find the container with id d3eca34eb94c054f8068a3d81ff192ddbcd26cc711fce090fab82fe765d75207
Jul 17 07:51:24.780596 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:24.780560    2546 generic.go:356] "Generic (PLEG): container finished" podID="4e37852f-de77-42ef-82f6-2c10a249725f" containerID="674e6b053fe0950ef7969483f5a8c538188f0e65f6033a7565cd6f6efa00cee9" exitCode=6
Jul 17 07:51:24.781011 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:24.780646    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7" event={"ID":"4e37852f-de77-42ef-82f6-2c10a249725f","Type":"ContainerDied","Data":"674e6b053fe0950ef7969483f5a8c538188f0e65f6033a7565cd6f6efa00cee9"}
Jul 17 07:51:24.781011 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:24.780738    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7" event={"ID":"4e37852f-de77-42ef-82f6-2c10a249725f","Type":"ContainerStarted","Data":"d3eca34eb94c054f8068a3d81ff192ddbcd26cc711fce090fab82fe765d75207"}
Jul 17 07:51:24.781011 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:24.780863    2546 scope.go:117] "RemoveContainer" containerID="674e6b053fe0950ef7969483f5a8c538188f0e65f6033a7565cd6f6efa00cee9"
Jul 17 07:51:25.787050 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:25.787018    2546 generic.go:356] "Generic (PLEG): container finished" podID="4e37852f-de77-42ef-82f6-2c10a249725f" containerID="d5b78c2c8d561869bcb7b47fb034f3159b2f301bb2419e9de960d69055a52153" exitCode=6
Jul 17 07:51:25.787460 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:25.787102    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7" event={"ID":"4e37852f-de77-42ef-82f6-2c10a249725f","Type":"ContainerDied","Data":"d5b78c2c8d561869bcb7b47fb034f3159b2f301bb2419e9de960d69055a52153"}
Jul 17 07:51:25.787460 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:25.787165    2546 scope.go:117] "RemoveContainer" containerID="674e6b053fe0950ef7969483f5a8c538188f0e65f6033a7565cd6f6efa00cee9"
Jul 17 07:51:25.787460 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:25.787421    2546 scope.go:117] "RemoveContainer" containerID="d5b78c2c8d561869bcb7b47fb034f3159b2f301bb2419e9de960d69055a52153"
Jul 17 07:51:25.787686 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:51:25.787646    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7_odh-ai-gateway-infra(4e37852f-de77-42ef-82f6-2c10a249725f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7" podUID="4e37852f-de77-42ef-82f6-2c10a249725f"
Jul 17 07:51:26.793555 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:26.793532    2546 scope.go:117] "RemoveContainer" containerID="d5b78c2c8d561869bcb7b47fb034f3159b2f301bb2419e9de960d69055a52153"
Jul 17 07:51:26.793924 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:51:26.793764    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7_odh-ai-gateway-infra(4e37852f-de77-42ef-82f6-2c10a249725f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7" podUID="4e37852f-de77-42ef-82f6-2c10a249725f"
Jul 17 07:51:38.899319 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:38.899276    2546 scope.go:117] "RemoveContainer" containerID="d5b78c2c8d561869bcb7b47fb034f3159b2f301bb2419e9de960d69055a52153"
Jul 17 07:51:39.861698 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:39.861592    2546 generic.go:356] "Generic (PLEG): container finished" podID="4e37852f-de77-42ef-82f6-2c10a249725f" containerID="02ce1e1b5eb9879576c9080f776047d16b90792a1e101cf1b31ca3edddf2bc3f" exitCode=6
Jul 17 07:51:39.861698 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:39.861680    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7" event={"ID":"4e37852f-de77-42ef-82f6-2c10a249725f","Type":"ContainerDied","Data":"02ce1e1b5eb9879576c9080f776047d16b90792a1e101cf1b31ca3edddf2bc3f"}
Jul 17 07:51:39.861882 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:39.861752    2546 scope.go:117] "RemoveContainer" containerID="d5b78c2c8d561869bcb7b47fb034f3159b2f301bb2419e9de960d69055a52153"
Jul 17 07:51:39.862069 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:39.862047    2546 scope.go:117] "RemoveContainer" containerID="02ce1e1b5eb9879576c9080f776047d16b90792a1e101cf1b31ca3edddf2bc3f"
Jul 17 07:51:39.862306 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:51:39.862288    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7_odh-ai-gateway-infra(4e37852f-de77-42ef-82f6-2c10a249725f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7" podUID="4e37852f-de77-42ef-82f6-2c10a249725f"
Jul 17 07:51:40.890048 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:40.890008    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"]
Jul 17 07:51:41.022818 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:41.022792    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"
Jul 17 07:51:41.121574 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:41.121530    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e37852f-de77-42ef-82f6-2c10a249725f-maas-api-service-ca\") pod \"4e37852f-de77-42ef-82f6-2c10a249725f\" (UID: \"4e37852f-de77-42ef-82f6-2c10a249725f\") "
Jul 17 07:51:41.121950 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:41.121927    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e37852f-de77-42ef-82f6-2c10a249725f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4e37852f-de77-42ef-82f6-2c10a249725f" (UID: "4e37852f-de77-42ef-82f6-2c10a249725f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:51:41.222702 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:41.222577    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e37852f-de77-42ef-82f6-2c10a249725f-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:51:41.873678 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:41.873633    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"
Jul 17 07:51:41.873861 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:41.873697    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7" event={"ID":"4e37852f-de77-42ef-82f6-2c10a249725f","Type":"ContainerDied","Data":"d3eca34eb94c054f8068a3d81ff192ddbcd26cc711fce090fab82fe765d75207"}
Jul 17 07:51:41.873861 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:41.873765    2546 scope.go:117] "RemoveContainer" containerID="02ce1e1b5eb9879576c9080f776047d16b90792a1e101cf1b31ca3edddf2bc3f"
Jul 17 07:51:41.895546 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:41.895515    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"]
Jul 17 07:51:41.905142 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:41.905119    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-t2vn7"]
Jul 17 07:51:43.904315 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:51:43.904282    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e37852f-de77-42ef-82f6-2c10a249725f" path="/var/lib/kubelet/pods/4e37852f-de77-42ef-82f6-2c10a249725f/volumes"
Jul 17 07:52:13.484512 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.484477    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"]
Jul 17 07:52:13.485065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.484915    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e37852f-de77-42ef-82f6-2c10a249725f" containerName="revoke-keys"
Jul 17 07:52:13.485065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.484926    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e37852f-de77-42ef-82f6-2c10a249725f" containerName="revoke-keys"
Jul 17 07:52:13.485065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.484939    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e37852f-de77-42ef-82f6-2c10a249725f" containerName="revoke-keys"
Jul 17 07:52:13.485065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.484945    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e37852f-de77-42ef-82f6-2c10a249725f" containerName="revoke-keys"
Jul 17 07:52:13.485065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.484954    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e37852f-de77-42ef-82f6-2c10a249725f" containerName="revoke-keys"
Jul 17 07:52:13.485065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.484959    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e37852f-de77-42ef-82f6-2c10a249725f" containerName="revoke-keys"
Jul 17 07:52:13.485065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.485027    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e37852f-de77-42ef-82f6-2c10a249725f" containerName="revoke-keys"
Jul 17 07:52:13.485065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.485035    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e37852f-de77-42ef-82f6-2c10a249725f" containerName="revoke-keys"
Jul 17 07:52:13.485065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.485043    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e37852f-de77-42ef-82f6-2c10a249725f" containerName="revoke-keys"
Jul 17 07:52:13.488164 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.488146    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"
Jul 17 07:52:13.490577 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.490554    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:52:13.490719 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.490575    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:52:13.495162 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.495128    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"]
Jul 17 07:52:13.528013 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.527975    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b51096-1f70-49e2-ab84-38544ff8e612-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm\" (UID: \"74b51096-1f70-49e2-ab84-38544ff8e612\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"
Jul 17 07:52:13.628911 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.628877    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b51096-1f70-49e2-ab84-38544ff8e612-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm\" (UID: \"74b51096-1f70-49e2-ab84-38544ff8e612\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"
Jul 17 07:52:13.629492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.629472    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b51096-1f70-49e2-ab84-38544ff8e612-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm\" (UID: \"74b51096-1f70-49e2-ab84-38544ff8e612\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"
Jul 17 07:52:13.799118 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.799084    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"
Jul 17 07:52:13.936524 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:13.936501    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"]
Jul 17 07:52:13.939277 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:52:13.939244    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b51096_1f70_49e2_ab84_38544ff8e612.slice/crio-cd6de66b09d0cd5800039c48959387c35db0eec76fac5d0039b3a0ff121d3ab9 WatchSource:0}: Error finding container cd6de66b09d0cd5800039c48959387c35db0eec76fac5d0039b3a0ff121d3ab9: Status 404 returned error can't find the container with id cd6de66b09d0cd5800039c48959387c35db0eec76fac5d0039b3a0ff121d3ab9
Jul 17 07:52:14.037237 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:14.037202    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm" event={"ID":"74b51096-1f70-49e2-ab84-38544ff8e612","Type":"ContainerStarted","Data":"cd6de66b09d0cd5800039c48959387c35db0eec76fac5d0039b3a0ff121d3ab9"}
Jul 17 07:52:15.043585 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:15.043552    2546 generic.go:356] "Generic (PLEG): container finished" podID="74b51096-1f70-49e2-ab84-38544ff8e612" containerID="04b3cabc590579c7fc967dde40726f252d40bd9833ea23822c3239863a3b040b" exitCode=6
Jul 17 07:52:15.043994 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:15.043634    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm" event={"ID":"74b51096-1f70-49e2-ab84-38544ff8e612","Type":"ContainerDied","Data":"04b3cabc590579c7fc967dde40726f252d40bd9833ea23822c3239863a3b040b"}
Jul 17 07:52:15.043994 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:15.043855    2546 scope.go:117] "RemoveContainer" containerID="04b3cabc590579c7fc967dde40726f252d40bd9833ea23822c3239863a3b040b"
Jul 17 07:52:15.694772 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:52:15.694739    2546 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b51096_1f70_49e2_ab84_38544ff8e612.slice/crio-a863c530009a2e369ffd16adbf6cc4ad4e2a1d237985d2a1621afd17e4637d7b.scope\": RecentStats: unable to find data in memory cache]"
Jul 17 07:52:16.050936 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:16.050904    2546 generic.go:356] "Generic (PLEG): container finished" podID="74b51096-1f70-49e2-ab84-38544ff8e612" containerID="a863c530009a2e369ffd16adbf6cc4ad4e2a1d237985d2a1621afd17e4637d7b" exitCode=6
Jul 17 07:52:16.051370 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:16.050992    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm" event={"ID":"74b51096-1f70-49e2-ab84-38544ff8e612","Type":"ContainerDied","Data":"a863c530009a2e369ffd16adbf6cc4ad4e2a1d237985d2a1621afd17e4637d7b"}
Jul 17 07:52:16.051370 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:16.051053    2546 scope.go:117] "RemoveContainer" containerID="04b3cabc590579c7fc967dde40726f252d40bd9833ea23822c3239863a3b040b"
Jul 17 07:52:16.051370 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:16.051185    2546 scope.go:117] "RemoveContainer" containerID="a863c530009a2e369ffd16adbf6cc4ad4e2a1d237985d2a1621afd17e4637d7b"
Jul 17 07:52:16.051521 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:52:16.051448    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm_odh-ai-gateway-infra(74b51096-1f70-49e2-ab84-38544ff8e612)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm" podUID="74b51096-1f70-49e2-ab84-38544ff8e612"
Jul 17 07:52:17.057357 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:17.057323    2546 scope.go:117] "RemoveContainer" containerID="a863c530009a2e369ffd16adbf6cc4ad4e2a1d237985d2a1621afd17e4637d7b"
Jul 17 07:52:17.057859 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:52:17.057630    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm_odh-ai-gateway-infra(74b51096-1f70-49e2-ab84-38544ff8e612)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm" podUID="74b51096-1f70-49e2-ab84-38544ff8e612"
Jul 17 07:52:29.898937 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:29.898901    2546 scope.go:117] "RemoveContainer" containerID="a863c530009a2e369ffd16adbf6cc4ad4e2a1d237985d2a1621afd17e4637d7b"
Jul 17 07:52:30.125133 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:30.125098    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm" event={"ID":"74b51096-1f70-49e2-ab84-38544ff8e612","Type":"ContainerStarted","Data":"2bddd2d3a50305b7aba0522637bab5e301ebfce4d2f0656d436f824e518e3ea6"}
Jul 17 07:52:30.143256 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:30.143198    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm" podStartSLOduration=17.143153721 podStartE2EDuration="17.143153721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:52:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:52:30.142421111 +0000 UTC m=+2412.948618286" watchObservedRunningTime="2026-07-17 07:52:30.143153721 +0000 UTC m=+2412.949350897"
Jul 17 07:52:31.132199 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:31.132163    2546 generic.go:356] "Generic (PLEG): container finished" podID="74b51096-1f70-49e2-ab84-38544ff8e612" containerID="2bddd2d3a50305b7aba0522637bab5e301ebfce4d2f0656d436f824e518e3ea6" exitCode=6
Jul 17 07:52:31.132726 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:31.132238    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm" event={"ID":"74b51096-1f70-49e2-ab84-38544ff8e612","Type":"ContainerDied","Data":"2bddd2d3a50305b7aba0522637bab5e301ebfce4d2f0656d436f824e518e3ea6"}
Jul 17 07:52:31.132726 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:31.132300    2546 scope.go:117] "RemoveContainer" containerID="a863c530009a2e369ffd16adbf6cc4ad4e2a1d237985d2a1621afd17e4637d7b"
Jul 17 07:52:31.132726 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:31.132628    2546 scope.go:117] "RemoveContainer" containerID="2bddd2d3a50305b7aba0522637bab5e301ebfce4d2f0656d436f824e518e3ea6"
Jul 17 07:52:31.132923 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:52:31.132900    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm_odh-ai-gateway-infra(74b51096-1f70-49e2-ab84-38544ff8e612)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm" podUID="74b51096-1f70-49e2-ab84-38544ff8e612"
Jul 17 07:52:31.153534 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:31.153505    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"]
Jul 17 07:52:32.273972 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:32.273944    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"
Jul 17 07:52:32.417142 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:32.417056    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b51096-1f70-49e2-ab84-38544ff8e612-maas-api-service-ca\") pod \"74b51096-1f70-49e2-ab84-38544ff8e612\" (UID: \"74b51096-1f70-49e2-ab84-38544ff8e612\") "
Jul 17 07:52:32.417429 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:32.417404    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b51096-1f70-49e2-ab84-38544ff8e612-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74b51096-1f70-49e2-ab84-38544ff8e612" (UID: "74b51096-1f70-49e2-ab84-38544ff8e612"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:52:32.517842 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:32.517802    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b51096-1f70-49e2-ab84-38544ff8e612-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:52:33.145816 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:33.145786    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"
Jul 17 07:52:33.145984 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:33.145817    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm" event={"ID":"74b51096-1f70-49e2-ab84-38544ff8e612","Type":"ContainerDied","Data":"cd6de66b09d0cd5800039c48959387c35db0eec76fac5d0039b3a0ff121d3ab9"}
Jul 17 07:52:33.145984 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:33.145879    2546 scope.go:117] "RemoveContainer" containerID="2bddd2d3a50305b7aba0522637bab5e301ebfce4d2f0656d436f824e518e3ea6"
Jul 17 07:52:33.172138 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:33.172110    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"]
Jul 17 07:52:33.180441 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:33.180415    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-k9jlm"]
Jul 17 07:52:33.905078 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:33.905038    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b51096-1f70-49e2-ab84-38544ff8e612" path="/var/lib/kubelet/pods/74b51096-1f70-49e2-ab84-38544ff8e612/volumes"
Jul 17 07:52:40.226029 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.225939    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj"]
Jul 17 07:52:40.226514 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.226365    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b51096-1f70-49e2-ab84-38544ff8e612" containerName="revoke-keys"
Jul 17 07:52:40.226514 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.226379    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b51096-1f70-49e2-ab84-38544ff8e612" containerName="revoke-keys"
Jul 17 07:52:40.226514 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.226400    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b51096-1f70-49e2-ab84-38544ff8e612" containerName="revoke-keys"
Jul 17 07:52:40.226514 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.226405    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b51096-1f70-49e2-ab84-38544ff8e612" containerName="revoke-keys"
Jul 17 07:52:40.226514 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.226461    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b51096-1f70-49e2-ab84-38544ff8e612" containerName="revoke-keys"
Jul 17 07:52:40.226514 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.226471    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b51096-1f70-49e2-ab84-38544ff8e612" containerName="revoke-keys"
Jul 17 07:52:40.231020 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.230996    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj"
Jul 17 07:52:40.233869 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.233850    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:52:40.233974 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.233858    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:52:40.239345 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.239321    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj"]
Jul 17 07:52:40.288434 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.288399    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08103ee3-a530-41a2-ab0e-3cd8559de326-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj\" (UID: \"08103ee3-a530-41a2-ab0e-3cd8559de326\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj"
Jul 17 07:52:40.389332 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.389299    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08103ee3-a530-41a2-ab0e-3cd8559de326-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj\" (UID: \"08103ee3-a530-41a2-ab0e-3cd8559de326\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj"
Jul 17 07:52:40.389958 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.389937    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08103ee3-a530-41a2-ab0e-3cd8559de326-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj\" (UID: \"08103ee3-a530-41a2-ab0e-3cd8559de326\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj"
Jul 17 07:52:40.542253 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.542215    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj"
Jul 17 07:52:40.675048 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:40.675023    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj"]
Jul 17 07:52:40.677405 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:52:40.677378    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08103ee3_a530_41a2_ab0e_3cd8559de326.slice/crio-1bd5623125401781d4103d21228c1ad52856f30e090d5fd265ba03f99ea0e104 WatchSource:0}: Error finding container 1bd5623125401781d4103d21228c1ad52856f30e090d5fd265ba03f99ea0e104: Status 404 returned error can't find the container with id 1bd5623125401781d4103d21228c1ad52856f30e090d5fd265ba03f99ea0e104
Jul 17 07:52:41.189470 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:41.189369    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj" event={"ID":"08103ee3-a530-41a2-ab0e-3cd8559de326","Type":"ContainerStarted","Data":"5aaf1ab52c9fec4371717e8a80129016df63c07222e2c996a48335b4bdc57a08"}
Jul 17 07:52:41.189470 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:41.189432    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj" event={"ID":"08103ee3-a530-41a2-ab0e-3cd8559de326","Type":"ContainerStarted","Data":"1bd5623125401781d4103d21228c1ad52856f30e090d5fd265ba03f99ea0e104"}
Jul 17 07:52:41.207631 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:41.207584    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj" podStartSLOduration=1.207566964 podStartE2EDuration="1.207566964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:52:41.205771524 +0000 UTC m=+2424.011968711" watchObservedRunningTime="2026-07-17 07:52:41.207566964 +0000 UTC m=+2424.013764138"
Jul 17 07:52:42.195659 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:42.195624    2546 generic.go:356] "Generic (PLEG): container finished" podID="08103ee3-a530-41a2-ab0e-3cd8559de326" containerID="5aaf1ab52c9fec4371717e8a80129016df63c07222e2c996a48335b4bdc57a08" exitCode=0
Jul 17 07:52:42.196071 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:42.195699    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj" event={"ID":"08103ee3-a530-41a2-ab0e-3cd8559de326","Type":"ContainerDied","Data":"5aaf1ab52c9fec4371717e8a80129016df63c07222e2c996a48335b4bdc57a08"}
Jul 17 07:52:43.333311 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:43.333285    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj"
Jul 17 07:52:43.413018 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:43.412983    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08103ee3-a530-41a2-ab0e-3cd8559de326-maas-api-service-ca\") pod \"08103ee3-a530-41a2-ab0e-3cd8559de326\" (UID: \"08103ee3-a530-41a2-ab0e-3cd8559de326\") "
Jul 17 07:52:43.413377 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:43.413352    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08103ee3-a530-41a2-ab0e-3cd8559de326-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "08103ee3-a530-41a2-ab0e-3cd8559de326" (UID: "08103ee3-a530-41a2-ab0e-3cd8559de326"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:52:43.513701 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:43.513586    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08103ee3-a530-41a2-ab0e-3cd8559de326-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:52:44.207463 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:44.207369    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj" event={"ID":"08103ee3-a530-41a2-ab0e-3cd8559de326","Type":"ContainerDied","Data":"1bd5623125401781d4103d21228c1ad52856f30e090d5fd265ba03f99ea0e104"}
Jul 17 07:52:44.207463 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:44.207397    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj"
Jul 17 07:52:44.207649 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:52:44.207465    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bd5623125401781d4103d21228c1ad52856f30e090d5fd265ba03f99ea0e104"
Jul 17 07:53:21.758439 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.758403    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"]
Jul 17 07:53:21.758885 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.758828    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b51096-1f70-49e2-ab84-38544ff8e612" containerName="revoke-keys"
Jul 17 07:53:21.758885 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.758841    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b51096-1f70-49e2-ab84-38544ff8e612" containerName="revoke-keys"
Jul 17 07:53:21.758885 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.758858    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08103ee3-a530-41a2-ab0e-3cd8559de326" containerName="revoke-keys"
Jul 17 07:53:21.758885 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.758864    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="08103ee3-a530-41a2-ab0e-3cd8559de326" containerName="revoke-keys"
Jul 17 07:53:21.759040 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.758935    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="08103ee3-a530-41a2-ab0e-3cd8559de326" containerName="revoke-keys"
Jul 17 07:53:21.759040 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.758947    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b51096-1f70-49e2-ab84-38544ff8e612" containerName="revoke-keys"
Jul 17 07:53:21.763415 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.763397    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"
Jul 17 07:53:21.766063 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.766042    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:53:21.766145 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.766047    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:53:21.770390 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.770361    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"]
Jul 17 07:53:21.777969 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.777942    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/532cea7a-a3cd-437d-8237-1a7fa158a704-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-vww25\" (UID: \"532cea7a-a3cd-437d-8237-1a7fa158a704\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"
Jul 17 07:53:21.878793 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.878758    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/532cea7a-a3cd-437d-8237-1a7fa158a704-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-vww25\" (UID: \"532cea7a-a3cd-437d-8237-1a7fa158a704\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"
Jul 17 07:53:21.879392 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:21.879373    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/532cea7a-a3cd-437d-8237-1a7fa158a704-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-vww25\" (UID: \"532cea7a-a3cd-437d-8237-1a7fa158a704\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"
Jul 17 07:53:22.075977 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:22.075940    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"
Jul 17 07:53:22.226376 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:22.226343    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"]
Jul 17 07:53:22.228768 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:53:22.228737    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532cea7a_a3cd_437d_8237_1a7fa158a704.slice/crio-4cd6e35134c25591e3e7267dea9333aeb4a9ab60d9d0fec98a8cafb5ce7efae6 WatchSource:0}: Error finding container 4cd6e35134c25591e3e7267dea9333aeb4a9ab60d9d0fec98a8cafb5ce7efae6: Status 404 returned error can't find the container with id 4cd6e35134c25591e3e7267dea9333aeb4a9ab60d9d0fec98a8cafb5ce7efae6
Jul 17 07:53:22.393480 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:22.393444    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25" event={"ID":"532cea7a-a3cd-437d-8237-1a7fa158a704","Type":"ContainerStarted","Data":"4cd6e35134c25591e3e7267dea9333aeb4a9ab60d9d0fec98a8cafb5ce7efae6"}
Jul 17 07:53:23.400503 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:23.400461    2546 generic.go:356] "Generic (PLEG): container finished" podID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerID="7223a830f74d1e5d3d26de487b5e6f775b634cecae1ed33fba4fa9d9ab4ca617" exitCode=6
Jul 17 07:53:23.401016 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:23.400532    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25" event={"ID":"532cea7a-a3cd-437d-8237-1a7fa158a704","Type":"ContainerDied","Data":"7223a830f74d1e5d3d26de487b5e6f775b634cecae1ed33fba4fa9d9ab4ca617"}
Jul 17 07:53:23.401016 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:23.400864    2546 scope.go:117] "RemoveContainer" containerID="7223a830f74d1e5d3d26de487b5e6f775b634cecae1ed33fba4fa9d9ab4ca617"
Jul 17 07:53:24.407154 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:24.407121    2546 generic.go:356] "Generic (PLEG): container finished" podID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerID="df4257e8d250c85b6f8d4501d36e6751128abd36ad28203e2e8f42629c29b9d4" exitCode=6
Jul 17 07:53:24.407566 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:24.407196    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25" event={"ID":"532cea7a-a3cd-437d-8237-1a7fa158a704","Type":"ContainerDied","Data":"df4257e8d250c85b6f8d4501d36e6751128abd36ad28203e2e8f42629c29b9d4"}
Jul 17 07:53:24.407566 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:24.407244    2546 scope.go:117] "RemoveContainer" containerID="7223a830f74d1e5d3d26de487b5e6f775b634cecae1ed33fba4fa9d9ab4ca617"
Jul 17 07:53:24.407566 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:24.407417    2546 scope.go:117] "RemoveContainer" containerID="df4257e8d250c85b6f8d4501d36e6751128abd36ad28203e2e8f42629c29b9d4"
Jul 17 07:53:24.407727 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:53:24.407649    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-vww25_odh-ai-gateway-infra(532cea7a-a3cd-437d-8237-1a7fa158a704)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704"
Jul 17 07:53:25.414509 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:25.414481    2546 scope.go:117] "RemoveContainer" containerID="df4257e8d250c85b6f8d4501d36e6751128abd36ad28203e2e8f42629c29b9d4"
Jul 17 07:53:25.414920 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:53:25.414700    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-vww25_odh-ai-gateway-infra(532cea7a-a3cd-437d-8237-1a7fa158a704)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704"
Jul 17 07:53:38.898738 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:38.898705    2546 scope.go:117] "RemoveContainer" containerID="df4257e8d250c85b6f8d4501d36e6751128abd36ad28203e2e8f42629c29b9d4"
Jul 17 07:53:39.487999 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:39.487968    2546 generic.go:356] "Generic (PLEG): container finished" podID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerID="4405eb281e9f485a5fce3b10744bd60432d715e88297e411941688881acfe738" exitCode=6
Jul 17 07:53:39.488142 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:39.488031    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25" event={"ID":"532cea7a-a3cd-437d-8237-1a7fa158a704","Type":"ContainerDied","Data":"4405eb281e9f485a5fce3b10744bd60432d715e88297e411941688881acfe738"}
Jul 17 07:53:39.488142 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:39.488080    2546 scope.go:117] "RemoveContainer" containerID="df4257e8d250c85b6f8d4501d36e6751128abd36ad28203e2e8f42629c29b9d4"
Jul 17 07:53:39.488369 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:39.488346    2546 scope.go:117] "RemoveContainer" containerID="4405eb281e9f485a5fce3b10744bd60432d715e88297e411941688881acfe738"
Jul 17 07:53:39.488651 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:53:39.488624    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-vww25_odh-ai-gateway-infra(532cea7a-a3cd-437d-8237-1a7fa158a704)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704"
Jul 17 07:53:40.517061 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:40.517025    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"]
Jul 17 07:53:40.654553 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:40.654531    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"
Jul 17 07:53:40.762354 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:40.762316    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/532cea7a-a3cd-437d-8237-1a7fa158a704-maas-api-service-ca\") pod \"532cea7a-a3cd-437d-8237-1a7fa158a704\" (UID: \"532cea7a-a3cd-437d-8237-1a7fa158a704\") "
Jul 17 07:53:40.762703 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:40.762654    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/532cea7a-a3cd-437d-8237-1a7fa158a704-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "532cea7a-a3cd-437d-8237-1a7fa158a704" (UID: "532cea7a-a3cd-437d-8237-1a7fa158a704"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:53:40.863321 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:40.863287    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/532cea7a-a3cd-437d-8237-1a7fa158a704-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:53:41.502458 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:41.502423    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25" event={"ID":"532cea7a-a3cd-437d-8237-1a7fa158a704","Type":"ContainerDied","Data":"4cd6e35134c25591e3e7267dea9333aeb4a9ab60d9d0fec98a8cafb5ce7efae6"}
Jul 17 07:53:41.502652 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:41.502489    2546 scope.go:117] "RemoveContainer" containerID="4405eb281e9f485a5fce3b10744bd60432d715e88297e411941688881acfe738"
Jul 17 07:53:41.502652 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:41.502437    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"
Jul 17 07:53:41.523756 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:41.523730    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"]
Jul 17 07:53:41.535139 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:41.530396    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-vww25"]
Jul 17 07:53:41.904640 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:41.904605    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704" path="/var/lib/kubelet/pods/532cea7a-a3cd-437d-8237-1a7fa158a704/volumes"
Jul 17 07:53:53.599695 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.599647    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"]
Jul 17 07:53:53.600141 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.600077    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerName="revoke-keys"
Jul 17 07:53:53.600141 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.600089    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerName="revoke-keys"
Jul 17 07:53:53.600141 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.600107    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerName="revoke-keys"
Jul 17 07:53:53.600141 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.600113    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerName="revoke-keys"
Jul 17 07:53:53.600294 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.600172    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerName="revoke-keys"
Jul 17 07:53:53.600294 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.600179    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerName="revoke-keys"
Jul 17 07:53:53.600294 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.600187    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerName="revoke-keys"
Jul 17 07:53:53.603248 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.603230    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"
Jul 17 07:53:53.605902 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.605878    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:53:53.606006 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.605947    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:53:53.610744 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.610542    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"]
Jul 17 07:53:53.789892 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.789842    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40f32a2d-31a2-4636-bd9b-a3c3b093dc8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b\" (UID: \"40f32a2d-31a2-4636-bd9b-a3c3b093dc8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"
Jul 17 07:53:53.890580 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.890497    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40f32a2d-31a2-4636-bd9b-a3c3b093dc8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b\" (UID: \"40f32a2d-31a2-4636-bd9b-a3c3b093dc8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"
Jul 17 07:53:53.891133 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.891114    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40f32a2d-31a2-4636-bd9b-a3c3b093dc8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b\" (UID: \"40f32a2d-31a2-4636-bd9b-a3c3b093dc8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"
Jul 17 07:53:53.915419 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:53.915393    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"
Jul 17 07:53:54.053507 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:54.053474    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"]
Jul 17 07:53:54.055874 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:53:54.055845    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40f32a2d_31a2_4636_bd9b_a3c3b093dc8e.slice/crio-b0c8214abbf94cd06d21f148edc4fcc2713334157fde8c83195e9832deb0dae4 WatchSource:0}: Error finding container b0c8214abbf94cd06d21f148edc4fcc2713334157fde8c83195e9832deb0dae4: Status 404 returned error can't find the container with id b0c8214abbf94cd06d21f148edc4fcc2713334157fde8c83195e9832deb0dae4
Jul 17 07:53:54.569660 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:54.569555    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b" event={"ID":"40f32a2d-31a2-4636-bd9b-a3c3b093dc8e","Type":"ContainerStarted","Data":"4e71f9501ebd698379f32259694e8e80042f20c88976b6ef6aa24a671b675132"}
Jul 17 07:53:54.569660 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:54.569612    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b" event={"ID":"40f32a2d-31a2-4636-bd9b-a3c3b093dc8e","Type":"ContainerStarted","Data":"b0c8214abbf94cd06d21f148edc4fcc2713334157fde8c83195e9832deb0dae4"}
Jul 17 07:53:54.585197 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:54.585144    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b" podStartSLOduration=1.585127371 podStartE2EDuration="1.585127371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:53:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:53:54.584274338 +0000 UTC m=+2497.390471571" watchObservedRunningTime="2026-07-17 07:53:54.585127371 +0000 UTC m=+2497.391324546"
Jul 17 07:53:55.575580 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:55.575544    2546 generic.go:356] "Generic (PLEG): container finished" podID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerID="4e71f9501ebd698379f32259694e8e80042f20c88976b6ef6aa24a671b675132" exitCode=6
Jul 17 07:53:55.575580 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:55.575584    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b" event={"ID":"40f32a2d-31a2-4636-bd9b-a3c3b093dc8e","Type":"ContainerDied","Data":"4e71f9501ebd698379f32259694e8e80042f20c88976b6ef6aa24a671b675132"}
Jul 17 07:53:55.576017 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:55.575844    2546 scope.go:117] "RemoveContainer" containerID="4e71f9501ebd698379f32259694e8e80042f20c88976b6ef6aa24a671b675132"
Jul 17 07:53:56.582089 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:56.581997    2546 generic.go:356] "Generic (PLEG): container finished" podID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerID="09dad648f463fecc831a95e1e8979e38c6d268e04f0267354c4214fc8093835b" exitCode=6
Jul 17 07:53:56.582514 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:56.582077    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b" event={"ID":"40f32a2d-31a2-4636-bd9b-a3c3b093dc8e","Type":"ContainerDied","Data":"09dad648f463fecc831a95e1e8979e38c6d268e04f0267354c4214fc8093835b"}
Jul 17 07:53:56.582514 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:56.582135    2546 scope.go:117] "RemoveContainer" containerID="4e71f9501ebd698379f32259694e8e80042f20c88976b6ef6aa24a671b675132"
Jul 17 07:53:56.582514 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:56.582384    2546 scope.go:117] "RemoveContainer" containerID="09dad648f463fecc831a95e1e8979e38c6d268e04f0267354c4214fc8093835b"
Jul 17 07:53:56.582629 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:53:56.582609    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b_odh-ai-gateway-infra(40f32a2d-31a2-4636-bd9b-a3c3b093dc8e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e"
Jul 17 07:53:57.588494 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:53:57.588465    2546 scope.go:117] "RemoveContainer" containerID="09dad648f463fecc831a95e1e8979e38c6d268e04f0267354c4214fc8093835b"
Jul 17 07:53:57.588909 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:53:57.588705    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b_odh-ai-gateway-infra(40f32a2d-31a2-4636-bd9b-a3c3b093dc8e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e"
Jul 17 07:54:09.905602 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:09.905505    2546 scope.go:117] "RemoveContainer" containerID="09dad648f463fecc831a95e1e8979e38c6d268e04f0267354c4214fc8093835b"
Jul 17 07:54:10.653360 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:10.653329    2546 generic.go:356] "Generic (PLEG): container finished" podID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerID="e8e22e0d4e1fc4d2105401ea9e5a7827a51169439813437b0b2c036105268db3" exitCode=6
Jul 17 07:54:10.653525 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:10.653399    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b" event={"ID":"40f32a2d-31a2-4636-bd9b-a3c3b093dc8e","Type":"ContainerDied","Data":"e8e22e0d4e1fc4d2105401ea9e5a7827a51169439813437b0b2c036105268db3"}
Jul 17 07:54:10.653525 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:10.653462    2546 scope.go:117] "RemoveContainer" containerID="09dad648f463fecc831a95e1e8979e38c6d268e04f0267354c4214fc8093835b"
Jul 17 07:54:10.653782 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:10.653765    2546 scope.go:117] "RemoveContainer" containerID="e8e22e0d4e1fc4d2105401ea9e5a7827a51169439813437b0b2c036105268db3"
Jul 17 07:54:10.653995 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:54:10.653973    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b_odh-ai-gateway-infra(40f32a2d-31a2-4636-bd9b-a3c3b093dc8e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e"
Jul 17 07:54:11.685023 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:11.684988    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"]
Jul 17 07:54:11.829384 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:11.829355    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"
Jul 17 07:54:11.859013 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:11.858980    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40f32a2d-31a2-4636-bd9b-a3c3b093dc8e-maas-api-service-ca\") pod \"40f32a2d-31a2-4636-bd9b-a3c3b093dc8e\" (UID: \"40f32a2d-31a2-4636-bd9b-a3c3b093dc8e\") "
Jul 17 07:54:11.859336 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:11.859312    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40f32a2d-31a2-4636-bd9b-a3c3b093dc8e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" (UID: "40f32a2d-31a2-4636-bd9b-a3c3b093dc8e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:54:11.960534 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:11.960432    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40f32a2d-31a2-4636-bd9b-a3c3b093dc8e-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:54:12.666970 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:12.666934    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"
Jul 17 07:54:12.666970 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:12.666965    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b" event={"ID":"40f32a2d-31a2-4636-bd9b-a3c3b093dc8e","Type":"ContainerDied","Data":"b0c8214abbf94cd06d21f148edc4fcc2713334157fde8c83195e9832deb0dae4"}
Jul 17 07:54:12.667242 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:12.667027    2546 scope.go:117] "RemoveContainer" containerID="e8e22e0d4e1fc4d2105401ea9e5a7827a51169439813437b0b2c036105268db3"
Jul 17 07:54:12.683145 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:12.683115    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"]
Jul 17 07:54:12.684947 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:12.684920    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-xc65b"]
Jul 17 07:54:13.905159 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.905123    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" path="/var/lib/kubelet/pods/40f32a2d-31a2-4636-bd9b-a3c3b093dc8e/volumes"
Jul 17 07:54:13.968318 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.968289    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5"]
Jul 17 07:54:13.968707 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.968694    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerName="revoke-keys"
Jul 17 07:54:13.968759 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.968709    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="532cea7a-a3cd-437d-8237-1a7fa158a704" containerName="revoke-keys"
Jul 17 07:54:13.968759 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.968718    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerName="revoke-keys"
Jul 17 07:54:13.968759 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.968724    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerName="revoke-keys"
Jul 17 07:54:13.968759 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.968747    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerName="revoke-keys"
Jul 17 07:54:13.968759 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.968752    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerName="revoke-keys"
Jul 17 07:54:13.968914 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.968817    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerName="revoke-keys"
Jul 17 07:54:13.968914 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.968827    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerName="revoke-keys"
Jul 17 07:54:13.968914 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.968833    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerName="revoke-keys"
Jul 17 07:54:13.973371 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.973348    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5"
Jul 17 07:54:13.978653 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.978631    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:54:13.978792 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.978699    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:54:13.990275 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:13.990246    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5"]
Jul 17 07:54:14.082197 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:14.082156    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f418af02-cf9b-4f3a-87ee-8fb98fdbd97e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5\" (UID: \"f418af02-cf9b-4f3a-87ee-8fb98fdbd97e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5"
Jul 17 07:54:14.182971 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:14.182857    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f418af02-cf9b-4f3a-87ee-8fb98fdbd97e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5\" (UID: \"f418af02-cf9b-4f3a-87ee-8fb98fdbd97e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5"
Jul 17 07:54:14.183586 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:14.183562    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f418af02-cf9b-4f3a-87ee-8fb98fdbd97e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5\" (UID: \"f418af02-cf9b-4f3a-87ee-8fb98fdbd97e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5"
Jul 17 07:54:14.283618 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:14.283570    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5"
Jul 17 07:54:14.422409 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:14.422376    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5"]
Jul 17 07:54:14.425714 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:54:14.425682    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf418af02_cf9b_4f3a_87ee_8fb98fdbd97e.slice/crio-943c0cda05e7021eeff8ee085c21b02560374c89421e144e6b664305a95898a2 WatchSource:0}: Error finding container 943c0cda05e7021eeff8ee085c21b02560374c89421e144e6b664305a95898a2: Status 404 returned error can't find the container with id 943c0cda05e7021eeff8ee085c21b02560374c89421e144e6b664305a95898a2
Jul 17 07:54:14.687738 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:14.687659    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5" event={"ID":"f418af02-cf9b-4f3a-87ee-8fb98fdbd97e","Type":"ContainerStarted","Data":"1c73ae66b05a86fef39f284303d3ff7f09ac106b44128fc6dbb85cb36236a1f3"}
Jul 17 07:54:14.687738 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:14.687725    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5" event={"ID":"f418af02-cf9b-4f3a-87ee-8fb98fdbd97e","Type":"ContainerStarted","Data":"943c0cda05e7021eeff8ee085c21b02560374c89421e144e6b664305a95898a2"}
Jul 17 07:54:14.713985 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:14.713938    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5" podStartSLOduration=1.713920732 podStartE2EDuration="1.713920732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:54:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:54:14.712322728 +0000 UTC m=+2517.518519905" watchObservedRunningTime="2026-07-17 07:54:14.713920732 +0000 UTC m=+2517.520117908"
Jul 17 07:54:15.693832 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:15.693795    2546 generic.go:356] "Generic (PLEG): container finished" podID="f418af02-cf9b-4f3a-87ee-8fb98fdbd97e" containerID="1c73ae66b05a86fef39f284303d3ff7f09ac106b44128fc6dbb85cb36236a1f3" exitCode=0
Jul 17 07:54:15.694192 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:15.693883    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5" event={"ID":"f418af02-cf9b-4f3a-87ee-8fb98fdbd97e","Type":"ContainerDied","Data":"1c73ae66b05a86fef39f284303d3ff7f09ac106b44128fc6dbb85cb36236a1f3"}
Jul 17 07:54:16.827872 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:16.827843    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5"
Jul 17 07:54:16.911359 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:16.911333    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f418af02-cf9b-4f3a-87ee-8fb98fdbd97e-maas-api-service-ca\") pod \"f418af02-cf9b-4f3a-87ee-8fb98fdbd97e\" (UID: \"f418af02-cf9b-4f3a-87ee-8fb98fdbd97e\") "
Jul 17 07:54:16.911655 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:16.911632    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f418af02-cf9b-4f3a-87ee-8fb98fdbd97e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f418af02-cf9b-4f3a-87ee-8fb98fdbd97e" (UID: "f418af02-cf9b-4f3a-87ee-8fb98fdbd97e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:54:17.012510 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:17.012419    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f418af02-cf9b-4f3a-87ee-8fb98fdbd97e-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:54:17.703991 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:17.703960    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5"
Jul 17 07:54:17.704178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:17.703958    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5" event={"ID":"f418af02-cf9b-4f3a-87ee-8fb98fdbd97e","Type":"ContainerDied","Data":"943c0cda05e7021eeff8ee085c21b02560374c89421e144e6b664305a95898a2"}
Jul 17 07:54:17.704178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:17.704094    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="943c0cda05e7021eeff8ee085c21b02560374c89421e144e6b664305a95898a2"
Jul 17 07:54:35.665089 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.665054    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"]
Jul 17 07:54:35.665569 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.665435    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerName="revoke-keys"
Jul 17 07:54:35.665569 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.665447    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f32a2d-31a2-4636-bd9b-a3c3b093dc8e" containerName="revoke-keys"
Jul 17 07:54:35.665569 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.665493    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f418af02-cf9b-4f3a-87ee-8fb98fdbd97e" containerName="revoke-keys"
Jul 17 07:54:35.665569 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.665498    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f418af02-cf9b-4f3a-87ee-8fb98fdbd97e" containerName="revoke-keys"
Jul 17 07:54:35.665569 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.665561    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="f418af02-cf9b-4f3a-87ee-8fb98fdbd97e" containerName="revoke-keys"
Jul 17 07:54:35.668678 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.668651    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"
Jul 17 07:54:35.671958 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.671932    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:54:35.672556 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.672538    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:54:35.678818 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.678794    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"]
Jul 17 07:54:35.802072 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.802032    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12011c9c-247e-4653-bebc-4b72950e7e20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk\" (UID: \"12011c9c-247e-4653-bebc-4b72950e7e20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"
Jul 17 07:54:35.902611 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.902576    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12011c9c-247e-4653-bebc-4b72950e7e20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk\" (UID: \"12011c9c-247e-4653-bebc-4b72950e7e20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"
Jul 17 07:54:35.903249 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.903222    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12011c9c-247e-4653-bebc-4b72950e7e20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk\" (UID: \"12011c9c-247e-4653-bebc-4b72950e7e20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"
Jul 17 07:54:35.980850 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:35.980740    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"
Jul 17 07:54:36.131236 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:36.131202    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"]
Jul 17 07:54:36.134035 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:54:36.134005    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12011c9c_247e_4653_bebc_4b72950e7e20.slice/crio-0f9926a8a654235d519bcf4b71f1ea42aa64755bdbb06ddcea0e15c8b603e020 WatchSource:0}: Error finding container 0f9926a8a654235d519bcf4b71f1ea42aa64755bdbb06ddcea0e15c8b603e020: Status 404 returned error can't find the container with id 0f9926a8a654235d519bcf4b71f1ea42aa64755bdbb06ddcea0e15c8b603e020
Jul 17 07:54:36.800418 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:36.800391    2546 generic.go:356] "Generic (PLEG): container finished" podID="12011c9c-247e-4653-bebc-4b72950e7e20" containerID="2daca4986839289fc81286acd3da5e51bdd1bbb8171a7c37a0f7b1ad3b02f392" exitCode=6
Jul 17 07:54:36.800804 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:36.800453    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk" event={"ID":"12011c9c-247e-4653-bebc-4b72950e7e20","Type":"ContainerDied","Data":"2daca4986839289fc81286acd3da5e51bdd1bbb8171a7c37a0f7b1ad3b02f392"}
Jul 17 07:54:36.800804 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:36.800503    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk" event={"ID":"12011c9c-247e-4653-bebc-4b72950e7e20","Type":"ContainerStarted","Data":"0f9926a8a654235d519bcf4b71f1ea42aa64755bdbb06ddcea0e15c8b603e020"}
Jul 17 07:54:36.800804 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:36.800657    2546 scope.go:117] "RemoveContainer" containerID="2daca4986839289fc81286acd3da5e51bdd1bbb8171a7c37a0f7b1ad3b02f392"
Jul 17 07:54:37.806647 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:37.806609    2546 generic.go:356] "Generic (PLEG): container finished" podID="12011c9c-247e-4653-bebc-4b72950e7e20" containerID="6fd97ca6f0dd2e1958d2e1449e42b459b30d5f21d7432b2406d3597c81ed8b91" exitCode=6
Jul 17 07:54:37.806647 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:37.806649    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk" event={"ID":"12011c9c-247e-4653-bebc-4b72950e7e20","Type":"ContainerDied","Data":"6fd97ca6f0dd2e1958d2e1449e42b459b30d5f21d7432b2406d3597c81ed8b91"}
Jul 17 07:54:37.807190 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:37.806768    2546 scope.go:117] "RemoveContainer" containerID="2daca4986839289fc81286acd3da5e51bdd1bbb8171a7c37a0f7b1ad3b02f392"
Jul 17 07:54:37.807190 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:37.806976    2546 scope.go:117] "RemoveContainer" containerID="6fd97ca6f0dd2e1958d2e1449e42b459b30d5f21d7432b2406d3597c81ed8b91"
Jul 17 07:54:37.807304 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:54:37.807197    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk_odh-ai-gateway-infra(12011c9c-247e-4653-bebc-4b72950e7e20)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk" podUID="12011c9c-247e-4653-bebc-4b72950e7e20"
Jul 17 07:54:38.813426 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:38.813399    2546 scope.go:117] "RemoveContainer" containerID="6fd97ca6f0dd2e1958d2e1449e42b459b30d5f21d7432b2406d3597c81ed8b91"
Jul 17 07:54:38.813825 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:54:38.813627    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk_odh-ai-gateway-infra(12011c9c-247e-4653-bebc-4b72950e7e20)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk" podUID="12011c9c-247e-4653-bebc-4b72950e7e20"
Jul 17 07:54:43.690712 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:43.690653    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"]
Jul 17 07:54:43.695499 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:43.695479    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"
Jul 17 07:54:43.709860 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:43.709824    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"]
Jul 17 07:54:43.768855 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:43.768820    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87c8fce9-3d1a-4f92-9ba1-99c4f5047615-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp\" (UID: \"87c8fce9-3d1a-4f92-9ba1-99c4f5047615\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"
Jul 17 07:54:43.869941 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:43.869907    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87c8fce9-3d1a-4f92-9ba1-99c4f5047615-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp\" (UID: \"87c8fce9-3d1a-4f92-9ba1-99c4f5047615\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"
Jul 17 07:54:43.870519 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:43.870491    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87c8fce9-3d1a-4f92-9ba1-99c4f5047615-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp\" (UID: \"87c8fce9-3d1a-4f92-9ba1-99c4f5047615\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"
Jul 17 07:54:44.009811 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:44.009690    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"
Jul 17 07:54:44.142265 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:44.142236    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"]
Jul 17 07:54:44.144510 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:54:44.144482    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c8fce9_3d1a_4f92_9ba1_99c4f5047615.slice/crio-134ec15af2e3e46c283c6f169602234b15cab4b7ee273edff362c3b8503b768c WatchSource:0}: Error finding container 134ec15af2e3e46c283c6f169602234b15cab4b7ee273edff362c3b8503b768c: Status 404 returned error can't find the container with id 134ec15af2e3e46c283c6f169602234b15cab4b7ee273edff362c3b8503b768c
Jul 17 07:54:44.844840 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:44.844803    2546 generic.go:356] "Generic (PLEG): container finished" podID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerID="02b684a89aca461fa32c08061b5a82a7c77b03dfe172c67a47a53a2af2ce347c" exitCode=6
Jul 17 07:54:44.845208 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:44.844887    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp" event={"ID":"87c8fce9-3d1a-4f92-9ba1-99c4f5047615","Type":"ContainerDied","Data":"02b684a89aca461fa32c08061b5a82a7c77b03dfe172c67a47a53a2af2ce347c"}
Jul 17 07:54:44.845208 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:44.844948    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp" event={"ID":"87c8fce9-3d1a-4f92-9ba1-99c4f5047615","Type":"ContainerStarted","Data":"134ec15af2e3e46c283c6f169602234b15cab4b7ee273edff362c3b8503b768c"}
Jul 17 07:54:44.845208 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:44.845096    2546 scope.go:117] "RemoveContainer" containerID="02b684a89aca461fa32c08061b5a82a7c77b03dfe172c67a47a53a2af2ce347c"
Jul 17 07:54:45.852292 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:45.852252    2546 generic.go:356] "Generic (PLEG): container finished" podID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerID="714431b3a06cab9ae558030e9629a47033ac19030ca846eb29eac1509124c264" exitCode=6
Jul 17 07:54:45.852750 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:45.852330    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp" event={"ID":"87c8fce9-3d1a-4f92-9ba1-99c4f5047615","Type":"ContainerDied","Data":"714431b3a06cab9ae558030e9629a47033ac19030ca846eb29eac1509124c264"}
Jul 17 07:54:45.852750 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:45.852396    2546 scope.go:117] "RemoveContainer" containerID="02b684a89aca461fa32c08061b5a82a7c77b03dfe172c67a47a53a2af2ce347c"
Jul 17 07:54:45.852750 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:45.852568    2546 scope.go:117] "RemoveContainer" containerID="714431b3a06cab9ae558030e9629a47033ac19030ca846eb29eac1509124c264"
Jul 17 07:54:45.852920 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:54:45.852883    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp_odh-ai-gateway-infra(87c8fce9-3d1a-4f92-9ba1-99c4f5047615)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615"
Jul 17 07:54:46.859091 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:46.859065    2546 scope.go:117] "RemoveContainer" containerID="714431b3a06cab9ae558030e9629a47033ac19030ca846eb29eac1509124c264"
Jul 17 07:54:46.859492 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:54:46.859260    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp_odh-ai-gateway-infra(87c8fce9-3d1a-4f92-9ba1-99c4f5047615)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615"
Jul 17 07:54:50.898758 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:50.898727    2546 scope.go:117] "RemoveContainer" containerID="6fd97ca6f0dd2e1958d2e1449e42b459b30d5f21d7432b2406d3597c81ed8b91"
Jul 17 07:54:51.888990 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:51.888959    2546 generic.go:356] "Generic (PLEG): container finished" podID="12011c9c-247e-4653-bebc-4b72950e7e20" containerID="fa1fcde3d8bb6c37b4638d565ebf4057f9dd7ed4f1cfbcd4ac7bd780608ea014" exitCode=6
Jul 17 07:54:51.889159 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:51.889020    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk" event={"ID":"12011c9c-247e-4653-bebc-4b72950e7e20","Type":"ContainerDied","Data":"fa1fcde3d8bb6c37b4638d565ebf4057f9dd7ed4f1cfbcd4ac7bd780608ea014"}
Jul 17 07:54:51.889159 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:51.889077    2546 scope.go:117] "RemoveContainer" containerID="6fd97ca6f0dd2e1958d2e1449e42b459b30d5f21d7432b2406d3597c81ed8b91"
Jul 17 07:54:51.889407 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:51.889379    2546 scope.go:117] "RemoveContainer" containerID="fa1fcde3d8bb6c37b4638d565ebf4057f9dd7ed4f1cfbcd4ac7bd780608ea014"
Jul 17 07:54:51.889681 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:54:51.889646    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk_odh-ai-gateway-infra(12011c9c-247e-4653-bebc-4b72950e7e20)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk" podUID="12011c9c-247e-4653-bebc-4b72950e7e20"
Jul 17 07:54:52.921026 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:52.920988    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"]
Jul 17 07:54:53.059318 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:53.059293    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"
Jul 17 07:54:53.156799 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:53.156765    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12011c9c-247e-4653-bebc-4b72950e7e20-maas-api-service-ca\") pod \"12011c9c-247e-4653-bebc-4b72950e7e20\" (UID: \"12011c9c-247e-4653-bebc-4b72950e7e20\") "
Jul 17 07:54:53.157132 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:53.157111    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12011c9c-247e-4653-bebc-4b72950e7e20-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "12011c9c-247e-4653-bebc-4b72950e7e20" (UID: "12011c9c-247e-4653-bebc-4b72950e7e20"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:54:53.258013 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:53.257920    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12011c9c-247e-4653-bebc-4b72950e7e20-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:54:53.901634 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:53.901609    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"
Jul 17 07:54:53.905260 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:53.905228    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk" event={"ID":"12011c9c-247e-4653-bebc-4b72950e7e20","Type":"ContainerDied","Data":"0f9926a8a654235d519bcf4b71f1ea42aa64755bdbb06ddcea0e15c8b603e020"}
Jul 17 07:54:53.905404 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:53.905286    2546 scope.go:117] "RemoveContainer" containerID="fa1fcde3d8bb6c37b4638d565ebf4057f9dd7ed4f1cfbcd4ac7bd780608ea014"
Jul 17 07:54:53.926352 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:53.926327    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"]
Jul 17 07:54:53.928194 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:53.928174    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-z49gk"]
Jul 17 07:54:55.905357 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:55.905325    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12011c9c-247e-4653-bebc-4b72950e7e20" path="/var/lib/kubelet/pods/12011c9c-247e-4653-bebc-4b72950e7e20/volumes"
Jul 17 07:54:58.898939 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:58.898906    2546 scope.go:117] "RemoveContainer" containerID="714431b3a06cab9ae558030e9629a47033ac19030ca846eb29eac1509124c264"
Jul 17 07:54:59.933825 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:59.933796    2546 generic.go:356] "Generic (PLEG): container finished" podID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerID="8f862f0face063bfcb13aed40f5e1bfb4acca35a39d3dd72205dbfa796a2900b" exitCode=6
Jul 17 07:54:59.934221 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:59.933865    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp" event={"ID":"87c8fce9-3d1a-4f92-9ba1-99c4f5047615","Type":"ContainerDied","Data":"8f862f0face063bfcb13aed40f5e1bfb4acca35a39d3dd72205dbfa796a2900b"}
Jul 17 07:54:59.934221 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:59.933921    2546 scope.go:117] "RemoveContainer" containerID="714431b3a06cab9ae558030e9629a47033ac19030ca846eb29eac1509124c264"
Jul 17 07:54:59.934221 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:54:59.934202    2546 scope.go:117] "RemoveContainer" containerID="8f862f0face063bfcb13aed40f5e1bfb4acca35a39d3dd72205dbfa796a2900b"
Jul 17 07:54:59.934411 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:54:59.934392    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp_odh-ai-gateway-infra(87c8fce9-3d1a-4f92-9ba1-99c4f5047615)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615"
Jul 17 07:55:00.973092 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:55:00.973043    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"]
Jul 17 07:55:01.107395 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:55:01.107367    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"
Jul 17 07:55:01.233554 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:55:01.233466    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87c8fce9-3d1a-4f92-9ba1-99c4f5047615-maas-api-service-ca\") pod \"87c8fce9-3d1a-4f92-9ba1-99c4f5047615\" (UID: \"87c8fce9-3d1a-4f92-9ba1-99c4f5047615\") "
Jul 17 07:55:01.233910 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:55:01.233879    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87c8fce9-3d1a-4f92-9ba1-99c4f5047615-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87c8fce9-3d1a-4f92-9ba1-99c4f5047615" (UID: "87c8fce9-3d1a-4f92-9ba1-99c4f5047615"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:55:01.334930 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:55:01.334891    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87c8fce9-3d1a-4f92-9ba1-99c4f5047615-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:55:01.946845 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:55:01.946810    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp" event={"ID":"87c8fce9-3d1a-4f92-9ba1-99c4f5047615","Type":"ContainerDied","Data":"134ec15af2e3e46c283c6f169602234b15cab4b7ee273edff362c3b8503b768c"}
Jul 17 07:55:01.947004 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:55:01.946874    2546 scope.go:117] "RemoveContainer" containerID="8f862f0face063bfcb13aed40f5e1bfb4acca35a39d3dd72205dbfa796a2900b"
Jul 17 07:55:01.947004 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:55:01.946828    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"
Jul 17 07:55:01.971857 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:55:01.971813    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"]
Jul 17 07:55:01.974270 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:55:01.974249    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-fm9tp"]
Jul 17 07:55:03.904948 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:55:03.904917    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" path="/var/lib/kubelet/pods/87c8fce9-3d1a-4f92-9ba1-99c4f5047615/volumes"
Jul 17 07:56:51.999195 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999089    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"]
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999465    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999476    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999484    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12011c9c-247e-4653-bebc-4b72950e7e20" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999489    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="12011c9c-247e-4653-bebc-4b72950e7e20" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999506    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999512    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999518    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999522    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999536    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12011c9c-247e-4653-bebc-4b72950e7e20" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999541    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="12011c9c-247e-4653-bebc-4b72950e7e20" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999609    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="12011c9c-247e-4653-bebc-4b72950e7e20" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999617    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999625    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="12011c9c-247e-4653-bebc-4b72950e7e20" containerName="revoke-keys"
Jul 17 07:56:52.002364 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:51.999632    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerName="revoke-keys"
Jul 17 07:56:52.003286 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:52.003270    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"
Jul 17 07:56:52.005994 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:52.005965    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:56:52.006167 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:52.006150    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:56:52.017619 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:52.017594    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"]
Jul 17 07:56:52.092225 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:52.092129    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5\" (UID: \"15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"
Jul 17 07:56:52.193127 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:52.193085    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5\" (UID: \"15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"
Jul 17 07:56:52.193950 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:52.193925    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5\" (UID: \"15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"
Jul 17 07:56:52.314102 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:52.314063    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"
Jul 17 07:56:52.445880 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:52.445832    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"]
Jul 17 07:56:52.448154 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:56:52.448124    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ee1ccd_ac70_4de8_97b7_8dcc6e242a0a.slice/crio-3f1bd3641259f64fc90bfe4d632344cedcdd7ebf9ce06a8fe5d9e92d2bdf7016 WatchSource:0}: Error finding container 3f1bd3641259f64fc90bfe4d632344cedcdd7ebf9ce06a8fe5d9e92d2bdf7016: Status 404 returned error can't find the container with id 3f1bd3641259f64fc90bfe4d632344cedcdd7ebf9ce06a8fe5d9e92d2bdf7016
Jul 17 07:56:52.503864 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:52.503836    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5" event={"ID":"15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a","Type":"ContainerStarted","Data":"3f1bd3641259f64fc90bfe4d632344cedcdd7ebf9ce06a8fe5d9e92d2bdf7016"}
Jul 17 07:56:53.509912 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:53.509822    2546 generic.go:356] "Generic (PLEG): container finished" podID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerID="38373d6f6642017d3e20aa6056ddc2c811c924935dc33f90869459cddf14c1b2" exitCode=6
Jul 17 07:56:53.510271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:53.509908    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5" event={"ID":"15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a","Type":"ContainerDied","Data":"38373d6f6642017d3e20aa6056ddc2c811c924935dc33f90869459cddf14c1b2"}
Jul 17 07:56:53.510271 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:53.510099    2546 scope.go:117] "RemoveContainer" containerID="38373d6f6642017d3e20aa6056ddc2c811c924935dc33f90869459cddf14c1b2"
Jul 17 07:56:54.516875 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:54.516784    2546 generic.go:356] "Generic (PLEG): container finished" podID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerID="9cd08dfa8ebffb660c241826c6dcc0191d9c61a07584a7ada607b790499c6e6e" exitCode=6
Jul 17 07:56:54.516875 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:54.516857    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5" event={"ID":"15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a","Type":"ContainerDied","Data":"9cd08dfa8ebffb660c241826c6dcc0191d9c61a07584a7ada607b790499c6e6e"}
Jul 17 07:56:54.517280 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:54.516931    2546 scope.go:117] "RemoveContainer" containerID="38373d6f6642017d3e20aa6056ddc2c811c924935dc33f90869459cddf14c1b2"
Jul 17 07:56:54.517280 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:54.517142    2546 scope.go:117] "RemoveContainer" containerID="9cd08dfa8ebffb660c241826c6dcc0191d9c61a07584a7ada607b790499c6e6e"
Jul 17 07:56:54.517473 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:56:54.517448    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5_odh-ai-gateway-infra(15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a"
Jul 17 07:56:55.523805 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:56:55.523776    2546 scope.go:117] "RemoveContainer" containerID="9cd08dfa8ebffb660c241826c6dcc0191d9c61a07584a7ada607b790499c6e6e"
Jul 17 07:56:55.524203 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:56:55.523987    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5_odh-ai-gateway-infra(15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a"
Jul 17 07:57:05.962492 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:05.962455    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"]
Jul 17 07:57:05.962882 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:05.962866    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12011c9c-247e-4653-bebc-4b72950e7e20" containerName="revoke-keys"
Jul 17 07:57:05.962882 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:05.962879    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="12011c9c-247e-4653-bebc-4b72950e7e20" containerName="revoke-keys"
Jul 17 07:57:05.962974 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:05.962964    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="12011c9c-247e-4653-bebc-4b72950e7e20" containerName="revoke-keys"
Jul 17 07:57:05.963010 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:05.962976    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c8fce9-3d1a-4f92-9ba1-99c4f5047615" containerName="revoke-keys"
Jul 17 07:57:05.967042 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:05.967016    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:05.969468 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:05.969446    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1f268b\"/\"openshift-service-ca.crt\""
Jul 17 07:57:05.969570 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:05.969522    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1f268b\"/\"kube-root-ca.crt\""
Jul 17 07:57:05.970443 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:05.970422    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1f268b\"/\"test-model-1f268b-kserve-self-signed-certs\""
Jul 17 07:57:05.970556 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:05.970467    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1f268b\"/\"default-dockercfg-9lpmn\""
Jul 17 07:57:05.976623 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:05.976449    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"]
Jul 17 07:57:06.022437 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.022406    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fqkt\" (UniqueName: \"kubernetes.io/projected/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-kube-api-access-8fqkt\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.022611 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.022459    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tls-certs\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.022611 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.022514    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-dshm\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.022611 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.022565    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tmp-dir\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.022611 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.022607    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-model-cache\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.022836 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.022656    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-home\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.123511 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.123468    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-home\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.123736 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.123552    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fqkt\" (UniqueName: \"kubernetes.io/projected/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-kube-api-access-8fqkt\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.123736 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.123584    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tls-certs\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.123736 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.123607    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-dshm\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.123736 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.123654    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tmp-dir\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.123736 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.123714    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-model-cache\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.124027 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.123973    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-home\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.124097 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.124046    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tmp-dir\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.124152 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.124094    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-model-cache\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.125918 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.125885    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-dshm\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.126132 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.126114    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tls-certs\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.132652 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.132632    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fqkt\" (UniqueName: \"kubernetes.io/projected/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-kube-api-access-8fqkt\") pod \"test-model-1f268b-kserve-7f8d8f65d7-kzm8s\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") " pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.279552 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.279514    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:06.415788 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.415765    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"]
Jul 17 07:57:06.417789 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:57:06.417765    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod116ee6db_7d42_497e_85d5_d4bd9f9d15b8.slice/crio-9122a7b8992aa55cb658f9fb1320bab9af65917636937387ca068f7f4d013022 WatchSource:0}: Error finding container 9122a7b8992aa55cb658f9fb1320bab9af65917636937387ca068f7f4d013022: Status 404 returned error can't find the container with id 9122a7b8992aa55cb658f9fb1320bab9af65917636937387ca068f7f4d013022
Jul 17 07:57:06.579484 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.579378    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s" event={"ID":"116ee6db-7d42-497e-85d5-d4bd9f9d15b8","Type":"ContainerStarted","Data":"ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254"}
Jul 17 07:57:06.579484 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.579422    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s" event={"ID":"116ee6db-7d42-497e-85d5-d4bd9f9d15b8","Type":"ContainerStarted","Data":"9122a7b8992aa55cb658f9fb1320bab9af65917636937387ca068f7f4d013022"}
Jul 17 07:57:06.603599 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:06.603546    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s" podStartSLOduration=1.603528938 podStartE2EDuration="1.603528938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:57:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:57:06.600875926 +0000 UTC m=+2689.407073099" watchObservedRunningTime="2026-07-17 07:57:06.603528938 +0000 UTC m=+2689.409726125"
Jul 17 07:57:10.899084 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:10.899012    2546 scope.go:117] "RemoveContainer" containerID="9cd08dfa8ebffb660c241826c6dcc0191d9c61a07584a7ada607b790499c6e6e"
Jul 17 07:57:11.605708 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:11.605647    2546 generic.go:356] "Generic (PLEG): container finished" podID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerID="a7cc62c6786e6e916997d4ab1c87e9a19a08d2930558ef7bef7d8af41b961b91" exitCode=6
Jul 17 07:57:11.605862 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:11.605724    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5" event={"ID":"15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a","Type":"ContainerDied","Data":"a7cc62c6786e6e916997d4ab1c87e9a19a08d2930558ef7bef7d8af41b961b91"}
Jul 17 07:57:11.605862 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:11.605793    2546 scope.go:117] "RemoveContainer" containerID="9cd08dfa8ebffb660c241826c6dcc0191d9c61a07584a7ada607b790499c6e6e"
Jul 17 07:57:11.606082 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:11.606066    2546 scope.go:117] "RemoveContainer" containerID="a7cc62c6786e6e916997d4ab1c87e9a19a08d2930558ef7bef7d8af41b961b91"
Jul 17 07:57:11.606322 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:57:11.606300    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5_odh-ai-gateway-infra(15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a"
Jul 17 07:57:12.657406 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:12.657370    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"]
Jul 17 07:57:12.798110 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:12.798089    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"
Jul 17 07:57:12.888438 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:12.888406    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a-maas-api-service-ca\") pod \"15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a\" (UID: \"15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a\") "
Jul 17 07:57:12.888806 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:12.888784    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" (UID: "15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:57:12.990076 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:12.990000    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:57:13.618797 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:13.618763    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"
Jul 17 07:57:13.618980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:13.618770    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5" event={"ID":"15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a","Type":"ContainerDied","Data":"3f1bd3641259f64fc90bfe4d632344cedcdd7ebf9ce06a8fe5d9e92d2bdf7016"}
Jul 17 07:57:13.618980 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:13.618909    2546 scope.go:117] "RemoveContainer" containerID="a7cc62c6786e6e916997d4ab1c87e9a19a08d2930558ef7bef7d8af41b961b91"
Jul 17 07:57:13.640531 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:13.640505    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"]
Jul 17 07:57:13.644518 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:13.644495    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-cxcn5"]
Jul 17 07:57:13.905178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:13.905097    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" path="/var/lib/kubelet/pods/15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a/volumes"
Jul 17 07:57:16.279697 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:16.279649    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:16.280144 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:16.279712    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:16.293549 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:16.293527    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:16.647944 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:16.647855    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:57:28.347363 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.347325    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"]
Jul 17 07:57:28.348184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.347740    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerName="revoke-keys"
Jul 17 07:57:28.348184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.347753    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerName="revoke-keys"
Jul 17 07:57:28.348184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.347785    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerName="revoke-keys"
Jul 17 07:57:28.348184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.347790    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerName="revoke-keys"
Jul 17 07:57:28.348184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.347850    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerName="revoke-keys"
Jul 17 07:57:28.348184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.347858    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerName="revoke-keys"
Jul 17 07:57:28.350848 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.350829    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.355160 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.355137    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cab91c\"/\"kube-root-ca.crt\""
Jul 17 07:57:28.355866 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.355847    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cab91c\"/\"openshift-service-ca.crt\""
Jul 17 07:57:28.355953 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.355855    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cab91c\"/\"test-model-cab91c-kserve-self-signed-certs\""
Jul 17 07:57:28.356022 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.355999    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cab91c\"/\"default-dockercfg-qf24v\""
Jul 17 07:57:28.364776 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.364751    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"]
Jul 17 07:57:28.445523 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.445484    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-model-cache\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.445726 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.445529    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-tmp-dir\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.445726 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.445613    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hlbs\" (UniqueName: \"kubernetes.io/projected/e3c54e86-ecce-4679-a917-8562f82a27ef-kube-api-access-6hlbs\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.445726 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.445710    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-home\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.445914 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.445744    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-dshm\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.445914 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.445881    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3c54e86-ecce-4679-a917-8562f82a27ef-tls-certs\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.546413 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.546381    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hlbs\" (UniqueName: \"kubernetes.io/projected/e3c54e86-ecce-4679-a917-8562f82a27ef-kube-api-access-6hlbs\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.546608 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.546445    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-home\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.546608 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.546466    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-dshm\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.546608 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.546536    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3c54e86-ecce-4679-a917-8562f82a27ef-tls-certs\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.546608 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.546578    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-model-cache\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.546608 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.546600    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-tmp-dir\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.546941 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.546921    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-home\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.547003 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.546987    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-model-cache\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.547060 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.547029    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-tmp-dir\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.549069 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.549044    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-dshm\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.549474 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.549452    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3c54e86-ecce-4679-a917-8562f82a27ef-tls-certs\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.556646 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.556624    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hlbs\" (UniqueName: \"kubernetes.io/projected/e3c54e86-ecce-4679-a917-8562f82a27ef-kube-api-access-6hlbs\") pod \"test-model-cab91c-kserve-d486dcc9f-rjdbc\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") " pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.660338 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.660253    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:28.800646 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:28.800617    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"]
Jul 17 07:57:28.802418 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:57:28.802394    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3c54e86_ecce_4679_a917_8562f82a27ef.slice/crio-53b44a856c9573b52625540e873b73cebcf5d8896f7e2e944bb4d45048630dc6 WatchSource:0}: Error finding container 53b44a856c9573b52625540e873b73cebcf5d8896f7e2e944bb4d45048630dc6: Status 404 returned error can't find the container with id 53b44a856c9573b52625540e873b73cebcf5d8896f7e2e944bb4d45048630dc6
Jul 17 07:57:29.710178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:29.710143    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc" event={"ID":"e3c54e86-ecce-4679-a917-8562f82a27ef","Type":"ContainerStarted","Data":"873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5"}
Jul 17 07:57:29.710178 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:29.710191    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc" event={"ID":"e3c54e86-ecce-4679-a917-8562f82a27ef","Type":"ContainerStarted","Data":"53b44a856c9573b52625540e873b73cebcf5d8896f7e2e944bb4d45048630dc6"}
Jul 17 07:57:29.733215 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:29.733152    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc" podStartSLOduration=1.733131533 podStartE2EDuration="1.733131533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:57:29.72976399 +0000 UTC m=+2712.535961166" watchObservedRunningTime="2026-07-17 07:57:29.733131533 +0000 UTC m=+2712.539328707"
Jul 17 07:57:38.660391 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:38.660354    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:38.660876 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:38.660430    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:38.676788 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:38.676756    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:38.767228 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:38.767189    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:57:53.477061 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:53.477023    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"]
Jul 17 07:57:54.454781 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:57:54.454748    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"]
Jul 17 07:58:08.497597 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.497523    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s" podUID="116ee6db-7d42-497e-85d5-d4bd9f9d15b8" containerName="main" containerID="cri-o://ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254" gracePeriod=45
Jul 17 07:58:08.747228 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.747201    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:58:08.844683 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.844642    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fqkt\" (UniqueName: \"kubernetes.io/projected/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-kube-api-access-8fqkt\") pod \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") "
Jul 17 07:58:08.844864 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.844723    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-dshm\") pod \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") "
Jul 17 07:58:08.844864 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.844819    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-home\") pod \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") "
Jul 17 07:58:08.844964 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.844882    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-model-cache\") pod \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") "
Jul 17 07:58:08.844964 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.844955    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tmp-dir\") pod \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") "
Jul 17 07:58:08.845049 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.845000    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tls-certs\") pod \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\" (UID: \"116ee6db-7d42-497e-85d5-d4bd9f9d15b8\") "
Jul 17 07:58:08.845125 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.845090    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-home" (OuterVolumeSpecName: "home") pod "116ee6db-7d42-497e-85d5-d4bd9f9d15b8" (UID: "116ee6db-7d42-497e-85d5-d4bd9f9d15b8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 07:58:08.845125 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.845099    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-model-cache" (OuterVolumeSpecName: "model-cache") pod "116ee6db-7d42-497e-85d5-d4bd9f9d15b8" (UID: "116ee6db-7d42-497e-85d5-d4bd9f9d15b8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 07:58:08.845299 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.845267    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "116ee6db-7d42-497e-85d5-d4bd9f9d15b8" (UID: "116ee6db-7d42-497e-85d5-d4bd9f9d15b8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 07:58:08.845421 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.845373    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-model-cache\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:08.845421 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.845397    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tmp-dir\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:08.845421 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.845409    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-home\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:08.846954 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.846935    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-dshm" (OuterVolumeSpecName: "dshm") pod "116ee6db-7d42-497e-85d5-d4bd9f9d15b8" (UID: "116ee6db-7d42-497e-85d5-d4bd9f9d15b8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 07:58:08.847030 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.846972    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-kube-api-access-8fqkt" (OuterVolumeSpecName: "kube-api-access-8fqkt") pod "116ee6db-7d42-497e-85d5-d4bd9f9d15b8" (UID: "116ee6db-7d42-497e-85d5-d4bd9f9d15b8"). InnerVolumeSpecName "kube-api-access-8fqkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 07:58:08.847068 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.847030    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "116ee6db-7d42-497e-85d5-d4bd9f9d15b8" (UID: "116ee6db-7d42-497e-85d5-d4bd9f9d15b8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 07:58:08.912353 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.912318    2546 generic.go:356] "Generic (PLEG): container finished" podID="116ee6db-7d42-497e-85d5-d4bd9f9d15b8" containerID="ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254" exitCode=0
Jul 17 07:58:08.912538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.912360    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"
Jul 17 07:58:08.912538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.912399    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s" event={"ID":"116ee6db-7d42-497e-85d5-d4bd9f9d15b8","Type":"ContainerDied","Data":"ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254"}
Jul 17 07:58:08.912538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.912437    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s" event={"ID":"116ee6db-7d42-497e-85d5-d4bd9f9d15b8","Type":"ContainerDied","Data":"9122a7b8992aa55cb658f9fb1320bab9af65917636937387ca068f7f4d013022"}
Jul 17 07:58:08.912538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.912456    2546 scope.go:117] "RemoveContainer" containerID="ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254"
Jul 17 07:58:08.921386 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.921368    2546 scope.go:117] "RemoveContainer" containerID="ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254"
Jul 17 07:58:08.921635 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:58:08.921616    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254\": container with ID starting with ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254 not found: ID does not exist" containerID="ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254"
Jul 17 07:58:08.921702 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.921644    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254"} err="failed to get container status \"ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254\": rpc error: code = NotFound desc = could not find container \"ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254\": container with ID starting with ab0f21d90909b60f422ab8c7caf087f3d4f1341d28f906a08014dc8b0e493254 not found: ID does not exist"
Jul 17 07:58:08.934991 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.934962    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"]
Jul 17 07:58:08.939154 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.939131    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-1f268b/test-model-1f268b-kserve-7f8d8f65d7-kzm8s"]
Jul 17 07:58:08.946715 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.946527    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-dshm\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:08.946715 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.946552    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-tls-certs\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:08.946715 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:08.946603    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fqkt\" (UniqueName: \"kubernetes.io/projected/116ee6db-7d42-497e-85d5-d4bd9f9d15b8-kube-api-access-8fqkt\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:09.477810 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.477770    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc" podUID="e3c54e86-ecce-4679-a917-8562f82a27ef" containerName="main" containerID="cri-o://873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5" gracePeriod=45
Jul 17 07:58:09.726977 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.726948    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:58:09.753651 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.753570    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-dshm\") pod \"e3c54e86-ecce-4679-a917-8562f82a27ef\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") "
Jul 17 07:58:09.753837 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.753658    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-tmp-dir\") pod \"e3c54e86-ecce-4679-a917-8562f82a27ef\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") "
Jul 17 07:58:09.753837 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.753702    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hlbs\" (UniqueName: \"kubernetes.io/projected/e3c54e86-ecce-4679-a917-8562f82a27ef-kube-api-access-6hlbs\") pod \"e3c54e86-ecce-4679-a917-8562f82a27ef\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") "
Jul 17 07:58:09.753837 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.753740    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-model-cache\") pod \"e3c54e86-ecce-4679-a917-8562f82a27ef\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") "
Jul 17 07:58:09.753837 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.753797    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3c54e86-ecce-4679-a917-8562f82a27ef-tls-certs\") pod \"e3c54e86-ecce-4679-a917-8562f82a27ef\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") "
Jul 17 07:58:09.753837 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.753826    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-home\") pod \"e3c54e86-ecce-4679-a917-8562f82a27ef\" (UID: \"e3c54e86-ecce-4679-a917-8562f82a27ef\") "
Jul 17 07:58:09.754141 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.753932    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e3c54e86-ecce-4679-a917-8562f82a27ef" (UID: "e3c54e86-ecce-4679-a917-8562f82a27ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 07:58:09.754141 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.753965    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "e3c54e86-ecce-4679-a917-8562f82a27ef" (UID: "e3c54e86-ecce-4679-a917-8562f82a27ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 07:58:09.754251 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.754141    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-home" (OuterVolumeSpecName: "home") pod "e3c54e86-ecce-4679-a917-8562f82a27ef" (UID: "e3c54e86-ecce-4679-a917-8562f82a27ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 07:58:09.754251 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.754210    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-tmp-dir\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:09.754251 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.754230    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-model-cache\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:09.756010 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.755985    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-dshm" (OuterVolumeSpecName: "dshm") pod "e3c54e86-ecce-4679-a917-8562f82a27ef" (UID: "e3c54e86-ecce-4679-a917-8562f82a27ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 07:58:09.756010 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.755989    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3c54e86-ecce-4679-a917-8562f82a27ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e3c54e86-ecce-4679-a917-8562f82a27ef" (UID: "e3c54e86-ecce-4679-a917-8562f82a27ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 07:58:09.756198 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.755995    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3c54e86-ecce-4679-a917-8562f82a27ef-kube-api-access-6hlbs" (OuterVolumeSpecName: "kube-api-access-6hlbs") pod "e3c54e86-ecce-4679-a917-8562f82a27ef" (UID: "e3c54e86-ecce-4679-a917-8562f82a27ef"). InnerVolumeSpecName "kube-api-access-6hlbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 07:58:09.855708 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.855647    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hlbs\" (UniqueName: \"kubernetes.io/projected/e3c54e86-ecce-4679-a917-8562f82a27ef-kube-api-access-6hlbs\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:09.855708 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.855704    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3c54e86-ecce-4679-a917-8562f82a27ef-tls-certs\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:09.855708 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.855714    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-home\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:09.855708 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.855721    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3c54e86-ecce-4679-a917-8562f82a27ef-dshm\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:09.905055 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.905024    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="116ee6db-7d42-497e-85d5-d4bd9f9d15b8" path="/var/lib/kubelet/pods/116ee6db-7d42-497e-85d5-d4bd9f9d15b8/volumes"
Jul 17 07:58:09.918711 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.918683    2546 generic.go:356] "Generic (PLEG): container finished" podID="e3c54e86-ecce-4679-a917-8562f82a27ef" containerID="873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5" exitCode=0
Jul 17 07:58:09.918860 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.918724    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"
Jul 17 07:58:09.918860 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.918774    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc" event={"ID":"e3c54e86-ecce-4679-a917-8562f82a27ef","Type":"ContainerDied","Data":"873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5"}
Jul 17 07:58:09.918860 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.918814    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc" event={"ID":"e3c54e86-ecce-4679-a917-8562f82a27ef","Type":"ContainerDied","Data":"53b44a856c9573b52625540e873b73cebcf5d8896f7e2e944bb4d45048630dc6"}
Jul 17 07:58:09.918860 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.918836    2546 scope.go:117] "RemoveContainer" containerID="873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5"
Jul 17 07:58:09.927790 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.927767    2546 scope.go:117] "RemoveContainer" containerID="873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5"
Jul 17 07:58:09.928126 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:58:09.928086    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5\": container with ID starting with 873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5 not found: ID does not exist" containerID="873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5"
Jul 17 07:58:09.928220 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.928129    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5"} err="failed to get container status \"873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5\": rpc error: code = NotFound desc = could not find container \"873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5\": container with ID starting with 873575b714958e681787e521c8fabcc69fb814bbe08446690720d7bda18b9ef5 not found: ID does not exist"
Jul 17 07:58:09.937009 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.936979    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"]
Jul 17 07:58:09.943053 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:09.943029    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-cab91c/test-model-cab91c-kserve-d486dcc9f-rjdbc"]
Jul 17 07:58:11.904800 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:11.904764    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3c54e86-ecce-4679-a917-8562f82a27ef" path="/var/lib/kubelet/pods/e3c54e86-ecce-4679-a917-8562f82a27ef/volumes"
Jul 17 07:58:13.905150 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.905120    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"]
Jul 17 07:58:13.905538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.905491    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c54e86-ecce-4679-a917-8562f82a27ef" containerName="main"
Jul 17 07:58:13.905538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.905501    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c54e86-ecce-4679-a917-8562f82a27ef" containerName="main"
Jul 17 07:58:13.905538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.905515    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerName="revoke-keys"
Jul 17 07:58:13.905538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.905520    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerName="revoke-keys"
Jul 17 07:58:13.905538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.905534    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="116ee6db-7d42-497e-85d5-d4bd9f9d15b8" containerName="main"
Jul 17 07:58:13.905538 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.905538    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="116ee6db-7d42-497e-85d5-d4bd9f9d15b8" containerName="main"
Jul 17 07:58:13.905779 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.905595    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="116ee6db-7d42-497e-85d5-d4bd9f9d15b8" containerName="main"
Jul 17 07:58:13.905779 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.905605    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ee1ccd-ac70-4de8-97b7-8dcc6e242a0a" containerName="revoke-keys"
Jul 17 07:58:13.905779 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.905612    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3c54e86-ecce-4679-a917-8562f82a27ef" containerName="main"
Jul 17 07:58:13.910019 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.910000    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"
Jul 17 07:58:13.915141 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.915117    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:58:13.915304 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.915170    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:58:13.915949 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.915918    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"]
Jul 17 07:58:13.994148 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:13.994111    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d59fb42-9482-49ca-b883-591456dcaa1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk\" (UID: \"9d59fb42-9482-49ca-b883-591456dcaa1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"
Jul 17 07:58:14.095142 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:14.095098    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d59fb42-9482-49ca-b883-591456dcaa1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk\" (UID: \"9d59fb42-9482-49ca-b883-591456dcaa1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"
Jul 17 07:58:14.095821 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:14.095795    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d59fb42-9482-49ca-b883-591456dcaa1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk\" (UID: \"9d59fb42-9482-49ca-b883-591456dcaa1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"
Jul 17 07:58:14.223011 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:14.222907    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"
Jul 17 07:58:14.560398 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:14.560365    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"]
Jul 17 07:58:14.562837 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:58:14.562811    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d59fb42_9482_49ca_b883_591456dcaa1a.slice/crio-b513a56a1473f03f6e87e43ec650e0612a112990a53b6c823a040ed71fef5952 WatchSource:0}: Error finding container b513a56a1473f03f6e87e43ec650e0612a112990a53b6c823a040ed71fef5952: Status 404 returned error can't find the container with id b513a56a1473f03f6e87e43ec650e0612a112990a53b6c823a040ed71fef5952
Jul 17 07:58:14.949184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:14.949091    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk" event={"ID":"9d59fb42-9482-49ca-b883-591456dcaa1a","Type":"ContainerStarted","Data":"494e0615d8d70f45e636cc0f0befe57a7788623e36d957e9bad08e2b27824652"}
Jul 17 07:58:14.949184 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:14.949152    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk" event={"ID":"9d59fb42-9482-49ca-b883-591456dcaa1a","Type":"ContainerStarted","Data":"b513a56a1473f03f6e87e43ec650e0612a112990a53b6c823a040ed71fef5952"}
Jul 17 07:58:14.965627 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:14.965556    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk" podStartSLOduration=1.965535571 podStartE2EDuration="1.965535571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:58:14.965067928 +0000 UTC m=+2757.771265095" watchObservedRunningTime="2026-07-17 07:58:14.965535571 +0000 UTC m=+2757.771732743"
Jul 17 07:58:15.955917 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:15.955886    2546 generic.go:356] "Generic (PLEG): container finished" podID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerID="494e0615d8d70f45e636cc0f0befe57a7788623e36d957e9bad08e2b27824652" exitCode=6
Jul 17 07:58:15.956323 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:15.955980    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk" event={"ID":"9d59fb42-9482-49ca-b883-591456dcaa1a","Type":"ContainerDied","Data":"494e0615d8d70f45e636cc0f0befe57a7788623e36d957e9bad08e2b27824652"}
Jul 17 07:58:15.956323 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:15.956097    2546 scope.go:117] "RemoveContainer" containerID="494e0615d8d70f45e636cc0f0befe57a7788623e36d957e9bad08e2b27824652"
Jul 17 07:58:16.962884 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:16.962798    2546 generic.go:356] "Generic (PLEG): container finished" podID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerID="960132896bd74d75ca37f3837b854fa471dedd9973f9876065a5e780e056ebc4" exitCode=6
Jul 17 07:58:16.962884 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:16.962865    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk" event={"ID":"9d59fb42-9482-49ca-b883-591456dcaa1a","Type":"ContainerDied","Data":"960132896bd74d75ca37f3837b854fa471dedd9973f9876065a5e780e056ebc4"}
Jul 17 07:58:16.963349 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:16.962916    2546 scope.go:117] "RemoveContainer" containerID="494e0615d8d70f45e636cc0f0befe57a7788623e36d957e9bad08e2b27824652"
Jul 17 07:58:16.963349 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:16.963104    2546 scope.go:117] "RemoveContainer" containerID="960132896bd74d75ca37f3837b854fa471dedd9973f9876065a5e780e056ebc4"
Jul 17 07:58:16.963459 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:58:16.963351    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk_odh-ai-gateway-infra(9d59fb42-9482-49ca-b883-591456dcaa1a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a"
Jul 17 07:58:17.969842 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:17.969809    2546 scope.go:117] "RemoveContainer" containerID="960132896bd74d75ca37f3837b854fa471dedd9973f9876065a5e780e056ebc4"
Jul 17 07:58:17.970210 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:58:17.970031    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk_odh-ai-gateway-infra(9d59fb42-9482-49ca-b883-591456dcaa1a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a"
Jul 17 07:58:32.898783 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:32.898752    2546 scope.go:117] "RemoveContainer" containerID="960132896bd74d75ca37f3837b854fa471dedd9973f9876065a5e780e056ebc4"
Jul 17 07:58:34.050878 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:34.050846    2546 generic.go:356] "Generic (PLEG): container finished" podID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerID="19d042eb69642f7c00ce694bcdde596aa9a3c6be5ea6ca1b57e9ead6cc63b05e" exitCode=6
Jul 17 07:58:34.051380 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:34.050929    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk" event={"ID":"9d59fb42-9482-49ca-b883-591456dcaa1a","Type":"ContainerDied","Data":"19d042eb69642f7c00ce694bcdde596aa9a3c6be5ea6ca1b57e9ead6cc63b05e"}
Jul 17 07:58:34.051380 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:34.050994    2546 scope.go:117] "RemoveContainer" containerID="960132896bd74d75ca37f3837b854fa471dedd9973f9876065a5e780e056ebc4"
Jul 17 07:58:34.051380 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:34.051300    2546 scope.go:117] "RemoveContainer" containerID="19d042eb69642f7c00ce694bcdde596aa9a3c6be5ea6ca1b57e9ead6cc63b05e"
Jul 17 07:58:34.051608 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:58:34.051587    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk_odh-ai-gateway-infra(9d59fb42-9482-49ca-b883-591456dcaa1a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a"
Jul 17 07:58:35.078118 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:35.078084    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"]
Jul 17 07:58:35.211554 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:35.211532    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"
Jul 17 07:58:35.298579 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:35.298548    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d59fb42-9482-49ca-b883-591456dcaa1a-maas-api-service-ca\") pod \"9d59fb42-9482-49ca-b883-591456dcaa1a\" (UID: \"9d59fb42-9482-49ca-b883-591456dcaa1a\") "
Jul 17 07:58:35.298972 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:35.298947    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d59fb42-9482-49ca-b883-591456dcaa1a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9d59fb42-9482-49ca-b883-591456dcaa1a" (UID: "9d59fb42-9482-49ca-b883-591456dcaa1a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:58:35.400311 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:35.400221    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d59fb42-9482-49ca-b883-591456dcaa1a-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:58:36.064452 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:36.064427    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"
Jul 17 07:58:36.064607 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:36.064469    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk" event={"ID":"9d59fb42-9482-49ca-b883-591456dcaa1a","Type":"ContainerDied","Data":"b513a56a1473f03f6e87e43ec650e0612a112990a53b6c823a040ed71fef5952"}
Jul 17 07:58:36.064607 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:36.064532    2546 scope.go:117] "RemoveContainer" containerID="19d042eb69642f7c00ce694bcdde596aa9a3c6be5ea6ca1b57e9ead6cc63b05e"
Jul 17 07:58:36.081713 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:36.081561    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"]
Jul 17 07:58:36.084750 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:36.084724    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-rxhkk"]
Jul 17 07:58:37.904399 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:37.904366    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a" path="/var/lib/kubelet/pods/9d59fb42-9482-49ca-b883-591456dcaa1a/volumes"
Jul 17 07:58:52.148982 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.148900    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"]
Jul 17 07:58:52.149382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.149278    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerName="revoke-keys"
Jul 17 07:58:52.149382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.149289    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerName="revoke-keys"
Jul 17 07:58:52.149382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.149300    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerName="revoke-keys"
Jul 17 07:58:52.149382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.149305    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerName="revoke-keys"
Jul 17 07:58:52.149382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.149312    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerName="revoke-keys"
Jul 17 07:58:52.149382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.149319    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerName="revoke-keys"
Jul 17 07:58:52.149568 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.149391    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerName="revoke-keys"
Jul 17 07:58:52.149568 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.149401    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerName="revoke-keys"
Jul 17 07:58:52.149568 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.149408    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d59fb42-9482-49ca-b883-591456dcaa1a" containerName="revoke-keys"
Jul 17 07:58:52.154109 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.154092    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"
Jul 17 07:58:52.156928 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.156905    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:58:52.157584 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.157568    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:58:52.165086 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.165062    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"]
Jul 17 07:58:52.255399 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.255366    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/404592fa-7cd0-473a-b6a6-44695c12216f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x\" (UID: \"404592fa-7cd0-473a-b6a6-44695c12216f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"
Jul 17 07:58:52.356086 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.356040    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/404592fa-7cd0-473a-b6a6-44695c12216f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x\" (UID: \"404592fa-7cd0-473a-b6a6-44695c12216f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"
Jul 17 07:58:52.356694 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.356651    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/404592fa-7cd0-473a-b6a6-44695c12216f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x\" (UID: \"404592fa-7cd0-473a-b6a6-44695c12216f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"
Jul 17 07:58:52.465857 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.465771    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"
Jul 17 07:58:52.610510 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:52.610487    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"]
Jul 17 07:58:52.613090 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:58:52.613053    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404592fa_7cd0_473a_b6a6_44695c12216f.slice/crio-ca6ae114c0962c3aa990626cbb2193155505059f817d75939d2604203a81b451 WatchSource:0}: Error finding container ca6ae114c0962c3aa990626cbb2193155505059f817d75939d2604203a81b451: Status 404 returned error can't find the container with id ca6ae114c0962c3aa990626cbb2193155505059f817d75939d2604203a81b451
Jul 17 07:58:53.155028 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:53.154935    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x" event={"ID":"404592fa-7cd0-473a-b6a6-44695c12216f","Type":"ContainerStarted","Data":"afa394fc15b9deea77a4fa49314960cef96bc01e8447a7617fdc9d74f7d4a1c2"}
Jul 17 07:58:53.155028 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:53.154995    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x" event={"ID":"404592fa-7cd0-473a-b6a6-44695c12216f","Type":"ContainerStarted","Data":"ca6ae114c0962c3aa990626cbb2193155505059f817d75939d2604203a81b451"}
Jul 17 07:58:53.174382 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:53.174319    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x" podStartSLOduration=1.174295373 podStartE2EDuration="1.174295373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:58:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:58:53.172894393 +0000 UTC m=+2795.979091574" watchObservedRunningTime="2026-07-17 07:58:53.174295373 +0000 UTC m=+2795.980492548"
Jul 17 07:58:54.161543 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:54.161506    2546 generic.go:356] "Generic (PLEG): container finished" podID="404592fa-7cd0-473a-b6a6-44695c12216f" containerID="afa394fc15b9deea77a4fa49314960cef96bc01e8447a7617fdc9d74f7d4a1c2" exitCode=6
Jul 17 07:58:54.162027 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:54.161597    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x" event={"ID":"404592fa-7cd0-473a-b6a6-44695c12216f","Type":"ContainerDied","Data":"afa394fc15b9deea77a4fa49314960cef96bc01e8447a7617fdc9d74f7d4a1c2"}
Jul 17 07:58:54.162027 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:54.161818    2546 scope.go:117] "RemoveContainer" containerID="afa394fc15b9deea77a4fa49314960cef96bc01e8447a7617fdc9d74f7d4a1c2"
Jul 17 07:58:55.168926 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:55.168820    2546 generic.go:356] "Generic (PLEG): container finished" podID="404592fa-7cd0-473a-b6a6-44695c12216f" containerID="db69b60c260983c5478995756ca4f93a18dc0d4df461683cfb68dacbacc6c65a" exitCode=6
Jul 17 07:58:55.168926 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:55.168887    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x" event={"ID":"404592fa-7cd0-473a-b6a6-44695c12216f","Type":"ContainerDied","Data":"db69b60c260983c5478995756ca4f93a18dc0d4df461683cfb68dacbacc6c65a"}
Jul 17 07:58:55.169462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:55.168950    2546 scope.go:117] "RemoveContainer" containerID="afa394fc15b9deea77a4fa49314960cef96bc01e8447a7617fdc9d74f7d4a1c2"
Jul 17 07:58:55.169462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:55.169152    2546 scope.go:117] "RemoveContainer" containerID="db69b60c260983c5478995756ca4f93a18dc0d4df461683cfb68dacbacc6c65a"
Jul 17 07:58:55.169462 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:58:55.169407    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x_odh-ai-gateway-infra(404592fa-7cd0-473a-b6a6-44695c12216f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x" podUID="404592fa-7cd0-473a-b6a6-44695c12216f"
Jul 17 07:58:56.176065 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:58:56.176035    2546 scope.go:117] "RemoveContainer" containerID="db69b60c260983c5478995756ca4f93a18dc0d4df461683cfb68dacbacc6c65a"
Jul 17 07:58:56.176449 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:58:56.176270    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x_odh-ai-gateway-infra(404592fa-7cd0-473a-b6a6-44695c12216f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x" podUID="404592fa-7cd0-473a-b6a6-44695c12216f"
Jul 17 07:59:09.905165 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:09.905140    2546 scope.go:117] "RemoveContainer" containerID="db69b60c260983c5478995756ca4f93a18dc0d4df461683cfb68dacbacc6c65a"
Jul 17 07:59:10.252294 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:10.252203    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x" event={"ID":"404592fa-7cd0-473a-b6a6-44695c12216f","Type":"ContainerStarted","Data":"d3c6e70c099d49e72dcc68aef666121af1f31601d26b73db671b9cfcd5c8b68c"}
Jul 17 07:59:11.258342 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:11.258306    2546 generic.go:356] "Generic (PLEG): container finished" podID="404592fa-7cd0-473a-b6a6-44695c12216f" containerID="d3c6e70c099d49e72dcc68aef666121af1f31601d26b73db671b9cfcd5c8b68c" exitCode=6
Jul 17 07:59:11.258768 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:11.258380    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x" event={"ID":"404592fa-7cd0-473a-b6a6-44695c12216f","Type":"ContainerDied","Data":"d3c6e70c099d49e72dcc68aef666121af1f31601d26b73db671b9cfcd5c8b68c"}
Jul 17 07:59:11.258768 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:11.258443    2546 scope.go:117] "RemoveContainer" containerID="db69b60c260983c5478995756ca4f93a18dc0d4df461683cfb68dacbacc6c65a"
Jul 17 07:59:11.258874 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:11.258772    2546 scope.go:117] "RemoveContainer" containerID="d3c6e70c099d49e72dcc68aef666121af1f31601d26b73db671b9cfcd5c8b68c"
Jul 17 07:59:11.258986 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:59:11.258966    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x_odh-ai-gateway-infra(404592fa-7cd0-473a-b6a6-44695c12216f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x" podUID="404592fa-7cd0-473a-b6a6-44695c12216f"
Jul 17 07:59:11.283503 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:11.283468    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"]
Jul 17 07:59:12.401529 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:12.401503    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"
Jul 17 07:59:12.560381 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:12.560337    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/404592fa-7cd0-473a-b6a6-44695c12216f-maas-api-service-ca\") pod \"404592fa-7cd0-473a-b6a6-44695c12216f\" (UID: \"404592fa-7cd0-473a-b6a6-44695c12216f\") "
Jul 17 07:59:12.560797 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:12.560774    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/404592fa-7cd0-473a-b6a6-44695c12216f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "404592fa-7cd0-473a-b6a6-44695c12216f" (UID: "404592fa-7cd0-473a-b6a6-44695c12216f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:59:12.662110 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:12.662054    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/404592fa-7cd0-473a-b6a6-44695c12216f-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:59:13.271750 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.271709    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x" event={"ID":"404592fa-7cd0-473a-b6a6-44695c12216f","Type":"ContainerDied","Data":"ca6ae114c0962c3aa990626cbb2193155505059f817d75939d2604203a81b451"}
Jul 17 07:59:13.271750 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.271748    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"
Jul 17 07:59:13.271986 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.271788    2546 scope.go:117] "RemoveContainer" containerID="d3c6e70c099d49e72dcc68aef666121af1f31601d26b73db671b9cfcd5c8b68c"
Jul 17 07:59:13.299687 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.297960    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"]
Jul 17 07:59:13.304257 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.304223    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-b531d224-m5k5x"]
Jul 17 07:59:13.905018 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.904974    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="404592fa-7cd0-473a-b6a6-44695c12216f" path="/var/lib/kubelet/pods/404592fa-7cd0-473a-b6a6-44695c12216f/volumes"
Jul 17 07:59:13.951593 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.951562    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"]
Jul 17 07:59:13.951987 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.951974    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404592fa-7cd0-473a-b6a6-44695c12216f" containerName="revoke-keys"
Jul 17 07:59:13.952033 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.951988    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="404592fa-7cd0-473a-b6a6-44695c12216f" containerName="revoke-keys"
Jul 17 07:59:13.952033 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.952002    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404592fa-7cd0-473a-b6a6-44695c12216f" containerName="revoke-keys"
Jul 17 07:59:13.952033 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.952008    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="404592fa-7cd0-473a-b6a6-44695c12216f" containerName="revoke-keys"
Jul 17 07:59:13.952033 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.952017    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404592fa-7cd0-473a-b6a6-44695c12216f" containerName="revoke-keys"
Jul 17 07:59:13.952033 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.952022    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="404592fa-7cd0-473a-b6a6-44695c12216f" containerName="revoke-keys"
Jul 17 07:59:13.952185 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.952092    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="404592fa-7cd0-473a-b6a6-44695c12216f" containerName="revoke-keys"
Jul 17 07:59:13.952185 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.952099    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="404592fa-7cd0-473a-b6a6-44695c12216f" containerName="revoke-keys"
Jul 17 07:59:13.952185 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.952107    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="404592fa-7cd0-473a-b6a6-44695c12216f" containerName="revoke-keys"
Jul 17 07:59:13.956613 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.956594    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"
Jul 17 07:59:13.959547 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.959525    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 07:59:13.959650 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.959560    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 07:59:13.964483 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:13.964461    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"]
Jul 17 07:59:14.077009 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:14.076958    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb24ca6-adc7-4163-b909-f3e1fedc798b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr\" (UID: \"9cb24ca6-adc7-4163-b909-f3e1fedc798b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"
Jul 17 07:59:14.177858 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:14.177758    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb24ca6-adc7-4163-b909-f3e1fedc798b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr\" (UID: \"9cb24ca6-adc7-4163-b909-f3e1fedc798b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"
Jul 17 07:59:14.178462 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:14.178438    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb24ca6-adc7-4163-b909-f3e1fedc798b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr\" (UID: \"9cb24ca6-adc7-4163-b909-f3e1fedc798b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"
Jul 17 07:59:14.268359 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:14.268318    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"
Jul 17 07:59:14.404576 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:14.404547    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"]
Jul 17 07:59:14.406884 ip-10-0-135-5 kubenswrapper[2546]: W0717 07:59:14.406858    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb24ca6_adc7_4163_b909_f3e1fedc798b.slice/crio-f52c8cd9cce0e5ebdf84de0e0696d20a3dd42bd18b1d4f6d7def2fbf4bef0bfc WatchSource:0}: Error finding container f52c8cd9cce0e5ebdf84de0e0696d20a3dd42bd18b1d4f6d7def2fbf4bef0bfc: Status 404 returned error can't find the container with id f52c8cd9cce0e5ebdf84de0e0696d20a3dd42bd18b1d4f6d7def2fbf4bef0bfc
Jul 17 07:59:15.284588 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:15.284552    2546 generic.go:356] "Generic (PLEG): container finished" podID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerID="c9e866d238195dbfff887c607e101bf239ff32db6ec986aeab337e8865349a4c" exitCode=6
Jul 17 07:59:15.285078 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:15.284641    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr" event={"ID":"9cb24ca6-adc7-4163-b909-f3e1fedc798b","Type":"ContainerDied","Data":"c9e866d238195dbfff887c607e101bf239ff32db6ec986aeab337e8865349a4c"}
Jul 17 07:59:15.285078 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:15.284712    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr" event={"ID":"9cb24ca6-adc7-4163-b909-f3e1fedc798b","Type":"ContainerStarted","Data":"f52c8cd9cce0e5ebdf84de0e0696d20a3dd42bd18b1d4f6d7def2fbf4bef0bfc"}
Jul 17 07:59:15.285078 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:15.284914    2546 scope.go:117] "RemoveContainer" containerID="c9e866d238195dbfff887c607e101bf239ff32db6ec986aeab337e8865349a4c"
Jul 17 07:59:16.291894 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:16.291864    2546 generic.go:356] "Generic (PLEG): container finished" podID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerID="6544f378126103331c6304f52be8069ff57f4b8c61ae0a8bf1760c5ceb0dfe7c" exitCode=6
Jul 17 07:59:16.292385 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:16.291947    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr" event={"ID":"9cb24ca6-adc7-4163-b909-f3e1fedc798b","Type":"ContainerDied","Data":"6544f378126103331c6304f52be8069ff57f4b8c61ae0a8bf1760c5ceb0dfe7c"}
Jul 17 07:59:16.292385 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:16.292004    2546 scope.go:117] "RemoveContainer" containerID="c9e866d238195dbfff887c607e101bf239ff32db6ec986aeab337e8865349a4c"
Jul 17 07:59:16.292385 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:16.292109    2546 scope.go:117] "RemoveContainer" containerID="6544f378126103331c6304f52be8069ff57f4b8c61ae0a8bf1760c5ceb0dfe7c"
Jul 17 07:59:16.292385 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:59:16.292368    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr_odh-ai-gateway-infra(9cb24ca6-adc7-4163-b909-f3e1fedc798b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b"
Jul 17 07:59:17.298735 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:17.298711    2546 scope.go:117] "RemoveContainer" containerID="6544f378126103331c6304f52be8069ff57f4b8c61ae0a8bf1760c5ceb0dfe7c"
Jul 17 07:59:17.299118 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:59:17.298935    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr_odh-ai-gateway-infra(9cb24ca6-adc7-4163-b909-f3e1fedc798b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b"
Jul 17 07:59:28.899069 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:28.899028    2546 scope.go:117] "RemoveContainer" containerID="6544f378126103331c6304f52be8069ff57f4b8c61ae0a8bf1760c5ceb0dfe7c"
Jul 17 07:59:29.361823 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:29.361788    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr" event={"ID":"9cb24ca6-adc7-4163-b909-f3e1fedc798b","Type":"ContainerStarted","Data":"3b0bd6c8fcd121afe6779d49b0c06e94dc9a8c9da4a15b1051a45a3164a7d108"}
Jul 17 07:59:29.381240 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:29.381190    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr" podStartSLOduration=16.381175591 podStartE2EDuration="16.381175591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 07:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 07:59:29.379275088 +0000 UTC m=+2832.185472264" watchObservedRunningTime="2026-07-17 07:59:29.381175591 +0000 UTC m=+2832.187372766"
Jul 17 07:59:30.368311 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:30.368280    2546 generic.go:356] "Generic (PLEG): container finished" podID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerID="3b0bd6c8fcd121afe6779d49b0c06e94dc9a8c9da4a15b1051a45a3164a7d108" exitCode=6
Jul 17 07:59:30.368803 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:30.368350    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr" event={"ID":"9cb24ca6-adc7-4163-b909-f3e1fedc798b","Type":"ContainerDied","Data":"3b0bd6c8fcd121afe6779d49b0c06e94dc9a8c9da4a15b1051a45a3164a7d108"}
Jul 17 07:59:30.368803 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:30.368415    2546 scope.go:117] "RemoveContainer" containerID="6544f378126103331c6304f52be8069ff57f4b8c61ae0a8bf1760c5ceb0dfe7c"
Jul 17 07:59:30.368803 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:30.368781    2546 scope.go:117] "RemoveContainer" containerID="3b0bd6c8fcd121afe6779d49b0c06e94dc9a8c9da4a15b1051a45a3164a7d108"
Jul 17 07:59:30.369057 ip-10-0-135-5 kubenswrapper[2546]: E0717 07:59:30.369037    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr_odh-ai-gateway-infra(9cb24ca6-adc7-4163-b909-f3e1fedc798b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b"
Jul 17 07:59:30.403118 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:30.403091    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"]
Jul 17 07:59:31.509770 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:31.509745    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"
Jul 17 07:59:31.537481 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:31.537453    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb24ca6-adc7-4163-b909-f3e1fedc798b-maas-api-service-ca\") pod \"9cb24ca6-adc7-4163-b909-f3e1fedc798b\" (UID: \"9cb24ca6-adc7-4163-b909-f3e1fedc798b\") "
Jul 17 07:59:31.537765 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:31.537744    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cb24ca6-adc7-4163-b909-f3e1fedc798b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9cb24ca6-adc7-4163-b909-f3e1fedc798b" (UID: "9cb24ca6-adc7-4163-b909-f3e1fedc798b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 07:59:31.638904 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:31.638808    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb24ca6-adc7-4163-b909-f3e1fedc798b-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 07:59:32.382003 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:32.381973    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"
Jul 17 07:59:32.382224 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:32.381965    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr" event={"ID":"9cb24ca6-adc7-4163-b909-f3e1fedc798b","Type":"ContainerDied","Data":"f52c8cd9cce0e5ebdf84de0e0696d20a3dd42bd18b1d4f6d7def2fbf4bef0bfc"}
Jul 17 07:59:32.382224 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:32.382111    2546 scope.go:117] "RemoveContainer" containerID="3b0bd6c8fcd121afe6779d49b0c06e94dc9a8c9da4a15b1051a45a3164a7d108"
Jul 17 07:59:32.400217 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:32.400188    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"]
Jul 17 07:59:32.405097 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:32.405072    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-px4nr"]
Jul 17 07:59:33.905334 ip-10-0-135-5 kubenswrapper[2546]: I0717 07:59:33.905300    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" path="/var/lib/kubelet/pods/9cb24ca6-adc7-4163-b909-f3e1fedc798b/volumes"
Jul 17 08:00:00.142761 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.142721    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737920-b8fkx"]
Jul 17 08:00:00.143249 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.143138    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerName="revoke-keys"
Jul 17 08:00:00.143249 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.143149    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerName="revoke-keys"
Jul 17 08:00:00.143249 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.143183    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerName="revoke-keys"
Jul 17 08:00:00.143249 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.143188    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerName="revoke-keys"
Jul 17 08:00:00.143249 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.143242    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerName="revoke-keys"
Jul 17 08:00:00.143249 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.143251    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerName="revoke-keys"
Jul 17 08:00:00.146301 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.146283    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737920-b8fkx"
Jul 17 08:00:00.150080 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.150058    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 08:00:00.156009 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.155987    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737920-b8fkx"
Jul 17 08:00:00.159456 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.159433    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737920-b8fkx"]
Jul 17 08:00:00.299894 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.299869    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737920-b8fkx"]
Jul 17 08:00:00.302135 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:00:00.302108    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf257f5a7_193a_4da0_86a9_ad103cd4f35f.slice/crio-ff6d6b4cb2e726803edd5ed39bf5253cbdf0190b393d14f22963ca798173f58a WatchSource:0}: Error finding container ff6d6b4cb2e726803edd5ed39bf5253cbdf0190b393d14f22963ca798173f58a: Status 404 returned error can't find the container with id ff6d6b4cb2e726803edd5ed39bf5253cbdf0190b393d14f22963ca798173f58a
Jul 17 08:00:00.520065 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:00.520032    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737920-b8fkx" event={"ID":"f257f5a7-193a-4da0-86a9-ad103cd4f35f","Type":"ContainerStarted","Data":"ff6d6b4cb2e726803edd5ed39bf5253cbdf0190b393d14f22963ca798173f58a"}
Jul 17 08:00:01.527424 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:01.527389    2546 generic.go:356] "Generic (PLEG): container finished" podID="f257f5a7-193a-4da0-86a9-ad103cd4f35f" containerID="ed57f734b6746ce2434bd2479a8e152fb5eb4063bf35521a96676588d87c4059" exitCode=0
Jul 17 08:00:01.527817 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:01.527477    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737920-b8fkx" event={"ID":"f257f5a7-193a-4da0-86a9-ad103cd4f35f","Type":"ContainerDied","Data":"ed57f734b6746ce2434bd2479a8e152fb5eb4063bf35521a96676588d87c4059"}
Jul 17 08:00:02.679037 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:02.679007    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737920-b8fkx"
Jul 17 08:00:03.539775 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:03.539736    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737920-b8fkx" event={"ID":"f257f5a7-193a-4da0-86a9-ad103cd4f35f","Type":"ContainerDied","Data":"ff6d6b4cb2e726803edd5ed39bf5253cbdf0190b393d14f22963ca798173f58a"}
Jul 17 08:00:03.539775 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:03.539759    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737920-b8fkx"
Jul 17 08:00:03.539993 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:03.539809    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff6d6b4cb2e726803edd5ed39bf5253cbdf0190b393d14f22963ca798173f58a"
Jul 17 08:00:06.022359 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.022319    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"]
Jul 17 08:00:06.022771 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.022742    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f257f5a7-193a-4da0-86a9-ad103cd4f35f" containerName="cleanup"
Jul 17 08:00:06.022771 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.022755    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f257f5a7-193a-4da0-86a9-ad103cd4f35f" containerName="cleanup"
Jul 17 08:00:06.022865 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.022775    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerName="revoke-keys"
Jul 17 08:00:06.022865 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.022781    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerName="revoke-keys"
Jul 17 08:00:06.022865 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.022850    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="f257f5a7-193a-4da0-86a9-ad103cd4f35f" containerName="cleanup"
Jul 17 08:00:06.022865 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.022861    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb24ca6-adc7-4163-b909-f3e1fedc798b" containerName="revoke-keys"
Jul 17 08:00:06.025869 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.025849    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"
Jul 17 08:00:06.028576 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.028556    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 08:00:06.028715 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.028639    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 08:00:06.035143 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.035120    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"]
Jul 17 08:00:06.178591 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.178553    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c90ffdae-fa65-446d-9ec1-806cdd7f159b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb\" (UID: \"c90ffdae-fa65-446d-9ec1-806cdd7f159b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"
Jul 17 08:00:06.279161 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.279071    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c90ffdae-fa65-446d-9ec1-806cdd7f159b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb\" (UID: \"c90ffdae-fa65-446d-9ec1-806cdd7f159b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"
Jul 17 08:00:06.279723 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.279704    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c90ffdae-fa65-446d-9ec1-806cdd7f159b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb\" (UID: \"c90ffdae-fa65-446d-9ec1-806cdd7f159b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"
Jul 17 08:00:06.336710 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.336651    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"
Jul 17 08:00:06.475778 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.475751    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"]
Jul 17 08:00:06.477701 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:00:06.477650    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90ffdae_fa65_446d_9ec1_806cdd7f159b.slice/crio-b1958ff4798b8f0b7ae10a5c921e7584449a14dadf0b87a30939dccd1ac3337c WatchSource:0}: Error finding container b1958ff4798b8f0b7ae10a5c921e7584449a14dadf0b87a30939dccd1ac3337c: Status 404 returned error can't find the container with id b1958ff4798b8f0b7ae10a5c921e7584449a14dadf0b87a30939dccd1ac3337c
Jul 17 08:00:06.557211 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:06.557125    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb" event={"ID":"c90ffdae-fa65-446d-9ec1-806cdd7f159b","Type":"ContainerStarted","Data":"b1958ff4798b8f0b7ae10a5c921e7584449a14dadf0b87a30939dccd1ac3337c"}
Jul 17 08:00:07.563772 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:07.563730    2546 generic.go:356] "Generic (PLEG): container finished" podID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerID="1834aa2299d596498af479d1f9074995a5421cba65a5342ad40112237fcc7d51" exitCode=6
Jul 17 08:00:07.564189 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:07.563814    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb" event={"ID":"c90ffdae-fa65-446d-9ec1-806cdd7f159b","Type":"ContainerDied","Data":"1834aa2299d596498af479d1f9074995a5421cba65a5342ad40112237fcc7d51"}
Jul 17 08:00:07.564189 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:07.563978    2546 scope.go:117] "RemoveContainer" containerID="1834aa2299d596498af479d1f9074995a5421cba65a5342ad40112237fcc7d51"
Jul 17 08:00:08.572583 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:08.572497    2546 generic.go:356] "Generic (PLEG): container finished" podID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerID="4c712ac642592545f1276165148f4e156c1e9e1cc6e5e8f691e770faf0ad6ee6" exitCode=6
Jul 17 08:00:08.572583 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:08.572561    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb" event={"ID":"c90ffdae-fa65-446d-9ec1-806cdd7f159b","Type":"ContainerDied","Data":"4c712ac642592545f1276165148f4e156c1e9e1cc6e5e8f691e770faf0ad6ee6"}
Jul 17 08:00:08.573091 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:08.572653    2546 scope.go:117] "RemoveContainer" containerID="1834aa2299d596498af479d1f9074995a5421cba65a5342ad40112237fcc7d51"
Jul 17 08:00:08.573091 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:08.572943    2546 scope.go:117] "RemoveContainer" containerID="4c712ac642592545f1276165148f4e156c1e9e1cc6e5e8f691e770faf0ad6ee6"
Jul 17 08:00:08.573206 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:00:08.573186    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb_odh-ai-gateway-infra(c90ffdae-fa65-446d-9ec1-806cdd7f159b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b"
Jul 17 08:00:09.579307 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:09.579274    2546 scope.go:117] "RemoveContainer" containerID="4c712ac642592545f1276165148f4e156c1e9e1cc6e5e8f691e770faf0ad6ee6"
Jul 17 08:00:09.579722 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:00:09.579490    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb_odh-ai-gateway-infra(c90ffdae-fa65-446d-9ec1-806cdd7f159b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b"
Jul 17 08:00:22.899023 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:22.898991    2546 scope.go:117] "RemoveContainer" containerID="4c712ac642592545f1276165148f4e156c1e9e1cc6e5e8f691e770faf0ad6ee6"
Jul 17 08:00:23.651110 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:23.651080    2546 generic.go:356] "Generic (PLEG): container finished" podID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerID="7c776a808109030f2d5ec410b5f3ddc85023dfec0b7fa9af7522ff9ef746bd11" exitCode=6
Jul 17 08:00:23.651310 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:23.651151    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb" event={"ID":"c90ffdae-fa65-446d-9ec1-806cdd7f159b","Type":"ContainerDied","Data":"7c776a808109030f2d5ec410b5f3ddc85023dfec0b7fa9af7522ff9ef746bd11"}
Jul 17 08:00:23.651310 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:23.651220    2546 scope.go:117] "RemoveContainer" containerID="4c712ac642592545f1276165148f4e156c1e9e1cc6e5e8f691e770faf0ad6ee6"
Jul 17 08:00:23.651579 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:23.651561    2546 scope.go:117] "RemoveContainer" containerID="7c776a808109030f2d5ec410b5f3ddc85023dfec0b7fa9af7522ff9ef746bd11"
Jul 17 08:00:23.651839 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:00:23.651819    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb_odh-ai-gateway-infra(c90ffdae-fa65-446d-9ec1-806cdd7f159b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b"
Jul 17 08:00:24.683422 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:24.683378    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"]
Jul 17 08:00:24.819550 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:24.819522    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"
Jul 17 08:00:24.961979 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:24.961884    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c90ffdae-fa65-446d-9ec1-806cdd7f159b-maas-api-service-ca\") pod \"c90ffdae-fa65-446d-9ec1-806cdd7f159b\" (UID: \"c90ffdae-fa65-446d-9ec1-806cdd7f159b\") "
Jul 17 08:00:24.962319 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:24.962293    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c90ffdae-fa65-446d-9ec1-806cdd7f159b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c90ffdae-fa65-446d-9ec1-806cdd7f159b" (UID: "c90ffdae-fa65-446d-9ec1-806cdd7f159b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 08:00:25.063279 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:25.063246    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c90ffdae-fa65-446d-9ec1-806cdd7f159b-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:00:25.663727 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:25.663689    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb" event={"ID":"c90ffdae-fa65-446d-9ec1-806cdd7f159b","Type":"ContainerDied","Data":"b1958ff4798b8f0b7ae10a5c921e7584449a14dadf0b87a30939dccd1ac3337c"}
Jul 17 08:00:25.663926 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:25.663754    2546 scope.go:117] "RemoveContainer" containerID="7c776a808109030f2d5ec410b5f3ddc85023dfec0b7fa9af7522ff9ef746bd11"
Jul 17 08:00:25.663926 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:25.663707    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"
Jul 17 08:00:25.685461 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:25.685421    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"]
Jul 17 08:00:25.689810 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:25.689787    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-v94fb"]
Jul 17 08:00:25.904727 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:25.904690    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" path="/var/lib/kubelet/pods/c90ffdae-fa65-446d-9ec1-806cdd7f159b/volumes"
Jul 17 08:00:29.436879 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.436843    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"]
Jul 17 08:00:29.437293 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.437232    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerName="revoke-keys"
Jul 17 08:00:29.437293 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.437242    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerName="revoke-keys"
Jul 17 08:00:29.437293 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.437250    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerName="revoke-keys"
Jul 17 08:00:29.437293 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.437255    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerName="revoke-keys"
Jul 17 08:00:29.437451 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.437342    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerName="revoke-keys"
Jul 17 08:00:29.437451 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.437352    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerName="revoke-keys"
Jul 17 08:00:29.441990 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.441969    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"
Jul 17 08:00:29.444913 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.444889    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 08:00:29.445177 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.445161    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 08:00:29.450308 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.450279    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"]
Jul 17 08:00:29.511940 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.511900    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1e1338-7594-4d93-a55e-857c14a9a65d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9\" (UID: \"fe1e1338-7594-4d93-a55e-857c14a9a65d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"
Jul 17 08:00:29.612591 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.612555    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1e1338-7594-4d93-a55e-857c14a9a65d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9\" (UID: \"fe1e1338-7594-4d93-a55e-857c14a9a65d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"
Jul 17 08:00:29.613177 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.613153    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1e1338-7594-4d93-a55e-857c14a9a65d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9\" (UID: \"fe1e1338-7594-4d93-a55e-857c14a9a65d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"
Jul 17 08:00:29.754594 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.754495    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"
Jul 17 08:00:29.890764 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.890739    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"]
Jul 17 08:00:29.892714 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:00:29.892686    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1e1338_7594_4d93_a55e_857c14a9a65d.slice/crio-7519a6fb6767b6bb27239b402b99c818fea6ded9ba3ae0e0db7d70fb34aafcae WatchSource:0}: Error finding container 7519a6fb6767b6bb27239b402b99c818fea6ded9ba3ae0e0db7d70fb34aafcae: Status 404 returned error can't find the container with id 7519a6fb6767b6bb27239b402b99c818fea6ded9ba3ae0e0db7d70fb34aafcae
Jul 17 08:00:29.947928 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.947897    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"]
Jul 17 08:00:29.948317 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.948304    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerName="revoke-keys"
Jul 17 08:00:29.948361 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.948318    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerName="revoke-keys"
Jul 17 08:00:29.948397 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.948377    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="c90ffdae-fa65-446d-9ec1-806cdd7f159b" containerName="revoke-keys"
Jul 17 08:00:29.952678 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.952651    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:29.956544 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.956515    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d805bd\"/\"auth-test-model-d805bd-kserve-self-signed-certs\""
Jul 17 08:00:29.956544 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.956529    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d805bd\"/\"openshift-service-ca.crt\""
Jul 17 08:00:29.956544 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.956541    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d805bd\"/\"default-dockercfg-fzqfz\""
Jul 17 08:00:29.956860 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.956635    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d805bd\"/\"kube-root-ca.crt\""
Jul 17 08:00:29.965532 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:29.965506    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"]
Jul 17 08:00:30.117874 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.117831    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-dshm\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.118046 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.117894    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvvrm\" (UniqueName: \"kubernetes.io/projected/c601f0c4-6b18-4612-bbbf-5afcdebe694c-kube-api-access-pvvrm\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.118046 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.117963    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-home\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.118046 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.117998    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tls-certs\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.118046 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.118021    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-model-cache\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.118046 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.118045    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tmp-dir\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.219185 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.219144    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-dshm\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.219370 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.219201    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvvrm\" (UniqueName: \"kubernetes.io/projected/c601f0c4-6b18-4612-bbbf-5afcdebe694c-kube-api-access-pvvrm\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.219370 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.219241    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-home\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.219370 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.219287    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tls-certs\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.219370 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.219322    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-model-cache\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.219581 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.219457    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tmp-dir\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.219717 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.219695    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-model-cache\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.219817 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.219715    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-home\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.219817 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.219787    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tmp-dir\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.221634 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.221611    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-dshm\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.221830 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.221811    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tls-certs\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.228488 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.228465    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvvrm\" (UniqueName: \"kubernetes.io/projected/c601f0c4-6b18-4612-bbbf-5afcdebe694c-kube-api-access-pvvrm\") pod \"auth-test-model-d805bd-kserve-f8888977f-4t4vj\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") " pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.262372 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.262323    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:30.400482 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.400457    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"]
Jul 17 08:00:30.402249 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:00:30.402221    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc601f0c4_6b18_4612_bbbf_5afcdebe694c.slice/crio-b234d56d7ba7e6b600b18a815355767f5f213b729b28a3cfc6de5f41148780fc WatchSource:0}: Error finding container b234d56d7ba7e6b600b18a815355767f5f213b729b28a3cfc6de5f41148780fc: Status 404 returned error can't find the container with id b234d56d7ba7e6b600b18a815355767f5f213b729b28a3cfc6de5f41148780fc
Jul 17 08:00:30.691479 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.691386    2546 generic.go:356] "Generic (PLEG): container finished" podID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerID="8082a35c121d70b3cc0ad847cd54d24cec23b13aa4e6e2bd0ad2f8b6510251c3" exitCode=6
Jul 17 08:00:30.691954 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.691470    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9" event={"ID":"fe1e1338-7594-4d93-a55e-857c14a9a65d","Type":"ContainerDied","Data":"8082a35c121d70b3cc0ad847cd54d24cec23b13aa4e6e2bd0ad2f8b6510251c3"}
Jul 17 08:00:30.691954 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.691523    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9" event={"ID":"fe1e1338-7594-4d93-a55e-857c14a9a65d","Type":"ContainerStarted","Data":"7519a6fb6767b6bb27239b402b99c818fea6ded9ba3ae0e0db7d70fb34aafcae"}
Jul 17 08:00:30.691954 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.691636    2546 scope.go:117] "RemoveContainer" containerID="8082a35c121d70b3cc0ad847cd54d24cec23b13aa4e6e2bd0ad2f8b6510251c3"
Jul 17 08:00:30.693182 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.693156    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj" event={"ID":"c601f0c4-6b18-4612-bbbf-5afcdebe694c","Type":"ContainerStarted","Data":"78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5"}
Jul 17 08:00:30.693299 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.693193    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj" event={"ID":"c601f0c4-6b18-4612-bbbf-5afcdebe694c","Type":"ContainerStarted","Data":"b234d56d7ba7e6b600b18a815355767f5f213b729b28a3cfc6de5f41148780fc"}
Jul 17 08:00:30.733642 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:30.733573    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj" podStartSLOduration=1.733550278 podStartE2EDuration="1.733550278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 08:00:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 08:00:30.730782242 +0000 UTC m=+2893.536979429" watchObservedRunningTime="2026-07-17 08:00:30.733550278 +0000 UTC m=+2893.539747454"
Jul 17 08:00:31.700315 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:31.700222    2546 generic.go:356] "Generic (PLEG): container finished" podID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerID="fbfa94db24f7bdeb8bde5f72816d5faf8a13918432b9f66847c3c99298e28b96" exitCode=6
Jul 17 08:00:31.700733 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:31.700305    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9" event={"ID":"fe1e1338-7594-4d93-a55e-857c14a9a65d","Type":"ContainerDied","Data":"fbfa94db24f7bdeb8bde5f72816d5faf8a13918432b9f66847c3c99298e28b96"}
Jul 17 08:00:31.700733 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:31.700367    2546 scope.go:117] "RemoveContainer" containerID="8082a35c121d70b3cc0ad847cd54d24cec23b13aa4e6e2bd0ad2f8b6510251c3"
Jul 17 08:00:31.700733 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:31.700561    2546 scope.go:117] "RemoveContainer" containerID="fbfa94db24f7bdeb8bde5f72816d5faf8a13918432b9f66847c3c99298e28b96"
Jul 17 08:00:31.700870 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:00:31.700843    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9_odh-ai-gateway-infra(fe1e1338-7594-4d93-a55e-857c14a9a65d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d"
Jul 17 08:00:32.707282 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:32.707250    2546 scope.go:117] "RemoveContainer" containerID="fbfa94db24f7bdeb8bde5f72816d5faf8a13918432b9f66847c3c99298e28b96"
Jul 17 08:00:32.707701 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:00:32.707481    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9_odh-ai-gateway-infra(fe1e1338-7594-4d93-a55e-857c14a9a65d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d"
Jul 17 08:00:40.263038 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:40.262986    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:40.263559 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:40.263058    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:40.279754 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:40.279724    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:40.759144 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:40.759118    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:00:46.898880 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:46.898850    2546 scope.go:117] "RemoveContainer" containerID="fbfa94db24f7bdeb8bde5f72816d5faf8a13918432b9f66847c3c99298e28b96"
Jul 17 08:00:47.784249 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:47.784220    2546 generic.go:356] "Generic (PLEG): container finished" podID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerID="829f96b46f207262d029eea55fa1024a0d9bc30bc8d73f57869e186c093e4c8b" exitCode=6
Jul 17 08:00:47.784447 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:47.784264    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9" event={"ID":"fe1e1338-7594-4d93-a55e-857c14a9a65d","Type":"ContainerDied","Data":"829f96b46f207262d029eea55fa1024a0d9bc30bc8d73f57869e186c093e4c8b"}
Jul 17 08:00:47.784447 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:47.784323    2546 scope.go:117] "RemoveContainer" containerID="fbfa94db24f7bdeb8bde5f72816d5faf8a13918432b9f66847c3c99298e28b96"
Jul 17 08:00:47.784711 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:47.784689    2546 scope.go:117] "RemoveContainer" containerID="829f96b46f207262d029eea55fa1024a0d9bc30bc8d73f57869e186c093e4c8b"
Jul 17 08:00:47.784939 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:00:47.784918    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9_odh-ai-gateway-infra(fe1e1338-7594-4d93-a55e-857c14a9a65d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d"
Jul 17 08:00:48.815813 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:48.815779    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"]
Jul 17 08:00:48.949870 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:48.949849    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"
Jul 17 08:00:49.000708 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:49.000650    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1e1338-7594-4d93-a55e-857c14a9a65d-maas-api-service-ca\") pod \"fe1e1338-7594-4d93-a55e-857c14a9a65d\" (UID: \"fe1e1338-7594-4d93-a55e-857c14a9a65d\") "
Jul 17 08:00:49.001021 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:49.000997    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe1e1338-7594-4d93-a55e-857c14a9a65d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe1e1338-7594-4d93-a55e-857c14a9a65d" (UID: "fe1e1338-7594-4d93-a55e-857c14a9a65d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 08:00:49.102146 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:49.102063    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe1e1338-7594-4d93-a55e-857c14a9a65d-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:00:49.797723 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:49.797687    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9" event={"ID":"fe1e1338-7594-4d93-a55e-857c14a9a65d","Type":"ContainerDied","Data":"7519a6fb6767b6bb27239b402b99c818fea6ded9ba3ae0e0db7d70fb34aafcae"}
Jul 17 08:00:49.797723 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:49.797710    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"
Jul 17 08:00:49.797999 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:49.797748    2546 scope.go:117] "RemoveContainer" containerID="829f96b46f207262d029eea55fa1024a0d9bc30bc8d73f57869e186c093e4c8b"
Jul 17 08:00:49.820590 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:49.820565    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"]
Jul 17 08:00:49.825838 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:49.825818    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-flpc9"]
Jul 17 08:00:49.905924 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:00:49.905898    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d" path="/var/lib/kubelet/pods/fe1e1338-7594-4d93-a55e-857c14a9a65d/volumes"
Jul 17 08:01:14.154943 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.154905    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"]
Jul 17 08:01:14.155504 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.155327    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerName="revoke-keys"
Jul 17 08:01:14.155504 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.155347    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerName="revoke-keys"
Jul 17 08:01:14.155504 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.155358    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerName="revoke-keys"
Jul 17 08:01:14.155504 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.155364    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerName="revoke-keys"
Jul 17 08:01:14.155504 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.155425    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerName="revoke-keys"
Jul 17 08:01:14.155504 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.155435    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerName="revoke-keys"
Jul 17 08:01:14.158613 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.158597    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.162486 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.162465    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"auth-test-model-04d1db-kserve-self-signed-certs\""
Jul 17 08:01:14.162486 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.162476    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"default-dockercfg-bh8jg\""
Jul 17 08:01:14.162692 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.162485    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"openshift-service-ca.crt\""
Jul 17 08:01:14.162692 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.162556    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"kube-root-ca.crt\""
Jul 17 08:01:14.169438 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.169413    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"]
Jul 17 08:01:14.247235 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.247200    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqskb\" (UniqueName: \"kubernetes.io/projected/995a933d-4511-417d-8ac4-b1d8f2e0c28d-kube-api-access-dqskb\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.247407 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.247266    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-home\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.247407 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.247325    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-dshm\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.247407 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.247366    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tmp-dir\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.247407 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.247402    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-model-cache\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.247553 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.247417    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tls-certs\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.348076 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.348043    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tmp-dir\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.348261 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.348091    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-model-cache\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.348261 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.348107    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tls-certs\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.348261 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.348154    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqskb\" (UniqueName: \"kubernetes.io/projected/995a933d-4511-417d-8ac4-b1d8f2e0c28d-kube-api-access-dqskb\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.348261 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.348195    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-home\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.348476 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.348269    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-dshm\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.348577 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.348547    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-model-cache\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.348757 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.348572    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tmp-dir\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.348757 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.348650    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-home\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.350490 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.350470    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-dshm\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.350661 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.350642    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tls-certs\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.356552 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.356531    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqskb\" (UniqueName: \"kubernetes.io/projected/995a933d-4511-417d-8ac4-b1d8f2e0c28d-kube-api-access-dqskb\") pod \"auth-test-model-04d1db-kserve-869bb64f9-cpd7b\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") " pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.467917 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.467817    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:14.598310 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.598281    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"]
Jul 17 08:01:14.599472 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:01:14.599445    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod995a933d_4511_417d_8ac4_b1d8f2e0c28d.slice/crio-07209160db039694fbccedf468a4d8ad0d35feba73540c1be3ef17d56ab7b4f4 WatchSource:0}: Error finding container 07209160db039694fbccedf468a4d8ad0d35feba73540c1be3ef17d56ab7b4f4: Status 404 returned error can't find the container with id 07209160db039694fbccedf468a4d8ad0d35feba73540c1be3ef17d56ab7b4f4
Jul 17 08:01:14.927992 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.927952    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b" event={"ID":"995a933d-4511-417d-8ac4-b1d8f2e0c28d","Type":"ContainerStarted","Data":"7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874"}
Jul 17 08:01:14.928215 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.928007    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b" event={"ID":"995a933d-4511-417d-8ac4-b1d8f2e0c28d","Type":"ContainerStarted","Data":"07209160db039694fbccedf468a4d8ad0d35feba73540c1be3ef17d56ab7b4f4"}
Jul 17 08:01:14.947307 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:14.947261    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b" podStartSLOduration=0.947244826 podStartE2EDuration="947.244826ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 08:01:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 08:01:14.946632485 +0000 UTC m=+2937.752829661" watchObservedRunningTime="2026-07-17 08:01:14.947244826 +0000 UTC m=+2937.753442000"
Jul 17 08:01:24.468264 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:24.468228    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:24.468658 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:24.468279    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:24.481016 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:24.480990    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:01:24.988525 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:01:24.988497    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:03:28.155535 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:28.155448    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"]
Jul 17 08:03:28.997324 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:28.997290    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"]
Jul 17 08:03:43.175720 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.175640    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj" podUID="c601f0c4-6b18-4612-bbbf-5afcdebe694c" containerName="main" containerID="cri-o://78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5" gracePeriod=45
Jul 17 08:03:43.427070 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.427008    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:03:43.599252 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.599213    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvvrm\" (UniqueName: \"kubernetes.io/projected/c601f0c4-6b18-4612-bbbf-5afcdebe694c-kube-api-access-pvvrm\") pod \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") "
Jul 17 08:03:43.599451 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.599263    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-dshm\") pod \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") "
Jul 17 08:03:43.599451 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.599292    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tmp-dir\") pod \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") "
Jul 17 08:03:43.599451 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.599314    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tls-certs\") pod \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") "
Jul 17 08:03:43.599451 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.599382    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-home\") pod \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") "
Jul 17 08:03:43.599451 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.599413    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-model-cache\") pod \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\" (UID: \"c601f0c4-6b18-4612-bbbf-5afcdebe694c\") "
Jul 17 08:03:43.599763 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.599596    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c601f0c4-6b18-4612-bbbf-5afcdebe694c" (UID: "c601f0c4-6b18-4612-bbbf-5afcdebe694c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:03:43.599820 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.599764    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tmp-dir\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:43.599820 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.599769    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-home" (OuterVolumeSpecName: "home") pod "c601f0c4-6b18-4612-bbbf-5afcdebe694c" (UID: "c601f0c4-6b18-4612-bbbf-5afcdebe694c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:03:43.599820 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.599787    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-model-cache" (OuterVolumeSpecName: "model-cache") pod "c601f0c4-6b18-4612-bbbf-5afcdebe694c" (UID: "c601f0c4-6b18-4612-bbbf-5afcdebe694c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:03:43.601629 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.601609    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-dshm" (OuterVolumeSpecName: "dshm") pod "c601f0c4-6b18-4612-bbbf-5afcdebe694c" (UID: "c601f0c4-6b18-4612-bbbf-5afcdebe694c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:03:43.601778 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.601635    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c601f0c4-6b18-4612-bbbf-5afcdebe694c-kube-api-access-pvvrm" (OuterVolumeSpecName: "kube-api-access-pvvrm") pod "c601f0c4-6b18-4612-bbbf-5afcdebe694c" (UID: "c601f0c4-6b18-4612-bbbf-5afcdebe694c"). InnerVolumeSpecName "kube-api-access-pvvrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 08:03:43.601778 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.601757    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c601f0c4-6b18-4612-bbbf-5afcdebe694c" (UID: "c601f0c4-6b18-4612-bbbf-5afcdebe694c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 08:03:43.672643 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.672604    2546 generic.go:356] "Generic (PLEG): container finished" podID="c601f0c4-6b18-4612-bbbf-5afcdebe694c" containerID="78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5" exitCode=0
Jul 17 08:03:43.672832 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.672648    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"
Jul 17 08:03:43.672832 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.672699    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj" event={"ID":"c601f0c4-6b18-4612-bbbf-5afcdebe694c","Type":"ContainerDied","Data":"78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5"}
Jul 17 08:03:43.672832 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.672747    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj" event={"ID":"c601f0c4-6b18-4612-bbbf-5afcdebe694c","Type":"ContainerDied","Data":"b234d56d7ba7e6b600b18a815355767f5f213b729b28a3cfc6de5f41148780fc"}
Jul 17 08:03:43.672832 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.672765    2546 scope.go:117] "RemoveContainer" containerID="78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5"
Jul 17 08:03:43.686241 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.686221    2546 scope.go:117] "RemoveContainer" containerID="78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5"
Jul 17 08:03:43.686516 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:03:43.686497    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5\": container with ID starting with 78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5 not found: ID does not exist" containerID="78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5"
Jul 17 08:03:43.686571 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.686529    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5"} err="failed to get container status \"78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5\": rpc error: code = NotFound desc = could not find container \"78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5\": container with ID starting with 78efa2350bd75f553750b792591301d821d70fa092bd098ee763e846469902e5 not found: ID does not exist"
Jul 17 08:03:43.699231 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.699208    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"]
Jul 17 08:03:43.701228 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.701207    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/auth-test-model-d805bd-kserve-f8888977f-4t4vj"]
Jul 17 08:03:43.701321 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.701239    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvvrm\" (UniqueName: \"kubernetes.io/projected/c601f0c4-6b18-4612-bbbf-5afcdebe694c-kube-api-access-pvvrm\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:43.701321 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.701258    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-dshm\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:43.701321 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.701268    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c601f0c4-6b18-4612-bbbf-5afcdebe694c-tls-certs\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:43.701321 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.701276    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-home\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:43.701321 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.701285    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c601f0c4-6b18-4612-bbbf-5afcdebe694c-model-cache\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:43.904804 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:43.904769    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c601f0c4-6b18-4612-bbbf-5afcdebe694c" path="/var/lib/kubelet/pods/c601f0c4-6b18-4612-bbbf-5afcdebe694c/volumes"
Jul 17 08:03:44.017375 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.017284    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b" podUID="995a933d-4511-417d-8ac4-b1d8f2e0c28d" containerName="main" containerID="cri-o://7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874" gracePeriod=45
Jul 17 08:03:44.270635 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.270610    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:03:44.408332 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408295    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-dshm\") pod \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") "
Jul 17 08:03:44.408332 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408331    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-model-cache\") pod \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") "
Jul 17 08:03:44.408582 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408368    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqskb\" (UniqueName: \"kubernetes.io/projected/995a933d-4511-417d-8ac4-b1d8f2e0c28d-kube-api-access-dqskb\") pod \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") "
Jul 17 08:03:44.408582 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408389    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-home\") pod \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") "
Jul 17 08:03:44.408582 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408439    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tmp-dir\") pod \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") "
Jul 17 08:03:44.408582 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408552    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tls-certs\") pod \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\" (UID: \"995a933d-4511-417d-8ac4-b1d8f2e0c28d\") "
Jul 17 08:03:44.408828 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408635    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-model-cache" (OuterVolumeSpecName: "model-cache") pod "995a933d-4511-417d-8ac4-b1d8f2e0c28d" (UID: "995a933d-4511-417d-8ac4-b1d8f2e0c28d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:03:44.408828 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408770    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-home" (OuterVolumeSpecName: "home") pod "995a933d-4511-417d-8ac4-b1d8f2e0c28d" (UID: "995a933d-4511-417d-8ac4-b1d8f2e0c28d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:03:44.408929 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408861    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "995a933d-4511-417d-8ac4-b1d8f2e0c28d" (UID: "995a933d-4511-417d-8ac4-b1d8f2e0c28d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:03:44.408994 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408957    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-home\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:44.408994 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408976    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tmp-dir\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:44.408994 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.408991    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-model-cache\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:44.410627 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.410606    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "995a933d-4511-417d-8ac4-b1d8f2e0c28d" (UID: "995a933d-4511-417d-8ac4-b1d8f2e0c28d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 08:03:44.410752 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.410652    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995a933d-4511-417d-8ac4-b1d8f2e0c28d-kube-api-access-dqskb" (OuterVolumeSpecName: "kube-api-access-dqskb") pod "995a933d-4511-417d-8ac4-b1d8f2e0c28d" (UID: "995a933d-4511-417d-8ac4-b1d8f2e0c28d"). InnerVolumeSpecName "kube-api-access-dqskb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 08:03:44.410752 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.410715    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-dshm" (OuterVolumeSpecName: "dshm") pod "995a933d-4511-417d-8ac4-b1d8f2e0c28d" (UID: "995a933d-4511-417d-8ac4-b1d8f2e0c28d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:03:44.509498 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.509456    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995a933d-4511-417d-8ac4-b1d8f2e0c28d-tls-certs\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:44.509498 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.509492    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995a933d-4511-417d-8ac4-b1d8f2e0c28d-dshm\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:44.509498 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.509502    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqskb\" (UniqueName: \"kubernetes.io/projected/995a933d-4511-417d-8ac4-b1d8f2e0c28d-kube-api-access-dqskb\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:03:44.681142 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.681042    2546 generic.go:356] "Generic (PLEG): container finished" podID="995a933d-4511-417d-8ac4-b1d8f2e0c28d" containerID="7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874" exitCode=0
Jul 17 08:03:44.681142 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.681084    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"
Jul 17 08:03:44.681142 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.681124    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b" event={"ID":"995a933d-4511-417d-8ac4-b1d8f2e0c28d","Type":"ContainerDied","Data":"7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874"}
Jul 17 08:03:44.681406 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.681169    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b" event={"ID":"995a933d-4511-417d-8ac4-b1d8f2e0c28d","Type":"ContainerDied","Data":"07209160db039694fbccedf468a4d8ad0d35feba73540c1be3ef17d56ab7b4f4"}
Jul 17 08:03:44.681406 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.681189    2546 scope.go:117] "RemoveContainer" containerID="7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874"
Jul 17 08:03:44.690476 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.690458    2546 scope.go:117] "RemoveContainer" containerID="7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874"
Jul 17 08:03:44.690742 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:03:44.690724    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874\": container with ID starting with 7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874 not found: ID does not exist" containerID="7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874"
Jul 17 08:03:44.690806 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.690750    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874"} err="failed to get container status \"7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874\": rpc error: code = NotFound desc = could not find container \"7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874\": container with ID starting with 7d834c3f167a178cd5125d110faefa7c27727f179ad79a2178b1913f92e53874 not found: ID does not exist"
Jul 17 08:03:44.705371 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.705345    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"]
Jul 17 08:03:44.709340 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:44.709321    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/auth-test-model-04d1db-kserve-869bb64f9-cpd7b"]
Jul 17 08:03:45.905059 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:45.905028    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="995a933d-4511-417d-8ac4-b1d8f2e0c28d" path="/var/lib/kubelet/pods/995a933d-4511-417d-8ac4-b1d8f2e0c28d/volumes"
Jul 17 08:03:46.552472 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.552438    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"]
Jul 17 08:03:46.552977 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.552955    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995a933d-4511-417d-8ac4-b1d8f2e0c28d" containerName="main"
Jul 17 08:03:46.552977 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.552978    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="995a933d-4511-417d-8ac4-b1d8f2e0c28d" containerName="main"
Jul 17 08:03:46.553187 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.553010    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerName="revoke-keys"
Jul 17 08:03:46.553187 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.553018    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerName="revoke-keys"
Jul 17 08:03:46.553187 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.553043    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c601f0c4-6b18-4612-bbbf-5afcdebe694c" containerName="main"
Jul 17 08:03:46.553187 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.553055    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="c601f0c4-6b18-4612-bbbf-5afcdebe694c" containerName="main"
Jul 17 08:03:46.553187 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.553151    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe1e1338-7594-4d93-a55e-857c14a9a65d" containerName="revoke-keys"
Jul 17 08:03:46.553187 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.553167    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="995a933d-4511-417d-8ac4-b1d8f2e0c28d" containerName="main"
Jul 17 08:03:46.553187 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.553182    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="c601f0c4-6b18-4612-bbbf-5afcdebe694c" containerName="main"
Jul 17 08:03:46.557924 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.557902    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"
Jul 17 08:03:46.560770 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.560740    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 08:03:46.561265 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.561245    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 08:03:46.566895 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.566870    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"]
Jul 17 08:03:46.731099 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.731066    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a147573c-12f9-4c09-999d-10c4d4e30dd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9\" (UID: \"a147573c-12f9-4c09-999d-10c4d4e30dd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"
Jul 17 08:03:46.832561 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.832455    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a147573c-12f9-4c09-999d-10c4d4e30dd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9\" (UID: \"a147573c-12f9-4c09-999d-10c4d4e30dd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"
Jul 17 08:03:46.833132 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.833110    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a147573c-12f9-4c09-999d-10c4d4e30dd9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9\" (UID: \"a147573c-12f9-4c09-999d-10c4d4e30dd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"
Jul 17 08:03:46.869348 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:46.869312    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"
Jul 17 08:03:47.011601 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:47.011566    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"]
Jul 17 08:03:47.015309 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:03:47.015270    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda147573c_12f9_4c09_999d_10c4d4e30dd9.slice/crio-b4e596f74743b2530203c9e9ca71cbe0fc5b80ac0cdc9a618a63f396df2a7896 WatchSource:0}: Error finding container b4e596f74743b2530203c9e9ca71cbe0fc5b80ac0cdc9a618a63f396df2a7896: Status 404 returned error can't find the container with id b4e596f74743b2530203c9e9ca71cbe0fc5b80ac0cdc9a618a63f396df2a7896
Jul 17 08:03:47.699173 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:47.699078    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9" event={"ID":"a147573c-12f9-4c09-999d-10c4d4e30dd9","Type":"ContainerStarted","Data":"4c4c279b2c694666496bedc21375eec1a6849cbced2b56d1e957bfc5f8146e1b"}
Jul 17 08:03:47.699173 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:47.699134    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9" event={"ID":"a147573c-12f9-4c09-999d-10c4d4e30dd9","Type":"ContainerStarted","Data":"b4e596f74743b2530203c9e9ca71cbe0fc5b80ac0cdc9a618a63f396df2a7896"}
Jul 17 08:03:47.719018 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:47.718968    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9" podStartSLOduration=1.718951765 podStartE2EDuration="1.718951765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 08:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 08:03:47.717867732 +0000 UTC m=+3090.524064919" watchObservedRunningTime="2026-07-17 08:03:47.718951765 +0000 UTC m=+3090.525148939"
Jul 17 08:03:48.704918 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:48.704882    2546 generic.go:356] "Generic (PLEG): container finished" podID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerID="4c4c279b2c694666496bedc21375eec1a6849cbced2b56d1e957bfc5f8146e1b" exitCode=6
Jul 17 08:03:48.705421 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:48.704971    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9" event={"ID":"a147573c-12f9-4c09-999d-10c4d4e30dd9","Type":"ContainerDied","Data":"4c4c279b2c694666496bedc21375eec1a6849cbced2b56d1e957bfc5f8146e1b"}
Jul 17 08:03:48.705421 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:48.705139    2546 scope.go:117] "RemoveContainer" containerID="4c4c279b2c694666496bedc21375eec1a6849cbced2b56d1e957bfc5f8146e1b"
Jul 17 08:03:49.712367 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:49.712279    2546 generic.go:356] "Generic (PLEG): container finished" podID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerID="4d2418ea7aa4e8ef042c2be5906dc0fd065282b732d41d4e8e5232294f166079" exitCode=6
Jul 17 08:03:49.712836 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:49.712367    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9" event={"ID":"a147573c-12f9-4c09-999d-10c4d4e30dd9","Type":"ContainerDied","Data":"4d2418ea7aa4e8ef042c2be5906dc0fd065282b732d41d4e8e5232294f166079"}
Jul 17 08:03:49.712836 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:49.712429    2546 scope.go:117] "RemoveContainer" containerID="4c4c279b2c694666496bedc21375eec1a6849cbced2b56d1e957bfc5f8146e1b"
Jul 17 08:03:49.712836 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:49.712585    2546 scope.go:117] "RemoveContainer" containerID="4d2418ea7aa4e8ef042c2be5906dc0fd065282b732d41d4e8e5232294f166079"
Jul 17 08:03:49.712964 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:03:49.712842    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9_odh-ai-gateway-infra(a147573c-12f9-4c09-999d-10c4d4e30dd9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9"
Jul 17 08:03:50.718956 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:03:50.718925    2546 scope.go:117] "RemoveContainer" containerID="4d2418ea7aa4e8ef042c2be5906dc0fd065282b732d41d4e8e5232294f166079"
Jul 17 08:03:50.719348 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:03:50.719160    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9_odh-ai-gateway-infra(a147573c-12f9-4c09-999d-10c4d4e30dd9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9"
Jul 17 08:04:02.899071 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:02.899037    2546 scope.go:117] "RemoveContainer" containerID="4d2418ea7aa4e8ef042c2be5906dc0fd065282b732d41d4e8e5232294f166079"
Jul 17 08:04:03.787223 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:03.787192    2546 generic.go:356] "Generic (PLEG): container finished" podID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerID="463d8c5ecdc71b0b59dfd187a094e4718055ae12a77c9d07f9d285d6a682990f" exitCode=6
Jul 17 08:04:03.787406 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:03.787269    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9" event={"ID":"a147573c-12f9-4c09-999d-10c4d4e30dd9","Type":"ContainerDied","Data":"463d8c5ecdc71b0b59dfd187a094e4718055ae12a77c9d07f9d285d6a682990f"}
Jul 17 08:04:03.787406 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:03.787333    2546 scope.go:117] "RemoveContainer" containerID="4d2418ea7aa4e8ef042c2be5906dc0fd065282b732d41d4e8e5232294f166079"
Jul 17 08:04:03.787679 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:03.787642    2546 scope.go:117] "RemoveContainer" containerID="463d8c5ecdc71b0b59dfd187a094e4718055ae12a77c9d07f9d285d6a682990f"
Jul 17 08:04:03.787913 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:04:03.787894    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9_odh-ai-gateway-infra(a147573c-12f9-4c09-999d-10c4d4e30dd9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9"
Jul 17 08:04:04.273594 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.273559    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"]
Jul 17 08:04:04.278388 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.278365    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"
Jul 17 08:04:04.279015 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.278995    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"]
Jul 17 08:04:04.282336 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.282320    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.288852 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.288834    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"default-dockercfg-bh8jg\""
Jul 17 08:04:04.289081 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.289067    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"openshift-service-ca.crt\""
Jul 17 08:04:04.289853 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.289833    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"kube-root-ca.crt\""
Jul 17 08:04:04.289930 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.289841    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"sub-test-model-04d1db-kserve-self-signed-certs\""
Jul 17 08:04:04.305485 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.305460    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"]
Jul 17 08:04:04.326503 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.326469    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"]
Jul 17 08:04:04.408241 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.408204    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57eaadf6-6ca1-4a96-aa21-78015191ebca-tls-certs\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.408441 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.408252    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-home\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.408441 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.408269    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-tmp-dir\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.408441 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.408346    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/956eff73-d1df-48ca-b920-ff88a57712e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s\" (UID: \"956eff73-d1df-48ca-b920-ff88a57712e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"
Jul 17 08:04:04.408575 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.408449    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-dshm\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.408575 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.408477    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w45k8\" (UniqueName: \"kubernetes.io/projected/57eaadf6-6ca1-4a96-aa21-78015191ebca-kube-api-access-w45k8\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.408575 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.408500    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-model-cache\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.509290 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.509258    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-dshm\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.509491 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.509306    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w45k8\" (UniqueName: \"kubernetes.io/projected/57eaadf6-6ca1-4a96-aa21-78015191ebca-kube-api-access-w45k8\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.509491 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.509341    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-model-cache\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.509491 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.509368    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57eaadf6-6ca1-4a96-aa21-78015191ebca-tls-certs\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.509491 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.509419    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-home\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.509491 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.509442    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-tmp-dir\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.509491 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.509481    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/956eff73-d1df-48ca-b920-ff88a57712e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s\" (UID: \"956eff73-d1df-48ca-b920-ff88a57712e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"
Jul 17 08:04:04.509856 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.509823    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-model-cache\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.509922 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.509863    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-home\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.509980 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.509944    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-tmp-dir\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.510253 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.510237    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/956eff73-d1df-48ca-b920-ff88a57712e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s\" (UID: \"956eff73-d1df-48ca-b920-ff88a57712e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"
Jul 17 08:04:04.511544 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.511524    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-dshm\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.512041 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.512017    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57eaadf6-6ca1-4a96-aa21-78015191ebca-tls-certs\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.517818 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.517794    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w45k8\" (UniqueName: \"kubernetes.io/projected/57eaadf6-6ca1-4a96-aa21-78015191ebca-kube-api-access-w45k8\") pod \"sub-test-model-04d1db-kserve-948fbc469-t9pmf\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") " pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.589832 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.589761    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"
Jul 17 08:04:04.594932 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.594905    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:04.766716 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.766522    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"]
Jul 17 08:04:04.769970 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:04:04.769939    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57eaadf6_6ca1_4a96_aa21_78015191ebca.slice/crio-980841fe209ec3e1cb6182e393c2a52124ee2c40c2f0e2ffe9b1a14af8bb420d WatchSource:0}: Error finding container 980841fe209ec3e1cb6182e393c2a52124ee2c40c2f0e2ffe9b1a14af8bb420d: Status 404 returned error can't find the container with id 980841fe209ec3e1cb6182e393c2a52124ee2c40c2f0e2ffe9b1a14af8bb420d
Jul 17 08:04:04.794896 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.794872    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf" event={"ID":"57eaadf6-6ca1-4a96-aa21-78015191ebca","Type":"ContainerStarted","Data":"980841fe209ec3e1cb6182e393c2a52124ee2c40c2f0e2ffe9b1a14af8bb420d"}
Jul 17 08:04:04.816421 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.816398    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"]
Jul 17 08:04:04.942152 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.942129    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"
Jul 17 08:04:04.968207 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:04.968180    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"]
Jul 17 08:04:04.971250 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:04:04.971221    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956eff73_d1df_48ca_b920_ff88a57712e7.slice/crio-079c821fc7c5537ddc12758a4480d8d607c9fdaba8ca6bcef1854ce8ac26e45d WatchSource:0}: Error finding container 079c821fc7c5537ddc12758a4480d8d607c9fdaba8ca6bcef1854ce8ac26e45d: Status 404 returned error can't find the container with id 079c821fc7c5537ddc12758a4480d8d607c9fdaba8ca6bcef1854ce8ac26e45d
Jul 17 08:04:05.014512 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.014485    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a147573c-12f9-4c09-999d-10c4d4e30dd9-maas-api-service-ca\") pod \"a147573c-12f9-4c09-999d-10c4d4e30dd9\" (UID: \"a147573c-12f9-4c09-999d-10c4d4e30dd9\") "
Jul 17 08:04:05.014836 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.014815    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a147573c-12f9-4c09-999d-10c4d4e30dd9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a147573c-12f9-4c09-999d-10c4d4e30dd9" (UID: "a147573c-12f9-4c09-999d-10c4d4e30dd9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 08:04:05.116113 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.116080    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a147573c-12f9-4c09-999d-10c4d4e30dd9-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:04:05.802569 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.802478    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf" event={"ID":"57eaadf6-6ca1-4a96-aa21-78015191ebca","Type":"ContainerStarted","Data":"270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3"}
Jul 17 08:04:05.804025 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.803997    2546 generic.go:356] "Generic (PLEG): container finished" podID="956eff73-d1df-48ca-b920-ff88a57712e7" containerID="cab39b48b6be168f1d48e0c39db37848186617b215abcbc70e0a4b17e6171272" exitCode=6
Jul 17 08:04:05.804133 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.804075    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s" event={"ID":"956eff73-d1df-48ca-b920-ff88a57712e7","Type":"ContainerDied","Data":"cab39b48b6be168f1d48e0c39db37848186617b215abcbc70e0a4b17e6171272"}
Jul 17 08:04:05.804133 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.804124    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s" event={"ID":"956eff73-d1df-48ca-b920-ff88a57712e7","Type":"ContainerStarted","Data":"079c821fc7c5537ddc12758a4480d8d607c9fdaba8ca6bcef1854ce8ac26e45d"}
Jul 17 08:04:05.804236 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.804206    2546 scope.go:117] "RemoveContainer" containerID="cab39b48b6be168f1d48e0c39db37848186617b215abcbc70e0a4b17e6171272"
Jul 17 08:04:05.805433 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.805414    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"
Jul 17 08:04:05.805433 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.805419    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9" event={"ID":"a147573c-12f9-4c09-999d-10c4d4e30dd9","Type":"ContainerDied","Data":"b4e596f74743b2530203c9e9ca71cbe0fc5b80ac0cdc9a618a63f396df2a7896"}
Jul 17 08:04:05.805576 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.805459    2546 scope.go:117] "RemoveContainer" containerID="463d8c5ecdc71b0b59dfd187a094e4718055ae12a77c9d07f9d285d6a682990f"
Jul 17 08:04:05.829758 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.829616    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf" podStartSLOduration=1.829596362 podStartE2EDuration="1.829596362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 08:04:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 08:04:05.827829831 +0000 UTC m=+3108.634027007" watchObservedRunningTime="2026-07-17 08:04:05.829596362 +0000 UTC m=+3108.635793538"
Jul 17 08:04:05.846032 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.846003    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"]
Jul 17 08:04:05.853348 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.853321    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-370a9d5a-9mmj9"]
Jul 17 08:04:05.904603 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:05.904570    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9" path="/var/lib/kubelet/pods/a147573c-12f9-4c09-999d-10c4d4e30dd9/volumes"
Jul 17 08:04:06.813135 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:06.813097    2546 generic.go:356] "Generic (PLEG): container finished" podID="956eff73-d1df-48ca-b920-ff88a57712e7" containerID="2cd6a8a531d80d9d923f37842e940f105cf32dbdda9e291ee493240b390066e9" exitCode=6
Jul 17 08:04:06.813596 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:06.813187    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s" event={"ID":"956eff73-d1df-48ca-b920-ff88a57712e7","Type":"ContainerDied","Data":"2cd6a8a531d80d9d923f37842e940f105cf32dbdda9e291ee493240b390066e9"}
Jul 17 08:04:06.813596 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:06.813259    2546 scope.go:117] "RemoveContainer" containerID="cab39b48b6be168f1d48e0c39db37848186617b215abcbc70e0a4b17e6171272"
Jul 17 08:04:06.813596 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:06.813502    2546 scope.go:117] "RemoveContainer" containerID="2cd6a8a531d80d9d923f37842e940f105cf32dbdda9e291ee493240b390066e9"
Jul 17 08:04:06.813806 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:04:06.813768    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s_odh-ai-gateway-infra(956eff73-d1df-48ca-b920-ff88a57712e7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s" podUID="956eff73-d1df-48ca-b920-ff88a57712e7"
Jul 17 08:04:07.820771 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:07.820741    2546 scope.go:117] "RemoveContainer" containerID="2cd6a8a531d80d9d923f37842e940f105cf32dbdda9e291ee493240b390066e9"
Jul 17 08:04:07.821162 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:04:07.821006    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s_odh-ai-gateway-infra(956eff73-d1df-48ca-b920-ff88a57712e7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s" podUID="956eff73-d1df-48ca-b920-ff88a57712e7"
Jul 17 08:04:09.620919 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.620879    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"]
Jul 17 08:04:09.621479 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.621458    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerName="revoke-keys"
Jul 17 08:04:09.621584 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.621482    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerName="revoke-keys"
Jul 17 08:04:09.621584 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.621498    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerName="revoke-keys"
Jul 17 08:04:09.621584 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.621505    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerName="revoke-keys"
Jul 17 08:04:09.621760 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.621623    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerName="revoke-keys"
Jul 17 08:04:09.621760 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.621646    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerName="revoke-keys"
Jul 17 08:04:09.625928 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.625904    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"
Jul 17 08:04:09.632373 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.632342    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"]
Jul 17 08:04:09.761412 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.761370    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92791a94-7bf0-4d1e-b52f-a806515d5297-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj\" (UID: \"92791a94-7bf0-4d1e-b52f-a806515d5297\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"
Jul 17 08:04:09.862125 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.862087    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92791a94-7bf0-4d1e-b52f-a806515d5297-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj\" (UID: \"92791a94-7bf0-4d1e-b52f-a806515d5297\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"
Jul 17 08:04:09.862722 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.862701    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92791a94-7bf0-4d1e-b52f-a806515d5297-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj\" (UID: \"92791a94-7bf0-4d1e-b52f-a806515d5297\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"
Jul 17 08:04:09.939410 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:09.939321    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"
Jul 17 08:04:10.083288 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:10.083249    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"]
Jul 17 08:04:10.085736 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:04:10.085697    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92791a94_7bf0_4d1e_b52f_a806515d5297.slice/crio-9f671d1fe50dd12cb72ad71dc03b9c15939976390d5662d243b58c2d21359968 WatchSource:0}: Error finding container 9f671d1fe50dd12cb72ad71dc03b9c15939976390d5662d243b58c2d21359968: Status 404 returned error can't find the container with id 9f671d1fe50dd12cb72ad71dc03b9c15939976390d5662d243b58c2d21359968
Jul 17 08:04:10.838166 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:10.838131    2546 generic.go:356] "Generic (PLEG): container finished" podID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerID="8ec795e2f321e52d97332a6db95788e813ddf60fc48a068483b681eafeb8b9df" exitCode=6
Jul 17 08:04:10.838581 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:10.838225    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj" event={"ID":"92791a94-7bf0-4d1e-b52f-a806515d5297","Type":"ContainerDied","Data":"8ec795e2f321e52d97332a6db95788e813ddf60fc48a068483b681eafeb8b9df"}
Jul 17 08:04:10.838581 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:10.838312    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj" event={"ID":"92791a94-7bf0-4d1e-b52f-a806515d5297","Type":"ContainerStarted","Data":"9f671d1fe50dd12cb72ad71dc03b9c15939976390d5662d243b58c2d21359968"}
Jul 17 08:04:10.838581 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:10.838391    2546 scope.go:117] "RemoveContainer" containerID="8ec795e2f321e52d97332a6db95788e813ddf60fc48a068483b681eafeb8b9df"
Jul 17 08:04:11.845483 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:11.845445    2546 generic.go:356] "Generic (PLEG): container finished" podID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerID="fba09a44b5bb36c0b9d5c70a818432a73dde8584e4c71b305c3792fe236765a0" exitCode=6
Jul 17 08:04:11.845935 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:11.845508    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj" event={"ID":"92791a94-7bf0-4d1e-b52f-a806515d5297","Type":"ContainerDied","Data":"fba09a44b5bb36c0b9d5c70a818432a73dde8584e4c71b305c3792fe236765a0"}
Jul 17 08:04:11.845935 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:11.845552    2546 scope.go:117] "RemoveContainer" containerID="8ec795e2f321e52d97332a6db95788e813ddf60fc48a068483b681eafeb8b9df"
Jul 17 08:04:11.845935 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:11.845727    2546 scope.go:117] "RemoveContainer" containerID="fba09a44b5bb36c0b9d5c70a818432a73dde8584e4c71b305c3792fe236765a0"
Jul 17 08:04:11.846095 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:04:11.845982    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj_odh-ai-gateway-infra(92791a94-7bf0-4d1e-b52f-a806515d5297)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297"
Jul 17 08:04:12.853168 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:12.853139    2546 scope.go:117] "RemoveContainer" containerID="fba09a44b5bb36c0b9d5c70a818432a73dde8584e4c71b305c3792fe236765a0"
Jul 17 08:04:12.853579 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:04:12.853362    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj_odh-ai-gateway-infra(92791a94-7bf0-4d1e-b52f-a806515d5297)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297"
Jul 17 08:04:14.595590 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:14.595556    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:14.596098 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:14.595620    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:14.608547 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:14.608524    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:14.875888 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:14.875801    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:04:21.899567 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:21.899531    2546 scope.go:117] "RemoveContainer" containerID="2cd6a8a531d80d9d923f37842e940f105cf32dbdda9e291ee493240b390066e9"
Jul 17 08:04:22.910421 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:22.910337    2546 generic.go:356] "Generic (PLEG): container finished" podID="956eff73-d1df-48ca-b920-ff88a57712e7" containerID="dd4818810c14a0fa25a5423df873832168fed0543fccfbdfb84f53f1ce4f7985" exitCode=6
Jul 17 08:04:22.910852 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:22.910412    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s" event={"ID":"956eff73-d1df-48ca-b920-ff88a57712e7","Type":"ContainerDied","Data":"dd4818810c14a0fa25a5423df873832168fed0543fccfbdfb84f53f1ce4f7985"}
Jul 17 08:04:22.910852 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:22.910480    2546 scope.go:117] "RemoveContainer" containerID="2cd6a8a531d80d9d923f37842e940f105cf32dbdda9e291ee493240b390066e9"
Jul 17 08:04:22.910961 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:22.910850    2546 scope.go:117] "RemoveContainer" containerID="dd4818810c14a0fa25a5423df873832168fed0543fccfbdfb84f53f1ce4f7985"
Jul 17 08:04:22.911114 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:04:22.911091    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s_odh-ai-gateway-infra(956eff73-d1df-48ca-b920-ff88a57712e7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s" podUID="956eff73-d1df-48ca-b920-ff88a57712e7"
Jul 17 08:04:23.937560 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:23.937519    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"]
Jul 17 08:04:24.078129 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:24.078104    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"
Jul 17 08:04:24.203030 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:24.202956    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/956eff73-d1df-48ca-b920-ff88a57712e7-maas-api-service-ca\") pod \"956eff73-d1df-48ca-b920-ff88a57712e7\" (UID: \"956eff73-d1df-48ca-b920-ff88a57712e7\") "
Jul 17 08:04:24.203334 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:24.203312    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/956eff73-d1df-48ca-b920-ff88a57712e7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "956eff73-d1df-48ca-b920-ff88a57712e7" (UID: "956eff73-d1df-48ca-b920-ff88a57712e7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 08:04:24.304512 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:24.304471    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/956eff73-d1df-48ca-b920-ff88a57712e7-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:04:24.899172 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:24.899137    2546 scope.go:117] "RemoveContainer" containerID="fba09a44b5bb36c0b9d5c70a818432a73dde8584e4c71b305c3792fe236765a0"
Jul 17 08:04:24.925404 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:24.925380    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"
Jul 17 08:04:24.925568 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:24.925411    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s" event={"ID":"956eff73-d1df-48ca-b920-ff88a57712e7","Type":"ContainerDied","Data":"079c821fc7c5537ddc12758a4480d8d607c9fdaba8ca6bcef1854ce8ac26e45d"}
Jul 17 08:04:24.925568 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:24.925470    2546 scope.go:117] "RemoveContainer" containerID="dd4818810c14a0fa25a5423df873832168fed0543fccfbdfb84f53f1ce4f7985"
Jul 17 08:04:24.953015 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:24.952988    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"]
Jul 17 08:04:24.962541 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:24.962516    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-pzx5s"]
Jul 17 08:04:25.905326 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:25.905291    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="956eff73-d1df-48ca-b920-ff88a57712e7" path="/var/lib/kubelet/pods/956eff73-d1df-48ca-b920-ff88a57712e7/volumes"
Jul 17 08:04:25.933692 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:25.933641    2546 generic.go:356] "Generic (PLEG): container finished" podID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerID="c50bf4846f032af87b1935cffc07446a8417084353c970807f0b6a1c433a0e72" exitCode=6
Jul 17 08:04:25.933865 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:25.933713    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj" event={"ID":"92791a94-7bf0-4d1e-b52f-a806515d5297","Type":"ContainerDied","Data":"c50bf4846f032af87b1935cffc07446a8417084353c970807f0b6a1c433a0e72"}
Jul 17 08:04:25.933865 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:25.933771    2546 scope.go:117] "RemoveContainer" containerID="fba09a44b5bb36c0b9d5c70a818432a73dde8584e4c71b305c3792fe236765a0"
Jul 17 08:04:25.934295 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:25.934276    2546 scope.go:117] "RemoveContainer" containerID="c50bf4846f032af87b1935cffc07446a8417084353c970807f0b6a1c433a0e72"
Jul 17 08:04:25.934544 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:04:25.934521    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj_odh-ai-gateway-infra(92791a94-7bf0-4d1e-b52f-a806515d5297)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297"
Jul 17 08:04:26.964523 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:26.964488    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"]
Jul 17 08:04:27.099564 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:27.099542    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"
Jul 17 08:04:27.235132 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:27.235037    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92791a94-7bf0-4d1e-b52f-a806515d5297-maas-api-service-ca\") pod \"92791a94-7bf0-4d1e-b52f-a806515d5297\" (UID: \"92791a94-7bf0-4d1e-b52f-a806515d5297\") "
Jul 17 08:04:27.235428 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:27.235403    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92791a94-7bf0-4d1e-b52f-a806515d5297-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92791a94-7bf0-4d1e-b52f-a806515d5297" (UID: "92791a94-7bf0-4d1e-b52f-a806515d5297"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 08:04:27.336095 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:27.336052    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92791a94-7bf0-4d1e-b52f-a806515d5297-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:04:27.946338 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:27.946304    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj" event={"ID":"92791a94-7bf0-4d1e-b52f-a806515d5297","Type":"ContainerDied","Data":"9f671d1fe50dd12cb72ad71dc03b9c15939976390d5662d243b58c2d21359968"}
Jul 17 08:04:27.946338 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:27.946326    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"
Jul 17 08:04:27.946570 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:27.946372    2546 scope.go:117] "RemoveContainer" containerID="c50bf4846f032af87b1935cffc07446a8417084353c970807f0b6a1c433a0e72"
Jul 17 08:04:27.964835 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:27.964811    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"]
Jul 17 08:04:27.968854 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:27.968832    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-dlpzj"]
Jul 17 08:04:29.905120 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:29.905091    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297" path="/var/lib/kubelet/pods/92791a94-7bf0-4d1e-b52f-a806515d5297/volumes"
Jul 17 08:04:52.168890 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:52.168803    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"]
Jul 17 08:04:59.665906 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.665869    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"]
Jul 17 08:04:59.666369 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666252    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956eff73-d1df-48ca-b920-ff88a57712e7" containerName="revoke-keys"
Jul 17 08:04:59.666369 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666263    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="956eff73-d1df-48ca-b920-ff88a57712e7" containerName="revoke-keys"
Jul 17 08:04:59.666369 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666282    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956eff73-d1df-48ca-b920-ff88a57712e7" containerName="revoke-keys"
Jul 17 08:04:59.666369 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666287    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="956eff73-d1df-48ca-b920-ff88a57712e7" containerName="revoke-keys"
Jul 17 08:04:59.666369 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666296    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerName="revoke-keys"
Jul 17 08:04:59.666369 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666303    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerName="revoke-keys"
Jul 17 08:04:59.666369 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666311    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerName="revoke-keys"
Jul 17 08:04:59.666369 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666316    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerName="revoke-keys"
Jul 17 08:04:59.666369 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666323    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerName="revoke-keys"
Jul 17 08:04:59.666369 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666328    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerName="revoke-keys"
Jul 17 08:04:59.666735 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666382    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="956eff73-d1df-48ca-b920-ff88a57712e7" containerName="revoke-keys"
Jul 17 08:04:59.666735 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666389    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerName="revoke-keys"
Jul 17 08:04:59.666735 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666397    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerName="revoke-keys"
Jul 17 08:04:59.666735 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666403    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="956eff73-d1df-48ca-b920-ff88a57712e7" containerName="revoke-keys"
Jul 17 08:04:59.666735 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666409    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerName="revoke-keys"
Jul 17 08:04:59.666735 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.666415    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="a147573c-12f9-4c09-999d-10c4d4e30dd9" containerName="revoke-keys"
Jul 17 08:04:59.669546 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.669528    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"
Jul 17 08:04:59.672083 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.672057    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 08:04:59.672213 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.672129    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 08:04:59.676088 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.676051    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"]
Jul 17 08:04:59.851422 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.851382    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d88da4-b5f1-4ac8-8694-d6ba45ad8460-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx\" (UID: \"b4d88da4-b5f1-4ac8-8694-d6ba45ad8460\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"
Jul 17 08:04:59.952576 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.952484    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d88da4-b5f1-4ac8-8694-d6ba45ad8460-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx\" (UID: \"b4d88da4-b5f1-4ac8-8694-d6ba45ad8460\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"
Jul 17 08:04:59.953143 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.953124    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d88da4-b5f1-4ac8-8694-d6ba45ad8460-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx\" (UID: \"b4d88da4-b5f1-4ac8-8694-d6ba45ad8460\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"
Jul 17 08:04:59.981477 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:04:59.981445    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"
Jul 17 08:05:00.113235 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:00.113207    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"]
Jul 17 08:05:00.115350 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:05:00.115315    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d88da4_b5f1_4ac8_8694_d6ba45ad8460.slice/crio-0de4de2a0e8bdb2bdfd97ef719783d37c1fb87f5b4ad7c536cb12db6a2f53751 WatchSource:0}: Error finding container 0de4de2a0e8bdb2bdfd97ef719783d37c1fb87f5b4ad7c536cb12db6a2f53751: Status 404 returned error can't find the container with id 0de4de2a0e8bdb2bdfd97ef719783d37c1fb87f5b4ad7c536cb12db6a2f53751
Jul 17 08:05:01.122953 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:01.122861    2546 generic.go:356] "Generic (PLEG): container finished" podID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerID="6f92ff51c6f89e4031b783911075c90894e20c840a269af35f3f188df608b496" exitCode=6
Jul 17 08:05:01.123357 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:01.122946    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx" event={"ID":"b4d88da4-b5f1-4ac8-8694-d6ba45ad8460","Type":"ContainerDied","Data":"6f92ff51c6f89e4031b783911075c90894e20c840a269af35f3f188df608b496"}
Jul 17 08:05:01.123357 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:01.123009    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx" event={"ID":"b4d88da4-b5f1-4ac8-8694-d6ba45ad8460","Type":"ContainerStarted","Data":"0de4de2a0e8bdb2bdfd97ef719783d37c1fb87f5b4ad7c536cb12db6a2f53751"}
Jul 17 08:05:01.123357 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:01.123137    2546 scope.go:117] "RemoveContainer" containerID="6f92ff51c6f89e4031b783911075c90894e20c840a269af35f3f188df608b496"
Jul 17 08:05:02.129979 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:02.129938    2546 generic.go:356] "Generic (PLEG): container finished" podID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerID="d1a703f28efb38e594245cdf2676478af407741b5568d63f94c6e048dc6f6124" exitCode=6
Jul 17 08:05:02.130469 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:02.130030    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx" event={"ID":"b4d88da4-b5f1-4ac8-8694-d6ba45ad8460","Type":"ContainerDied","Data":"d1a703f28efb38e594245cdf2676478af407741b5568d63f94c6e048dc6f6124"}
Jul 17 08:05:02.130469 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:02.130107    2546 scope.go:117] "RemoveContainer" containerID="6f92ff51c6f89e4031b783911075c90894e20c840a269af35f3f188df608b496"
Jul 17 08:05:02.130469 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:02.130278    2546 scope.go:117] "RemoveContainer" containerID="d1a703f28efb38e594245cdf2676478af407741b5568d63f94c6e048dc6f6124"
Jul 17 08:05:02.130643 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:05:02.130530    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx_odh-ai-gateway-infra(b4d88da4-b5f1-4ac8-8694-d6ba45ad8460)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460"
Jul 17 08:05:03.136447 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:03.136420    2546 scope.go:117] "RemoveContainer" containerID="d1a703f28efb38e594245cdf2676478af407741b5568d63f94c6e048dc6f6124"
Jul 17 08:05:03.136858 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:05:03.136654    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx_odh-ai-gateway-infra(b4d88da4-b5f1-4ac8-8694-d6ba45ad8460)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460"
Jul 17 08:05:04.299968 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.299933    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"]
Jul 17 08:05:04.300391 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.300323    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerName="revoke-keys"
Jul 17 08:05:04.300391 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.300334    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="92791a94-7bf0-4d1e-b52f-a806515d5297" containerName="revoke-keys"
Jul 17 08:05:04.300391 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.300361    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956eff73-d1df-48ca-b920-ff88a57712e7" containerName="revoke-keys"
Jul 17 08:05:04.300391 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.300366    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="956eff73-d1df-48ca-b920-ff88a57712e7" containerName="revoke-keys"
Jul 17 08:05:04.300548 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.300432    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="956eff73-d1df-48ca-b920-ff88a57712e7" containerName="revoke-keys"
Jul 17 08:05:04.304714 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.304696    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"
Jul 17 08:05:04.310662 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.310633    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"]
Jul 17 08:05:04.397082 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.397047    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d663f6ce-4747-493f-9613-cb7b36eaa9ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x\" (UID: \"d663f6ce-4747-493f-9613-cb7b36eaa9ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"
Jul 17 08:05:04.498578 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.498538    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d663f6ce-4747-493f-9613-cb7b36eaa9ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x\" (UID: \"d663f6ce-4747-493f-9613-cb7b36eaa9ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"
Jul 17 08:05:04.499234 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.499213    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d663f6ce-4747-493f-9613-cb7b36eaa9ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x\" (UID: \"d663f6ce-4747-493f-9613-cb7b36eaa9ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"
Jul 17 08:05:04.616683 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.616580    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"
Jul 17 08:05:04.961899 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:04.961873    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"]
Jul 17 08:05:04.963900 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:05:04.963873    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd663f6ce_4747_493f_9613_cb7b36eaa9ac.slice/crio-f67b1f80a9cf278f717a6d80dda38869d7b5229858549660e6de3b451dad383b WatchSource:0}: Error finding container f67b1f80a9cf278f717a6d80dda38869d7b5229858549660e6de3b451dad383b: Status 404 returned error can't find the container with id f67b1f80a9cf278f717a6d80dda38869d7b5229858549660e6de3b451dad383b
Jul 17 08:05:05.149164 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:05.149132    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x" event={"ID":"d663f6ce-4747-493f-9613-cb7b36eaa9ac","Type":"ContainerStarted","Data":"f67b1f80a9cf278f717a6d80dda38869d7b5229858549660e6de3b451dad383b"}
Jul 17 08:05:06.156577 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:06.156481    2546 generic.go:356] "Generic (PLEG): container finished" podID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerID="e9a6f6c0393fab5723869a45648ba101e7dd8c1d85dca5050a353fc4d05449f3" exitCode=6
Jul 17 08:05:06.157048 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:06.156571    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x" event={"ID":"d663f6ce-4747-493f-9613-cb7b36eaa9ac","Type":"ContainerDied","Data":"e9a6f6c0393fab5723869a45648ba101e7dd8c1d85dca5050a353fc4d05449f3"}
Jul 17 08:05:06.157048 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:06.156847    2546 scope.go:117] "RemoveContainer" containerID="e9a6f6c0393fab5723869a45648ba101e7dd8c1d85dca5050a353fc4d05449f3"
Jul 17 08:05:07.164215 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.164125    2546 generic.go:356] "Generic (PLEG): container finished" podID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerID="17fa254a10ce72493e60b4dddfcd47ed849f8e5fb2d0d1baa315ba07019a397f" exitCode=6
Jul 17 08:05:07.164215 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.164167    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x" event={"ID":"d663f6ce-4747-493f-9613-cb7b36eaa9ac","Type":"ContainerDied","Data":"17fa254a10ce72493e60b4dddfcd47ed849f8e5fb2d0d1baa315ba07019a397f"}
Jul 17 08:05:07.164215 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.164215    2546 scope.go:117] "RemoveContainer" containerID="e9a6f6c0393fab5723869a45648ba101e7dd8c1d85dca5050a353fc4d05449f3"
Jul 17 08:05:07.164805 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.164421    2546 scope.go:117] "RemoveContainer" containerID="17fa254a10ce72493e60b4dddfcd47ed849f8e5fb2d0d1baa315ba07019a397f"
Jul 17 08:05:07.164805 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:05:07.164654    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x_odh-ai-gateway-infra(d663f6ce-4747-493f-9613-cb7b36eaa9ac)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac"
Jul 17 08:05:07.189376 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.189342    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf" podUID="57eaadf6-6ca1-4a96-aa21-78015191ebca" containerName="main" containerID="cri-o://270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3" gracePeriod=45
Jul 17 08:05:07.450075 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.450047    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:05:07.528842 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.528808    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-model-cache\") pod \"57eaadf6-6ca1-4a96-aa21-78015191ebca\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") "
Jul 17 08:05:07.528842 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.528851    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-home\") pod \"57eaadf6-6ca1-4a96-aa21-78015191ebca\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") "
Jul 17 08:05:07.529084 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.528872    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-dshm\") pod \"57eaadf6-6ca1-4a96-aa21-78015191ebca\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") "
Jul 17 08:05:07.529084 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.528901    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w45k8\" (UniqueName: \"kubernetes.io/projected/57eaadf6-6ca1-4a96-aa21-78015191ebca-kube-api-access-w45k8\") pod \"57eaadf6-6ca1-4a96-aa21-78015191ebca\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") "
Jul 17 08:05:07.529084 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.528947    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57eaadf6-6ca1-4a96-aa21-78015191ebca-tls-certs\") pod \"57eaadf6-6ca1-4a96-aa21-78015191ebca\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") "
Jul 17 08:05:07.529084 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.529008    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-tmp-dir\") pod \"57eaadf6-6ca1-4a96-aa21-78015191ebca\" (UID: \"57eaadf6-6ca1-4a96-aa21-78015191ebca\") "
Jul 17 08:05:07.530589 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.529356    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-model-cache" (OuterVolumeSpecName: "model-cache") pod "57eaadf6-6ca1-4a96-aa21-78015191ebca" (UID: "57eaadf6-6ca1-4a96-aa21-78015191ebca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:05:07.530589 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.529618    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-home" (OuterVolumeSpecName: "home") pod "57eaadf6-6ca1-4a96-aa21-78015191ebca" (UID: "57eaadf6-6ca1-4a96-aa21-78015191ebca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:05:07.530589 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.529726    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57eaadf6-6ca1-4a96-aa21-78015191ebca" (UID: "57eaadf6-6ca1-4a96-aa21-78015191ebca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:05:07.530589 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.530211    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-home\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:05:07.530589 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.530233    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-tmp-dir\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:05:07.530589 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.530248    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-model-cache\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:05:07.537382 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.537348    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57eaadf6-6ca1-4a96-aa21-78015191ebca-kube-api-access-w45k8" (OuterVolumeSpecName: "kube-api-access-w45k8") pod "57eaadf6-6ca1-4a96-aa21-78015191ebca" (UID: "57eaadf6-6ca1-4a96-aa21-78015191ebca"). InnerVolumeSpecName "kube-api-access-w45k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 08:05:07.537382 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.537370    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-dshm" (OuterVolumeSpecName: "dshm") pod "57eaadf6-6ca1-4a96-aa21-78015191ebca" (UID: "57eaadf6-6ca1-4a96-aa21-78015191ebca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:05:07.537806 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.537781    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57eaadf6-6ca1-4a96-aa21-78015191ebca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57eaadf6-6ca1-4a96-aa21-78015191ebca" (UID: "57eaadf6-6ca1-4a96-aa21-78015191ebca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 08:05:07.631024 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.630973    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57eaadf6-6ca1-4a96-aa21-78015191ebca-dshm\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:05:07.631024 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.631018    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w45k8\" (UniqueName: \"kubernetes.io/projected/57eaadf6-6ca1-4a96-aa21-78015191ebca-kube-api-access-w45k8\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:05:07.631024 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:07.631030    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57eaadf6-6ca1-4a96-aa21-78015191ebca-tls-certs\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:05:08.171284 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:08.171200    2546 generic.go:356] "Generic (PLEG): container finished" podID="57eaadf6-6ca1-4a96-aa21-78015191ebca" containerID="270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3" exitCode=0
Jul 17 08:05:08.171284 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:08.171256    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"
Jul 17 08:05:08.171852 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:08.171281    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf" event={"ID":"57eaadf6-6ca1-4a96-aa21-78015191ebca","Type":"ContainerDied","Data":"270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3"}
Jul 17 08:05:08.171852 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:08.171328    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf" event={"ID":"57eaadf6-6ca1-4a96-aa21-78015191ebca","Type":"ContainerDied","Data":"980841fe209ec3e1cb6182e393c2a52124ee2c40c2f0e2ffe9b1a14af8bb420d"}
Jul 17 08:05:08.171852 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:08.171358    2546 scope.go:117] "RemoveContainer" containerID="270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3"
Jul 17 08:05:08.173804 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:08.173784    2546 scope.go:117] "RemoveContainer" containerID="17fa254a10ce72493e60b4dddfcd47ed849f8e5fb2d0d1baa315ba07019a397f"
Jul 17 08:05:08.174069 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:05:08.174047    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x_odh-ai-gateway-infra(d663f6ce-4747-493f-9613-cb7b36eaa9ac)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac"
Jul 17 08:05:08.180420 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:08.180405    2546 scope.go:117] "RemoveContainer" containerID="270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3"
Jul 17 08:05:08.180649 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:05:08.180633    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3\": container with ID starting with 270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3 not found: ID does not exist" containerID="270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3"
Jul 17 08:05:08.180748 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:08.180656    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3"} err="failed to get container status \"270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3\": rpc error: code = NotFound desc = could not find container \"270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3\": container with ID starting with 270eeee52ad46c06c44787da2c2db76aa2a7a2ce1c8cc841ea9ccc9cc9cc28c3 not found: ID does not exist"
Jul 17 08:05:08.202782 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:08.202760    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"]
Jul 17 08:05:08.209261 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:08.209238    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/sub-test-model-04d1db-kserve-948fbc469-t9pmf"]
Jul 17 08:05:09.339112 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.339077    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"]
Jul 17 08:05:09.339647 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.339628    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57eaadf6-6ca1-4a96-aa21-78015191ebca" containerName="main"
Jul 17 08:05:09.339746 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.339649    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="57eaadf6-6ca1-4a96-aa21-78015191ebca" containerName="main"
Jul 17 08:05:09.339810 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.339756    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="57eaadf6-6ca1-4a96-aa21-78015191ebca" containerName="main"
Jul 17 08:05:09.344119 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.344100    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.347677 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.347641    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d805bd\"/\"rate-test-model-d805bd-kserve-self-signed-certs\""
Jul 17 08:05:09.347788 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.347643    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d805bd\"/\"openshift-service-ca.crt\""
Jul 17 08:05:09.347788 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.347724    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d805bd\"/\"default-dockercfg-fzqfz\""
Jul 17 08:05:09.347788 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.347751    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d805bd\"/\"kube-root-ca.crt\""
Jul 17 08:05:09.351082 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.351059    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"]
Jul 17 08:05:09.449635 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.449598    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-dshm\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.449635 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.449638    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-home\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.449898 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.449693    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dffjk\" (UniqueName: \"kubernetes.io/projected/276d5ec0-3f29-4cdb-8468-1b86977d9bca-kube-api-access-dffjk\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.449898 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.449737    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tmp-dir\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.449898 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.449761    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tls-certs\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.450036 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.449926    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-model-cache\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.550659 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.550616    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-model-cache\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.550659 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.550659    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-dshm\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.550920 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.550706    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-home\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.550920 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.550725    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dffjk\" (UniqueName: \"kubernetes.io/projected/276d5ec0-3f29-4cdb-8468-1b86977d9bca-kube-api-access-dffjk\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.550920 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.550755    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tmp-dir\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.550920 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.550777    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tls-certs\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.551143 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.551116    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tmp-dir\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.551203 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.551130    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-model-cache\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.551253 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.551207    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-home\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.553065 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.553042    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-dshm\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.553230 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.553211    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tls-certs\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.559812 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.559789    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dffjk\" (UniqueName: \"kubernetes.io/projected/276d5ec0-3f29-4cdb-8468-1b86977d9bca-kube-api-access-dffjk\") pod \"rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") " pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.654802 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.654699    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:09.791999 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.791972    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"]
Jul 17 08:05:09.794747 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:05:09.794717    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod276d5ec0_3f29_4cdb_8468_1b86977d9bca.slice/crio-2dfb902a9027613ec16dd9eb96c50331dcab39f965a3028c6b001edd741b41f8 WatchSource:0}: Error finding container 2dfb902a9027613ec16dd9eb96c50331dcab39f965a3028c6b001edd741b41f8: Status 404 returned error can't find the container with id 2dfb902a9027613ec16dd9eb96c50331dcab39f965a3028c6b001edd741b41f8
Jul 17 08:05:09.905443 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:09.905363    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57eaadf6-6ca1-4a96-aa21-78015191ebca" path="/var/lib/kubelet/pods/57eaadf6-6ca1-4a96-aa21-78015191ebca/volumes"
Jul 17 08:05:10.187413 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:10.187308    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc" event={"ID":"276d5ec0-3f29-4cdb-8468-1b86977d9bca","Type":"ContainerStarted","Data":"84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7"}
Jul 17 08:05:10.187413 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:10.187368    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc" event={"ID":"276d5ec0-3f29-4cdb-8468-1b86977d9bca","Type":"ContainerStarted","Data":"2dfb902a9027613ec16dd9eb96c50331dcab39f965a3028c6b001edd741b41f8"}
Jul 17 08:05:10.211495 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:10.211440    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc" podStartSLOduration=1.211421705 podStartE2EDuration="1.211421705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 08:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 08:05:10.208952468 +0000 UTC m=+3173.015149658" watchObservedRunningTime="2026-07-17 08:05:10.211421705 +0000 UTC m=+3173.017618880"
Jul 17 08:05:14.898605 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:14.898567    2546 scope.go:117] "RemoveContainer" containerID="d1a703f28efb38e594245cdf2676478af407741b5568d63f94c6e048dc6f6124"
Jul 17 08:05:15.215099 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:15.215068    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx" event={"ID":"b4d88da4-b5f1-4ac8-8694-d6ba45ad8460","Type":"ContainerStarted","Data":"b315d9b343d7861010ca6ac18ac04b72fe3bf4c42231ae33a2a770ffdfba1fef"}
Jul 17 08:05:15.234468 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:15.234422    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx" podStartSLOduration=16.234407951 podStartE2EDuration="16.234407951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 08:04:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 08:05:15.232712975 +0000 UTC m=+3178.038910149" watchObservedRunningTime="2026-07-17 08:05:15.234407951 +0000 UTC m=+3178.040605126"
Jul 17 08:05:16.221505 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:16.221466    2546 generic.go:356] "Generic (PLEG): container finished" podID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerID="b315d9b343d7861010ca6ac18ac04b72fe3bf4c42231ae33a2a770ffdfba1fef" exitCode=6
Jul 17 08:05:16.221890 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:16.221540    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx" event={"ID":"b4d88da4-b5f1-4ac8-8694-d6ba45ad8460","Type":"ContainerDied","Data":"b315d9b343d7861010ca6ac18ac04b72fe3bf4c42231ae33a2a770ffdfba1fef"}
Jul 17 08:05:16.221890 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:16.221626    2546 scope.go:117] "RemoveContainer" containerID="d1a703f28efb38e594245cdf2676478af407741b5568d63f94c6e048dc6f6124"
Jul 17 08:05:16.221890 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:16.221875    2546 scope.go:117] "RemoveContainer" containerID="b315d9b343d7861010ca6ac18ac04b72fe3bf4c42231ae33a2a770ffdfba1fef"
Jul 17 08:05:16.222114 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:05:16.222095    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx_odh-ai-gateway-infra(b4d88da4-b5f1-4ac8-8694-d6ba45ad8460)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460"
Jul 17 08:05:16.261513 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:16.261488    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"]
Jul 17 08:05:17.367716 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:17.367689    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"
Jul 17 08:05:17.431308 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:17.431269    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d88da4-b5f1-4ac8-8694-d6ba45ad8460-maas-api-service-ca\") pod \"b4d88da4-b5f1-4ac8-8694-d6ba45ad8460\" (UID: \"b4d88da4-b5f1-4ac8-8694-d6ba45ad8460\") "
Jul 17 08:05:17.431635 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:17.431613    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d88da4-b5f1-4ac8-8694-d6ba45ad8460-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" (UID: "b4d88da4-b5f1-4ac8-8694-d6ba45ad8460"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 08:05:17.532258 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:17.532224    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d88da4-b5f1-4ac8-8694-d6ba45ad8460-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:05:18.234380 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:18.234280    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx" event={"ID":"b4d88da4-b5f1-4ac8-8694-d6ba45ad8460","Type":"ContainerDied","Data":"0de4de2a0e8bdb2bdfd97ef719783d37c1fb87f5b4ad7c536cb12db6a2f53751"}
Jul 17 08:05:18.234380 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:18.234343    2546 scope.go:117] "RemoveContainer" containerID="b315d9b343d7861010ca6ac18ac04b72fe3bf4c42231ae33a2a770ffdfba1fef"
Jul 17 08:05:18.234380 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:18.234299    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"
Jul 17 08:05:18.253252 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:18.253196    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"]
Jul 17 08:05:18.258179 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:18.258158    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-jwfkx"]
Jul 17 08:05:18.898838 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:18.898802    2546 scope.go:117] "RemoveContainer" containerID="17fa254a10ce72493e60b4dddfcd47ed849f8e5fb2d0d1baa315ba07019a397f"
Jul 17 08:05:19.242051 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:19.241959    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x" event={"ID":"d663f6ce-4747-493f-9613-cb7b36eaa9ac","Type":"ContainerStarted","Data":"9b2237daa1415fef855068b5f58505343530c1af92739c6c9e3d61d1d5c4d57d"}
Jul 17 08:05:19.263444 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:19.263394    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x" podStartSLOduration=15.26338082 podStartE2EDuration="15.26338082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 08:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 08:05:19.262143581 +0000 UTC m=+3182.068340759" watchObservedRunningTime="2026-07-17 08:05:19.26338082 +0000 UTC m=+3182.069577994"
Jul 17 08:05:19.655708 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:19.655646    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:19.655894 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:19.655723    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:19.669098 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:19.669073    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:19.905946 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:19.905863    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" path="/var/lib/kubelet/pods/b4d88da4-b5f1-4ac8-8694-d6ba45ad8460/volumes"
Jul 17 08:05:20.253545 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:20.253445    2546 generic.go:356] "Generic (PLEG): container finished" podID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerID="9b2237daa1415fef855068b5f58505343530c1af92739c6c9e3d61d1d5c4d57d" exitCode=6
Jul 17 08:05:20.253545 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:20.253526    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x" event={"ID":"d663f6ce-4747-493f-9613-cb7b36eaa9ac","Type":"ContainerDied","Data":"9b2237daa1415fef855068b5f58505343530c1af92739c6c9e3d61d1d5c4d57d"}
Jul 17 08:05:20.253797 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:20.253609    2546 scope.go:117] "RemoveContainer" containerID="17fa254a10ce72493e60b4dddfcd47ed849f8e5fb2d0d1baa315ba07019a397f"
Jul 17 08:05:20.254085 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:20.254066    2546 scope.go:117] "RemoveContainer" containerID="9b2237daa1415fef855068b5f58505343530c1af92739c6c9e3d61d1d5c4d57d"
Jul 17 08:05:20.254327 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:05:20.254298    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x_odh-ai-gateway-infra(d663f6ce-4747-493f-9613-cb7b36eaa9ac)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac"
Jul 17 08:05:20.266224 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:20.266207    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:05:20.279159 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:20.279132    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"]
Jul 17 08:05:21.385736 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:21.385711    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"
Jul 17 08:05:21.472344 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:21.472309    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d663f6ce-4747-493f-9613-cb7b36eaa9ac-maas-api-service-ca\") pod \"d663f6ce-4747-493f-9613-cb7b36eaa9ac\" (UID: \"d663f6ce-4747-493f-9613-cb7b36eaa9ac\") "
Jul 17 08:05:21.472661 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:21.472640    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d663f6ce-4747-493f-9613-cb7b36eaa9ac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d663f6ce-4747-493f-9613-cb7b36eaa9ac" (UID: "d663f6ce-4747-493f-9613-cb7b36eaa9ac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 08:05:21.574023 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:21.573991    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d663f6ce-4747-493f-9613-cb7b36eaa9ac-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:05:22.266115 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:22.266032    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"
Jul 17 08:05:22.266115 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:22.266080    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x" event={"ID":"d663f6ce-4747-493f-9613-cb7b36eaa9ac","Type":"ContainerDied","Data":"f67b1f80a9cf278f717a6d80dda38869d7b5229858549660e6de3b451dad383b"}
Jul 17 08:05:22.266350 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:22.266143    2546 scope.go:117] "RemoveContainer" containerID="9b2237daa1415fef855068b5f58505343530c1af92739c6c9e3d61d1d5c4d57d"
Jul 17 08:05:22.284589 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:22.284558    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"]
Jul 17 08:05:22.288613 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:22.288591    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f44a26e0-gz47x"]
Jul 17 08:05:23.904682 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:23.904639    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" path="/var/lib/kubelet/pods/d663f6ce-4747-493f-9613-cb7b36eaa9ac/volumes"
Jul 17 08:05:32.331360 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.331307    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"]
Jul 17 08:05:32.331973 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.331961    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerName="revoke-keys"
Jul 17 08:05:32.332054 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.331979    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerName="revoke-keys"
Jul 17 08:05:32.332054 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.331997    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerName="revoke-keys"
Jul 17 08:05:32.332054 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.332005    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerName="revoke-keys"
Jul 17 08:05:32.332054 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.332023    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerName="revoke-keys"
Jul 17 08:05:32.332054 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.332033    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerName="revoke-keys"
Jul 17 08:05:32.332319 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.332066    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerName="revoke-keys"
Jul 17 08:05:32.332319 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.332075    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerName="revoke-keys"
Jul 17 08:05:32.332319 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.332163    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerName="revoke-keys"
Jul 17 08:05:32.332319 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.332180    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerName="revoke-keys"
Jul 17 08:05:32.332319 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.332191    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerName="revoke-keys"
Jul 17 08:05:32.332319 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.332203    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerName="revoke-keys"
Jul 17 08:05:32.332319 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.332210    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerName="revoke-keys"
Jul 17 08:05:32.335805 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.335782    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.338680 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.338647    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"openshift-service-ca.crt\""
Jul 17 08:05:32.339605 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.339583    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"rate-test-model-04d1db-kserve-self-signed-certs\""
Jul 17 08:05:32.339734 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.339630    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"kube-root-ca.crt\""
Jul 17 08:05:32.339734 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.339660    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-04d1db\"/\"default-dockercfg-bh8jg\""
Jul 17 08:05:32.345805 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.345782    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"]
Jul 17 08:05:32.483716 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.483649    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8gk4\" (UniqueName: \"kubernetes.io/projected/5eb2e5c2-02e8-4228-bbcf-22042a09593b-kube-api-access-v8gk4\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.483904 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.483781    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tmp-dir\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.483904 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.483820    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-dshm\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.483904 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.483848    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tls-certs\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.483904 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.483888    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-model-cache\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.484047 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.483950    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-home\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.584500 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.584405    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-home\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.584500 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.584465    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8gk4\" (UniqueName: \"kubernetes.io/projected/5eb2e5c2-02e8-4228-bbcf-22042a09593b-kube-api-access-v8gk4\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.584500 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.584503    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tmp-dir\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.584858 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.584523    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-dshm\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.584858 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.584547    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tls-certs\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.584858 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.584564    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-model-cache\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.585002 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.584922    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-home\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.585002 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.584953    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tmp-dir\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.585115 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.585052    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-model-cache\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.586941 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.586911    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-dshm\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.587125 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.587105    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tls-certs\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.593051 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.593030    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8gk4\" (UniqueName: \"kubernetes.io/projected/5eb2e5c2-02e8-4228-bbcf-22042a09593b-kube-api-access-v8gk4\") pod \"rate-test-model-04d1db-kserve-7b588499-l5q5b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") " pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.649334 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.649307    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:32.781348 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:32.781321    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"]
Jul 17 08:05:32.783766 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:05:32.783731    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5eb2e5c2_02e8_4228_bbcf_22042a09593b.slice/crio-7253102d8bc867291a5714ff5737b9718c6430e84f96dc98be8615e4bbbfd48c WatchSource:0}: Error finding container 7253102d8bc867291a5714ff5737b9718c6430e84f96dc98be8615e4bbbfd48c: Status 404 returned error can't find the container with id 7253102d8bc867291a5714ff5737b9718c6430e84f96dc98be8615e4bbbfd48c
Jul 17 08:05:33.324678 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:33.324639    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b" event={"ID":"5eb2e5c2-02e8-4228-bbcf-22042a09593b","Type":"ContainerStarted","Data":"462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71"}
Jul 17 08:05:33.324895 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:33.324702    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b" event={"ID":"5eb2e5c2-02e8-4228-bbcf-22042a09593b","Type":"ContainerStarted","Data":"7253102d8bc867291a5714ff5737b9718c6430e84f96dc98be8615e4bbbfd48c"}
Jul 17 08:05:33.346033 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:33.345980    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b" podStartSLOduration=1.345963964 podStartE2EDuration="1.345963964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 08:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 08:05:33.344022787 +0000 UTC m=+3196.150219962" watchObservedRunningTime="2026-07-17 08:05:33.345963964 +0000 UTC m=+3196.152161138"
Jul 17 08:05:42.650454 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:42.650418    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:42.650976 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:42.650469    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:42.663003 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:42.662976    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:05:43.390722 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:05:43.390693    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:06:16.350589 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:16.350505    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"]
Jul 17 08:06:17.210257 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:17.210222    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"]
Jul 17 08:06:31.370445 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.370400    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc" podUID="276d5ec0-3f29-4cdb-8468-1b86977d9bca" containerName="main" containerID="cri-o://84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7" gracePeriod=45
Jul 17 08:06:31.625426 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.625364    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:06:31.628128 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.628107    2546 generic.go:356] "Generic (PLEG): container finished" podID="276d5ec0-3f29-4cdb-8468-1b86977d9bca" containerID="84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7" exitCode=0
Jul 17 08:06:31.628234 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.628136    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"
Jul 17 08:06:31.628234 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.628186    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc" event={"ID":"276d5ec0-3f29-4cdb-8468-1b86977d9bca","Type":"ContainerDied","Data":"84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7"}
Jul 17 08:06:31.628316 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.628235    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc" event={"ID":"276d5ec0-3f29-4cdb-8468-1b86977d9bca","Type":"ContainerDied","Data":"2dfb902a9027613ec16dd9eb96c50331dcab39f965a3028c6b001edd741b41f8"}
Jul 17 08:06:31.628316 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.628255    2546 scope.go:117] "RemoveContainer" containerID="84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7"
Jul 17 08:06:31.636356 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.636340    2546 scope.go:117] "RemoveContainer" containerID="84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7"
Jul 17 08:06:31.636596 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:06:31.636579    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7\": container with ID starting with 84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7 not found: ID does not exist" containerID="84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7"
Jul 17 08:06:31.636661 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.636605    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7"} err="failed to get container status \"84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7\": rpc error: code = NotFound desc = could not find container \"84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7\": container with ID starting with 84aef78aeecabeeb090aea213fd1c9d794b7a17356ed16d72cd7b8f23c371ca7 not found: ID does not exist"
Jul 17 08:06:31.786979 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.786945    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-model-cache\") pod \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") "
Jul 17 08:06:31.787197 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.787020    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tls-certs\") pod \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") "
Jul 17 08:06:31.787197 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.787067    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-home\") pod \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") "
Jul 17 08:06:31.787197 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.787093    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-dshm\") pod \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") "
Jul 17 08:06:31.787395 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.787228    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tmp-dir\") pod \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") "
Jul 17 08:06:31.787395 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.787245    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-model-cache" (OuterVolumeSpecName: "model-cache") pod "276d5ec0-3f29-4cdb-8468-1b86977d9bca" (UID: "276d5ec0-3f29-4cdb-8468-1b86977d9bca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:06:31.787395 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.787318    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-home" (OuterVolumeSpecName: "home") pod "276d5ec0-3f29-4cdb-8468-1b86977d9bca" (UID: "276d5ec0-3f29-4cdb-8468-1b86977d9bca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:06:31.787395 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.787327    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dffjk\" (UniqueName: \"kubernetes.io/projected/276d5ec0-3f29-4cdb-8468-1b86977d9bca-kube-api-access-dffjk\") pod \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\" (UID: \"276d5ec0-3f29-4cdb-8468-1b86977d9bca\") "
Jul 17 08:06:31.787611 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.787504    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "276d5ec0-3f29-4cdb-8468-1b86977d9bca" (UID: "276d5ec0-3f29-4cdb-8468-1b86977d9bca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:06:31.787796 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.787776    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-home\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:31.787869 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.787801    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tmp-dir\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:31.787869 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.787815    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-model-cache\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:31.789191 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.789169    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-dshm" (OuterVolumeSpecName: "dshm") pod "276d5ec0-3f29-4cdb-8468-1b86977d9bca" (UID: "276d5ec0-3f29-4cdb-8468-1b86977d9bca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:06:31.789310 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.789258    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/276d5ec0-3f29-4cdb-8468-1b86977d9bca-kube-api-access-dffjk" (OuterVolumeSpecName: "kube-api-access-dffjk") pod "276d5ec0-3f29-4cdb-8468-1b86977d9bca" (UID: "276d5ec0-3f29-4cdb-8468-1b86977d9bca"). InnerVolumeSpecName "kube-api-access-dffjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 08:06:31.789310 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.789289    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "276d5ec0-3f29-4cdb-8468-1b86977d9bca" (UID: "276d5ec0-3f29-4cdb-8468-1b86977d9bca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 08:06:31.888760 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.888659    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dffjk\" (UniqueName: \"kubernetes.io/projected/276d5ec0-3f29-4cdb-8468-1b86977d9bca-kube-api-access-dffjk\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:31.888760 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.888708    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/276d5ec0-3f29-4cdb-8468-1b86977d9bca-tls-certs\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:31.888760 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.888718    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/276d5ec0-3f29-4cdb-8468-1b86977d9bca-dshm\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:31.943650 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.943616    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"]
Jul 17 08:06:31.947931 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:31.947906    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d805bd/rate-test-model-d805bd-kserve-65f8d8cc59-gbtjc"]
Jul 17 08:06:32.230518 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.230423    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b" podUID="5eb2e5c2-02e8-4228-bbcf-22042a09593b" containerName="main" containerID="cri-o://462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71" gracePeriod=45
Jul 17 08:06:32.487396 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.487327    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:06:32.595017 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.594982    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-model-cache\") pod \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") "
Jul 17 08:06:32.595163 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.595060    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8gk4\" (UniqueName: \"kubernetes.io/projected/5eb2e5c2-02e8-4228-bbcf-22042a09593b-kube-api-access-v8gk4\") pod \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") "
Jul 17 08:06:32.595163 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.595133    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tmp-dir\") pod \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") "
Jul 17 08:06:32.595272 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.595200    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-home\") pod \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") "
Jul 17 08:06:32.595272 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.595260    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-dshm\") pod \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") "
Jul 17 08:06:32.595376 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.595299    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tls-certs\") pod \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\" (UID: \"5eb2e5c2-02e8-4228-bbcf-22042a09593b\") "
Jul 17 08:06:32.595376 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.595208    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-model-cache" (OuterVolumeSpecName: "model-cache") pod "5eb2e5c2-02e8-4228-bbcf-22042a09593b" (UID: "5eb2e5c2-02e8-4228-bbcf-22042a09593b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:06:32.595376 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.595319    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5eb2e5c2-02e8-4228-bbcf-22042a09593b" (UID: "5eb2e5c2-02e8-4228-bbcf-22042a09593b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:06:32.595376 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.595325    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-home" (OuterVolumeSpecName: "home") pod "5eb2e5c2-02e8-4228-bbcf-22042a09593b" (UID: "5eb2e5c2-02e8-4228-bbcf-22042a09593b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:06:32.595627 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.595610    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tmp-dir\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:32.595717 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.595629    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-home\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:32.595717 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.595637    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-model-cache\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:32.597231 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.597207    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-dshm" (OuterVolumeSpecName: "dshm") pod "5eb2e5c2-02e8-4228-bbcf-22042a09593b" (UID: "5eb2e5c2-02e8-4228-bbcf-22042a09593b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 08:06:32.597340 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.597243    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb2e5c2-02e8-4228-bbcf-22042a09593b-kube-api-access-v8gk4" (OuterVolumeSpecName: "kube-api-access-v8gk4") pod "5eb2e5c2-02e8-4228-bbcf-22042a09593b" (UID: "5eb2e5c2-02e8-4228-bbcf-22042a09593b"). InnerVolumeSpecName "kube-api-access-v8gk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 08:06:32.597340 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.597315    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5eb2e5c2-02e8-4228-bbcf-22042a09593b" (UID: "5eb2e5c2-02e8-4228-bbcf-22042a09593b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 08:06:32.635304 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.635275    2546 generic.go:356] "Generic (PLEG): container finished" podID="5eb2e5c2-02e8-4228-bbcf-22042a09593b" containerID="462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71" exitCode=0
Jul 17 08:06:32.635430 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.635315    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"
Jul 17 08:06:32.635430 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.635357    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b" event={"ID":"5eb2e5c2-02e8-4228-bbcf-22042a09593b","Type":"ContainerDied","Data":"462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71"}
Jul 17 08:06:32.635430 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.635408    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b" event={"ID":"5eb2e5c2-02e8-4228-bbcf-22042a09593b","Type":"ContainerDied","Data":"7253102d8bc867291a5714ff5737b9718c6430e84f96dc98be8615e4bbbfd48c"}
Jul 17 08:06:32.635430 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.635426    2546 scope.go:117] "RemoveContainer" containerID="462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71"
Jul 17 08:06:32.644398 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.644383    2546 scope.go:117] "RemoveContainer" containerID="462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71"
Jul 17 08:06:32.644646 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:06:32.644628    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71\": container with ID starting with 462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71 not found: ID does not exist" containerID="462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71"
Jul 17 08:06:32.644736 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.644655    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71"} err="failed to get container status \"462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71\": rpc error: code = NotFound desc = could not find container \"462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71\": container with ID starting with 462c0b756ec9510992df824514928fa899773dc30c2d531867a7ee148389bc71 not found: ID does not exist"
Jul 17 08:06:32.659838 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.659812    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"]
Jul 17 08:06:32.663736 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.663714    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-04d1db/rate-test-model-04d1db-kserve-7b588499-l5q5b"]
Jul 17 08:06:32.696842 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.696813    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eb2e5c2-02e8-4228-bbcf-22042a09593b-dshm\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:32.696842 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.696837    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eb2e5c2-02e8-4228-bbcf-22042a09593b-tls-certs\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:32.696842 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:32.696848    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8gk4\" (UniqueName: \"kubernetes.io/projected/5eb2e5c2-02e8-4228-bbcf-22042a09593b-kube-api-access-v8gk4\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:33.904448 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:33.904415    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="276d5ec0-3f29-4cdb-8468-1b86977d9bca" path="/var/lib/kubelet/pods/276d5ec0-3f29-4cdb-8468-1b86977d9bca/volumes"
Jul 17 08:06:33.904904 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:33.904888    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb2e5c2-02e8-4228-bbcf-22042a09593b" path="/var/lib/kubelet/pods/5eb2e5c2-02e8-4228-bbcf-22042a09593b/volumes"
Jul 17 08:06:36.542818 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.542787    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8"]
Jul 17 08:06:36.543188 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.543162    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerName="revoke-keys"
Jul 17 08:06:36.543188 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.543173    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d663f6ce-4747-493f-9613-cb7b36eaa9ac" containerName="revoke-keys"
Jul 17 08:06:36.543274 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.543190    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerName="revoke-keys"
Jul 17 08:06:36.543274 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.543197    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerName="revoke-keys"
Jul 17 08:06:36.543274 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.543204    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="276d5ec0-3f29-4cdb-8468-1b86977d9bca" containerName="main"
Jul 17 08:06:36.543274 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.543210    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="276d5ec0-3f29-4cdb-8468-1b86977d9bca" containerName="main"
Jul 17 08:06:36.543274 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.543217    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb2e5c2-02e8-4228-bbcf-22042a09593b" containerName="main"
Jul 17 08:06:36.543274 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.543222    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb2e5c2-02e8-4228-bbcf-22042a09593b" containerName="main"
Jul 17 08:06:36.543475 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.543285    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="276d5ec0-3f29-4cdb-8468-1b86977d9bca" containerName="main"
Jul 17 08:06:36.543475 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.543298    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4d88da4-b5f1-4ac8-8694-d6ba45ad8460" containerName="revoke-keys"
Jul 17 08:06:36.543475 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.543304    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb2e5c2-02e8-4228-bbcf-22042a09593b" containerName="main"
Jul 17 08:06:36.548108 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.548090    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8"
Jul 17 08:06:36.551241 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.551216    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 08:06:36.551597 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.551489    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c65vn\""
Jul 17 08:06:36.552999 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.552976    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8"]
Jul 17 08:06:36.637643 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.637608    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a624cf-ebe3-44c9-a70f-0210b9bae101-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8\" (UID: \"33a624cf-ebe3-44c9-a70f-0210b9bae101\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8"
Jul 17 08:06:36.738771 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.738734    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a624cf-ebe3-44c9-a70f-0210b9bae101-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8\" (UID: \"33a624cf-ebe3-44c9-a70f-0210b9bae101\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8"
Jul 17 08:06:36.739337 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.739318    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a624cf-ebe3-44c9-a70f-0210b9bae101-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8\" (UID: \"33a624cf-ebe3-44c9-a70f-0210b9bae101\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8"
Jul 17 08:06:36.860127 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.860042    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8"
Jul 17 08:06:36.991966 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:36.991940    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8"]
Jul 17 08:06:36.994423 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:06:36.994396    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a624cf_ebe3_44c9_a70f_0210b9bae101.slice/crio-480c059c57ad9e0e5455a90801e760e5cc8fec50b0f095877030b60a8c935d19 WatchSource:0}: Error finding container 480c059c57ad9e0e5455a90801e760e5cc8fec50b0f095877030b60a8c935d19: Status 404 returned error can't find the container with id 480c059c57ad9e0e5455a90801e760e5cc8fec50b0f095877030b60a8c935d19
Jul 17 08:06:37.670630 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:37.670597    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8" event={"ID":"33a624cf-ebe3-44c9-a70f-0210b9bae101","Type":"ContainerStarted","Data":"aa8c41b34c81cfb27da1937bd02617535682df1f323aaa6475d27f596c2853df"}
Jul 17 08:06:37.670973 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:37.670703    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8" event={"ID":"33a624cf-ebe3-44c9-a70f-0210b9bae101","Type":"ContainerStarted","Data":"480c059c57ad9e0e5455a90801e760e5cc8fec50b0f095877030b60a8c935d19"}
Jul 17 08:06:37.688149 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:37.688105    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8" podStartSLOduration=1.6880902500000001 podStartE2EDuration="1.68809025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 08:06:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 08:06:37.686263597 +0000 UTC m=+3260.492460774" watchObservedRunningTime="2026-07-17 08:06:37.68809025 +0000 UTC m=+3260.494287424"
Jul 17 08:06:38.677100 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:38.677067    2546 generic.go:356] "Generic (PLEG): container finished" podID="33a624cf-ebe3-44c9-a70f-0210b9bae101" containerID="aa8c41b34c81cfb27da1937bd02617535682df1f323aaa6475d27f596c2853df" exitCode=0
Jul 17 08:06:38.677487 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:38.677146    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8" event={"ID":"33a624cf-ebe3-44c9-a70f-0210b9bae101","Type":"ContainerDied","Data":"aa8c41b34c81cfb27da1937bd02617535682df1f323aaa6475d27f596c2853df"}
Jul 17 08:06:39.756146 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:39.756114    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"]
Jul 17 08:06:39.759595 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:39.759574    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"
Jul 17 08:06:39.768925 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:39.768886    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"]
Jul 17 08:06:39.815201 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:39.815179    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8"
Jul 17 08:06:39.870264 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:39.870220    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e450e195-bcb6-4e75-ab93-361cda299b8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4\" (UID: \"e450e195-bcb6-4e75-ab93-361cda299b8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"
Jul 17 08:06:39.971789 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:39.971693    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a624cf-ebe3-44c9-a70f-0210b9bae101-maas-api-service-ca\") pod \"33a624cf-ebe3-44c9-a70f-0210b9bae101\" (UID: \"33a624cf-ebe3-44c9-a70f-0210b9bae101\") "
Jul 17 08:06:39.971974 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:39.971932    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e450e195-bcb6-4e75-ab93-361cda299b8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4\" (UID: \"e450e195-bcb6-4e75-ab93-361cda299b8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"
Jul 17 08:06:39.972140 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:39.972113    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33a624cf-ebe3-44c9-a70f-0210b9bae101-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "33a624cf-ebe3-44c9-a70f-0210b9bae101" (UID: "33a624cf-ebe3-44c9-a70f-0210b9bae101"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 08:06:39.972545 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:39.972524    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e450e195-bcb6-4e75-ab93-361cda299b8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4\" (UID: \"e450e195-bcb6-4e75-ab93-361cda299b8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"
Jul 17 08:06:40.072324 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:40.072286    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"
Jul 17 08:06:40.072654 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:40.072635    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a624cf-ebe3-44c9-a70f-0210b9bae101-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:40.204200 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:40.204176    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"]
Jul 17 08:06:40.205827 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:06:40.205797    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode450e195_bcb6_4e75_ab93_361cda299b8b.slice/crio-7123732868e8ec4c5fdf27b5e7c268922cc1dabcf83d67ee6aa8b6c43bd0ae06 WatchSource:0}: Error finding container 7123732868e8ec4c5fdf27b5e7c268922cc1dabcf83d67ee6aa8b6c43bd0ae06: Status 404 returned error can't find the container with id 7123732868e8ec4c5fdf27b5e7c268922cc1dabcf83d67ee6aa8b6c43bd0ae06
Jul 17 08:06:40.689294 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:40.689261    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4" event={"ID":"e450e195-bcb6-4e75-ab93-361cda299b8b","Type":"ContainerStarted","Data":"287efff80898a9877b59b02066d7f7f815cad88223ef4b195e0ebb821f1c9363"}
Jul 17 08:06:40.689497 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:40.689318    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4" event={"ID":"e450e195-bcb6-4e75-ab93-361cda299b8b","Type":"ContainerStarted","Data":"7123732868e8ec4c5fdf27b5e7c268922cc1dabcf83d67ee6aa8b6c43bd0ae06"}
Jul 17 08:06:40.690512 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:40.690489    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8" event={"ID":"33a624cf-ebe3-44c9-a70f-0210b9bae101","Type":"ContainerDied","Data":"480c059c57ad9e0e5455a90801e760e5cc8fec50b0f095877030b60a8c935d19"}
Jul 17 08:06:40.690622 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:40.690526    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="480c059c57ad9e0e5455a90801e760e5cc8fec50b0f095877030b60a8c935d19"
Jul 17 08:06:40.690622 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:40.690522    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8"
Jul 17 08:06:40.710631 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:40.710573    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4" podStartSLOduration=1.710556738 podStartE2EDuration="1.710556738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 08:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 08:06:40.708527876 +0000 UTC m=+3263.514725054" watchObservedRunningTime="2026-07-17 08:06:40.710556738 +0000 UTC m=+3263.516753912"
Jul 17 08:06:41.696831 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:41.696797    2546 generic.go:356] "Generic (PLEG): container finished" podID="e450e195-bcb6-4e75-ab93-361cda299b8b" containerID="287efff80898a9877b59b02066d7f7f815cad88223ef4b195e0ebb821f1c9363" exitCode=6
Jul 17 08:06:41.697222 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:41.696884    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4" event={"ID":"e450e195-bcb6-4e75-ab93-361cda299b8b","Type":"ContainerDied","Data":"287efff80898a9877b59b02066d7f7f815cad88223ef4b195e0ebb821f1c9363"}
Jul 17 08:06:41.697222 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:41.697074    2546 scope.go:117] "RemoveContainer" containerID="287efff80898a9877b59b02066d7f7f815cad88223ef4b195e0ebb821f1c9363"
Jul 17 08:06:42.703764 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:42.703649    2546 generic.go:356] "Generic (PLEG): container finished" podID="e450e195-bcb6-4e75-ab93-361cda299b8b" containerID="b0c76e2064d08c201299f5321c81ee0b9daaaaa5cfa732ecf98470bd8ee92de6" exitCode=6
Jul 17 08:06:42.703764 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:42.703737    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4" event={"ID":"e450e195-bcb6-4e75-ab93-361cda299b8b","Type":"ContainerDied","Data":"b0c76e2064d08c201299f5321c81ee0b9daaaaa5cfa732ecf98470bd8ee92de6"}
Jul 17 08:06:42.704196 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:42.703796    2546 scope.go:117] "RemoveContainer" containerID="287efff80898a9877b59b02066d7f7f815cad88223ef4b195e0ebb821f1c9363"
Jul 17 08:06:42.704196 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:42.704012    2546 scope.go:117] "RemoveContainer" containerID="b0c76e2064d08c201299f5321c81ee0b9daaaaa5cfa732ecf98470bd8ee92de6"
Jul 17 08:06:42.704279 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:06:42.704240    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4_odh-ai-gateway-infra(e450e195-bcb6-4e75-ab93-361cda299b8b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4" podUID="e450e195-bcb6-4e75-ab93-361cda299b8b"
Jul 17 08:06:43.710457 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:43.710427    2546 scope.go:117] "RemoveContainer" containerID="b0c76e2064d08c201299f5321c81ee0b9daaaaa5cfa732ecf98470bd8ee92de6"
Jul 17 08:06:43.710874 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:06:43.710609    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4_odh-ai-gateway-infra(e450e195-bcb6-4e75-ab93-361cda299b8b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4" podUID="e450e195-bcb6-4e75-ab93-361cda299b8b"
Jul 17 08:06:56.899374 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:56.899334    2546 scope.go:117] "RemoveContainer" containerID="b0c76e2064d08c201299f5321c81ee0b9daaaaa5cfa732ecf98470bd8ee92de6"
Jul 17 08:06:57.788202 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:57.788170    2546 generic.go:356] "Generic (PLEG): container finished" podID="e450e195-bcb6-4e75-ab93-361cda299b8b" containerID="b64760bb3d3fd29bc4a92439c3e290cbb439a50a55a27f9b109a62162070ecd7" exitCode=6
Jul 17 08:06:57.788348 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:57.788239    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4" event={"ID":"e450e195-bcb6-4e75-ab93-361cda299b8b","Type":"ContainerDied","Data":"b64760bb3d3fd29bc4a92439c3e290cbb439a50a55a27f9b109a62162070ecd7"}
Jul 17 08:06:57.788348 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:57.788300    2546 scope.go:117] "RemoveContainer" containerID="b0c76e2064d08c201299f5321c81ee0b9daaaaa5cfa732ecf98470bd8ee92de6"
Jul 17 08:06:57.788565 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:57.788551    2546 scope.go:117] "RemoveContainer" containerID="b64760bb3d3fd29bc4a92439c3e290cbb439a50a55a27f9b109a62162070ecd7"
Jul 17 08:06:57.788807 ip-10-0-135-5 kubenswrapper[2546]: E0717 08:06:57.788789    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4_odh-ai-gateway-infra(e450e195-bcb6-4e75-ab93-361cda299b8b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4" podUID="e450e195-bcb6-4e75-ab93-361cda299b8b"
Jul 17 08:06:58.815556 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:58.815522    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"]
Jul 17 08:06:58.953245 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:58.953218    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"
Jul 17 08:06:59.058784 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:59.058750    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e450e195-bcb6-4e75-ab93-361cda299b8b-maas-api-service-ca\") pod \"e450e195-bcb6-4e75-ab93-361cda299b8b\" (UID: \"e450e195-bcb6-4e75-ab93-361cda299b8b\") "
Jul 17 08:06:59.059200 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:59.059172    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e450e195-bcb6-4e75-ab93-361cda299b8b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e450e195-bcb6-4e75-ab93-361cda299b8b" (UID: "e450e195-bcb6-4e75-ab93-361cda299b8b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 08:06:59.159831 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:59.159746    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e450e195-bcb6-4e75-ab93-361cda299b8b-maas-api-service-ca\") on node \"ip-10-0-135-5.ec2.internal\" DevicePath \"\""
Jul 17 08:06:59.800580 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:59.800552    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"
Jul 17 08:06:59.800580 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:59.800563    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4" event={"ID":"e450e195-bcb6-4e75-ab93-361cda299b8b","Type":"ContainerDied","Data":"7123732868e8ec4c5fdf27b5e7c268922cc1dabcf83d67ee6aa8b6c43bd0ae06"}
Jul 17 08:06:59.800867 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:59.800618    2546 scope.go:117] "RemoveContainer" containerID="b64760bb3d3fd29bc4a92439c3e290cbb439a50a55a27f9b109a62162070ecd7"
Jul 17 08:06:59.826030 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:59.825998    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"]
Jul 17 08:06:59.830841 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:59.830817    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2dfadf83-b7rl4"]
Jul 17 08:06:59.904825 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:06:59.904791    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e450e195-bcb6-4e75-ab93-361cda299b8b" path="/var/lib/kubelet/pods/e450e195-bcb6-4e75-ab93-361cda299b8b/volumes"
Jul 17 08:07:29.433868 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:29.433831    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cbc987ffb-mh7m7_061e93d7-6d96-4ec2-b941-3353df9ba2ef/authorino/0.log"
Jul 17 08:07:36.462882 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:36.462847    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg_d643e70c-240b-43eb-a90c-199b9e28c21e/copy-manifests/0.log"
Jul 17 08:07:36.470713 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:36.470689    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg_d643e70c-240b-43eb-a90c-199b9e28c21e/manager/0.log"
Jul 17 08:07:36.995660 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:36.995630    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737890-r2gr7_f0bf8c5c-8f9c-413f-a73f-c6d6a50610ed/cleanup/0.log"
Jul 17 08:07:37.238861 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:37.238832    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737920-b8fkx_f257f5a7-193a-4da0-86a9-ad103cd4f35f/cleanup/0.log"
Jul 17 08:07:37.969566 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:37.969539    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-e8d5b32b-mrcr5_f418af02-cf9b-4f3a-87ee-8fb98fdbd97e/revoke-keys/0.log"
Jul 17 08:07:38.095506 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:38.095467    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-f88ba1e3-9v5mj_08103ee3-a530-41a2-ab0e-3cd8559de326/revoke-keys/0.log"
Jul 17 08:07:38.217208 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:38.217169    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-d805bd-hbdv8_33a624cf-ebe3-44c9-a70f-0210b9bae101/revoke-keys/0.log"
Jul 17 08:07:39.923548 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:39.923472    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cbc987ffb-mh7m7_061e93d7-6d96-4ec2-b941-3353df9ba2ef/authorino/0.log"
Jul 17 08:07:40.588451 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:40.588407    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-x6k72_563d17bd-833a-4f3b-b75a-dc8bb3b073f0/manager/0.log"
Jul 17 08:07:41.490194 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:41.490162    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f788c4b68-nlnlq_e5fb2e41-af67-4efa-ac7e-3b902ca8335d/kube-auth-proxy/0.log"
Jul 17 08:07:42.021590 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:42.021558    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-d6nbw_df5ef7e8-5135-463d-b389-cb50ab2056fd/payload-processing/0.log"
Jul 17 08:07:42.926456 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:42.926425    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqsjxd_26797b83-d784-43cc-98e2-3b6ff6a6c98d/main/0.log"
Jul 17 08:07:43.184071 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:43.183980    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-46tmh_828cb4f7-cb62-4fd2-99b4-bee41ec6112b/main/0.log"
Jul 17 08:07:52.497928 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:52.497888    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l8rd7_018f064b-c9c3-4cf2-82a5-c2f01c3e0b3e/global-pull-secret-syncer/0.log"
Jul 17 08:07:52.590359 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:52.590323    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bdfrt_6974ffb8-419f-47f6-a360-8fc41ea1ec30/konnectivity-agent/0.log"
Jul 17 08:07:52.655473 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:52.655442    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-5.ec2.internal_23184d284d24f037f7828701abf81791/haproxy/0.log"
Jul 17 08:07:58.080522 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:58.080484    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cbc987ffb-mh7m7_061e93d7-6d96-4ec2-b941-3353df9ba2ef/authorino/0.log"
Jul 17 08:07:58.354590 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:07:58.354551    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-x6k72_563d17bd-833a-4f3b-b75a-dc8bb3b073f0/manager/0.log"
Jul 17 08:08:00.104370 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.104335    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c55b7f7e-ce36-4b50-b810-337e07d9ae15/alertmanager/0.log"
Jul 17 08:08:00.134240 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.134163    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c55b7f7e-ce36-4b50-b810-337e07d9ae15/config-reloader/0.log"
Jul 17 08:08:00.158833 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.158808    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c55b7f7e-ce36-4b50-b810-337e07d9ae15/kube-rbac-proxy-web/0.log"
Jul 17 08:08:00.188572 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.188542    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c55b7f7e-ce36-4b50-b810-337e07d9ae15/kube-rbac-proxy/0.log"
Jul 17 08:08:00.211564 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.211536    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c55b7f7e-ce36-4b50-b810-337e07d9ae15/kube-rbac-proxy-metric/0.log"
Jul 17 08:08:00.238758 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.238728    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c55b7f7e-ce36-4b50-b810-337e07d9ae15/prom-label-proxy/0.log"
Jul 17 08:08:00.264776 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.264736    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c55b7f7e-ce36-4b50-b810-337e07d9ae15/init-config-reloader/0.log"
Jul 17 08:08:00.467651 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.467560    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-qvmm2_64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5/kube-state-metrics/0.log"
Jul 17 08:08:00.491517 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.491491    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-qvmm2_64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5/kube-rbac-proxy-main/0.log"
Jul 17 08:08:00.521018 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.520986    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-qvmm2_64f530dc-cdc1-4a3f-88e9-b1e95cc26fc5/kube-rbac-proxy-self/0.log"
Jul 17 08:08:00.553745 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.553716    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-989794db7-f7gmz_a60d4f78-8935-4705-99ee-90b932b2aeee/metrics-server/0.log"
Jul 17 08:08:00.600610 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.600583    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-49cx2_959a3983-e44f-4163-bc64-9ea8ea64b696/monitoring-plugin/0.log"
Jul 17 08:08:00.723403 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.723322    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9hj7_a1502a15-f7bc-4ca7-a188-77f5e5874acc/node-exporter/0.log"
Jul 17 08:08:00.748326 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.748302    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9hj7_a1502a15-f7bc-4ca7-a188-77f5e5874acc/kube-rbac-proxy/0.log"
Jul 17 08:08:00.770941 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.770918    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9hj7_a1502a15-f7bc-4ca7-a188-77f5e5874acc/init-textfile/0.log"
Jul 17 08:08:00.890413 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.890378    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-jt6w7_11b501f2-5df3-4d59-9ab5-d1b213678d9c/kube-rbac-proxy-main/0.log"
Jul 17 08:08:00.927244 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.927216    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-jt6w7_11b501f2-5df3-4d59-9ab5-d1b213678d9c/kube-rbac-proxy-self/0.log"
Jul 17 08:08:00.952238 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.952198    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-jt6w7_11b501f2-5df3-4d59-9ab5-d1b213678d9c/openshift-state-metrics/0.log"
Jul 17 08:08:00.998090 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:00.997997    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6d125c1c-99dc-451a-9577-aabd12aaf11f/prometheus/0.log"
Jul 17 08:08:01.023511 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.023482    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6d125c1c-99dc-451a-9577-aabd12aaf11f/config-reloader/0.log"
Jul 17 08:08:01.050435 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.050407    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6d125c1c-99dc-451a-9577-aabd12aaf11f/thanos-sidecar/0.log"
Jul 17 08:08:01.074692 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.074649    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6d125c1c-99dc-451a-9577-aabd12aaf11f/kube-rbac-proxy-web/0.log"
Jul 17 08:08:01.104131 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.104108    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6d125c1c-99dc-451a-9577-aabd12aaf11f/kube-rbac-proxy/0.log"
Jul 17 08:08:01.128360 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.128334    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6d125c1c-99dc-451a-9577-aabd12aaf11f/kube-rbac-proxy-thanos/0.log"
Jul 17 08:08:01.153208 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.153181    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6d125c1c-99dc-451a-9577-aabd12aaf11f/init-config-reloader/0.log"
Jul 17 08:08:01.209123 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.209088    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-49qx6_5ba0208a-ce1c-4390-b578-14813da0f6e0/prometheus-operator/0.log"
Jul 17 08:08:01.230818 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.230797    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-49qx6_5ba0208a-ce1c-4390-b578-14813da0f6e0/kube-rbac-proxy/0.log"
Jul 17 08:08:01.293803 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.293779    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5757d965dd-cxh7m_4930b7ac-1314-4d80-880d-b490ad6c907e/telemeter-client/0.log"
Jul 17 08:08:01.333976 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.333955    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5757d965dd-cxh7m_4930b7ac-1314-4d80-880d-b490ad6c907e/reload/0.log"
Jul 17 08:08:01.370393 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.370363    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5757d965dd-cxh7m_4930b7ac-1314-4d80-880d-b490ad6c907e/kube-rbac-proxy/0.log"
Jul 17 08:08:01.428986 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.428958    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-849864688f-g7zn9_13213d21-c20c-45eb-916f-53505037c9a1/thanos-query/0.log"
Jul 17 08:08:01.458704 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.458637    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-849864688f-g7zn9_13213d21-c20c-45eb-916f-53505037c9a1/kube-rbac-proxy-web/0.log"
Jul 17 08:08:01.486372 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.486340    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-849864688f-g7zn9_13213d21-c20c-45eb-916f-53505037c9a1/kube-rbac-proxy/0.log"
Jul 17 08:08:01.515916 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.515891    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-849864688f-g7zn9_13213d21-c20c-45eb-916f-53505037c9a1/prom-label-proxy/0.log"
Jul 17 08:08:01.539818 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.539785    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-849864688f-g7zn9_13213d21-c20c-45eb-916f-53505037c9a1/kube-rbac-proxy-rules/0.log"
Jul 17 08:08:01.564041 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:01.563963    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-849864688f-g7zn9_13213d21-c20c-45eb-916f-53505037c9a1/kube-rbac-proxy-metrics/0.log"
Jul 17 08:08:02.175781 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.175748    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"]
Jul 17 08:08:02.176157 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.176120    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e450e195-bcb6-4e75-ab93-361cda299b8b" containerName="revoke-keys"
Jul 17 08:08:02.176157 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.176131    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e450e195-bcb6-4e75-ab93-361cda299b8b" containerName="revoke-keys"
Jul 17 08:08:02.176157 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.176146    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e450e195-bcb6-4e75-ab93-361cda299b8b" containerName="revoke-keys"
Jul 17 08:08:02.176157 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.176152    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e450e195-bcb6-4e75-ab93-361cda299b8b" containerName="revoke-keys"
Jul 17 08:08:02.176292 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.176165    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a624cf-ebe3-44c9-a70f-0210b9bae101" containerName="revoke-keys"
Jul 17 08:08:02.176292 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.176170    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a624cf-ebe3-44c9-a70f-0210b9bae101" containerName="revoke-keys"
Jul 17 08:08:02.176292 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.176231    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e450e195-bcb6-4e75-ab93-361cda299b8b" containerName="revoke-keys"
Jul 17 08:08:02.176292 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.176238    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e450e195-bcb6-4e75-ab93-361cda299b8b" containerName="revoke-keys"
Jul 17 08:08:02.176292 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.176246    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e450e195-bcb6-4e75-ab93-361cda299b8b" containerName="revoke-keys"
Jul 17 08:08:02.176292 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.176253    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="33a624cf-ebe3-44c9-a70f-0210b9bae101" containerName="revoke-keys"
Jul 17 08:08:02.179550 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.179530    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.182442 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.182421    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p7q6q\"/\"default-dockercfg-9bq8c\""
Jul 17 08:08:02.182974 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.182956    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p7q6q\"/\"kube-root-ca.crt\""
Jul 17 08:08:02.183076 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.183000    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p7q6q\"/\"openshift-service-ca.crt\""
Jul 17 08:08:02.192297 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.192274    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"]
Jul 17 08:08:02.260457 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.260419    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsc62\" (UniqueName: \"kubernetes.io/projected/12d8442b-9dc4-4ff9-9497-67bf7838fffa-kube-api-access-lsc62\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.260457 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.260458    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-podres\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.260694 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.260529    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-lib-modules\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.260694 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.260580    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-proc\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.260694 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.260638    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-sys\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.361534 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.361499    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-lib-modules\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.361744 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.361548    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-proc\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.361744 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.361607    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-sys\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.361744 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.361644    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsc62\" (UniqueName: \"kubernetes.io/projected/12d8442b-9dc4-4ff9-9497-67bf7838fffa-kube-api-access-lsc62\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.361744 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.361675    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-lib-modules\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.361744 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.361687    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-podres\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.361744 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.361718    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-sys\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.361744 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.361719    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-proc\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.362026 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.361774    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12d8442b-9dc4-4ff9-9497-67bf7838fffa-podres\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.370887 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.370865    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsc62\" (UniqueName: \"kubernetes.io/projected/12d8442b-9dc4-4ff9-9497-67bf7838fffa-kube-api-access-lsc62\") pod \"perf-node-gather-daemonset-plqtq\" (UID: \"12d8442b-9dc4-4ff9-9497-67bf7838fffa\") " pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.490059 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.489959    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:02.621874 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:02.621849    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"]
Jul 17 08:08:02.624109 ip-10-0-135-5 kubenswrapper[2546]: W0717 08:08:02.624078    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod12d8442b_9dc4_4ff9_9497_67bf7838fffa.slice/crio-628fe6917619cb205ac6fa26634888e6a140140feddc83c8c3f1c2c105e97088 WatchSource:0}: Error finding container 628fe6917619cb205ac6fa26634888e6a140140feddc83c8c3f1c2c105e97088: Status 404 returned error can't find the container with id 628fe6917619cb205ac6fa26634888e6a140140feddc83c8c3f1c2c105e97088
Jul 17 08:08:03.122392 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:03.122299    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq" event={"ID":"12d8442b-9dc4-4ff9-9497-67bf7838fffa","Type":"ContainerStarted","Data":"de8d23512970319013ae81707c0c3f019c38e4d7e8aa9d6cb22ae8f83ff2fdf5"}
Jul 17 08:08:03.122392 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:03.122354    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq" event={"ID":"12d8442b-9dc4-4ff9-9497-67bf7838fffa","Type":"ContainerStarted","Data":"628fe6917619cb205ac6fa26634888e6a140140feddc83c8c3f1c2c105e97088"}
Jul 17 08:08:03.122601 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:03.122394    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:03.140739 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:03.140691    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq" podStartSLOduration=1.140650825 podStartE2EDuration="1.140650825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 08:08:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 08:08:03.13982833 +0000 UTC m=+3345.946025506" watchObservedRunningTime="2026-07-17 08:08:03.140650825 +0000 UTC m=+3345.946847998"
Jul 17 08:08:03.879475 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:03.879441    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69bc96598-dpjrt_48a61b08-ab4a-40df-aacc-2352dcde00c4/console/0.log"
Jul 17 08:08:05.561793 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:05.561760    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c2p6j_34f4bb5b-d587-46a9-9296-d548428394a7/dns/0.log"
Jul 17 08:08:05.587616 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:05.587584    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c2p6j_34f4bb5b-d587-46a9-9296-d548428394a7/kube-rbac-proxy/0.log"
Jul 17 08:08:05.748241 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:05.748212    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rtjsd_ab8d6a91-d06b-4095-a531-a470e2f000da/dns-node-resolver/0.log"
Jul 17 08:08:06.414594 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:06.414565    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gt85w_2a32ad24-a73d-4805-a379-990aa9a4de37/node-ca/0.log"
Jul 17 08:08:07.549579 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:07.549554    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f788c4b68-nlnlq_e5fb2e41-af67-4efa-ac7e-3b902ca8335d/kube-auth-proxy/0.log"
Jul 17 08:08:07.716303 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:07.716272    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-d6nbw_df5ef7e8-5135-463d-b389-cb50ab2056fd/payload-processing/0.log"
Jul 17 08:08:08.526970 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:08.526937    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qbzsx_f7ca342e-6272-492c-bb62-7e3b0879a07a/serve-healthcheck-canary/0.log"
Jul 17 08:08:09.045540 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:09.045501    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-66xpt_f2525926-7a6e-4463-b5a9-30dd75d433f5/kube-rbac-proxy/0.log"
Jul 17 08:08:09.070354 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:09.070314    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-66xpt_f2525926-7a6e-4463-b5a9-30dd75d433f5/exporter/0.log"
Jul 17 08:08:09.095815 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:09.095785    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-66xpt_f2525926-7a6e-4463-b5a9-30dd75d433f5/extractor/0.log"
Jul 17 08:08:09.137040 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:09.137015    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p7q6q/perf-node-gather-daemonset-plqtq"
Jul 17 08:08:12.111207 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:12.111171    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg_d643e70c-240b-43eb-a90c-199b9e28c21e/manager/0.log"
Jul 17 08:08:12.137934 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:12.137910    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59ffcf4dc8-gt6sg_d643e70c-240b-43eb-a90c-199b9e28c21e/copy-manifests/0.log"
Jul 17 08:08:12.433380 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:12.433351    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f788c4b68-nlnlq_e5fb2e41-af67-4efa-ac7e-3b902ca8335d/kube-auth-proxy/0.log"
Jul 17 08:08:12.575618 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:12.575579    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-d6nbw_df5ef7e8-5135-463d-b389-cb50ab2056fd/payload-processing/0.log"
Jul 17 08:08:13.612746 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:13.612712    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6fc85c6965-tvm89_3325ee55-24c5-4173-82ae-eb1a6d5bf00d/manager/0.log"
Jul 17 08:08:13.644376 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:13.644338    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ckdcc_b4af7d89-db67-4177-b42b-b135e2a5a892/openshift-lws-operator/0.log"
Jul 17 08:08:14.040080 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:14.040048    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f788c4b68-nlnlq_e5fb2e41-af67-4efa-ac7e-3b902ca8335d/kube-auth-proxy/0.log"
Jul 17 08:08:14.174974 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:14.174941    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-d6nbw_df5ef7e8-5135-463d-b389-cb50ab2056fd/payload-processing/0.log"
Jul 17 08:08:20.212290 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:20.212255    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8q2hw_236f358b-1f12-4557-a344-79b8198771a6/kube-multus/0.log"
Jul 17 08:08:20.239276 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:20.239251    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t2w2w_685350e6-1b5d-472b-b075-9593e40ae8b5/kube-multus-additional-cni-plugins/0.log"
Jul 17 08:08:20.266461 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:20.266438    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t2w2w_685350e6-1b5d-472b-b075-9593e40ae8b5/egress-router-binary-copy/0.log"
Jul 17 08:08:20.288016 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:20.287990    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t2w2w_685350e6-1b5d-472b-b075-9593e40ae8b5/cni-plugins/0.log"
Jul 17 08:08:20.312348 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:20.312329    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t2w2w_685350e6-1b5d-472b-b075-9593e40ae8b5/bond-cni-plugin/0.log"
Jul 17 08:08:20.335562 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:20.335537    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t2w2w_685350e6-1b5d-472b-b075-9593e40ae8b5/routeoverride-cni/0.log"
Jul 17 08:08:20.358990 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:20.358968    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t2w2w_685350e6-1b5d-472b-b075-9593e40ae8b5/whereabouts-cni-bincopy/0.log"
Jul 17 08:08:20.381199 ip-10-0-135-5 kubenswrapper[2546]: I0717 08:08:20.381154    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t2w2w_685350e6-1b5d-472b-b075-9593e40ae8b5/whereabouts-cni/0.log"