Jul 11 03:48:45.262332 ip-10-0-135-235 systemd[1]: Starting Kubernetes Kubelet...
Jul 11 03:48:45.725990 ip-10-0-135-235 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 03:48:45.725990 ip-10-0-135-235 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 11 03:48:45.725990 ip-10-0-135-235 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 03:48:45.725990 ip-10-0-135-235 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 11 03:48:45.725990 ip-10-0-135-235 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 03:48:45.725990 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.723790    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729228    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729333    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729338    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729343    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729347    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729352    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729357    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729361    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729366    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729371    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729375    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729379    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729384    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729394    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729398    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729403    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729407    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729411    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729415    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:45.734770 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729419    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729424    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729428    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729434    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729438    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729443    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729447    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729458    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729462    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729467    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729471    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729475    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729479    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729484    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729488    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729492    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729498    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729502    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729507    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729511    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:45.784870 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729520    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729524    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729529    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729536    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729542    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729547    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729551    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729556    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729561    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729567    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729572    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729581    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729585    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729590    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729594    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729599    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729603    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729612    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729617    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:45.788680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729625    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729629    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729633    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729640    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729645    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729654    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729658    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729662    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729666    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729674    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729680    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729686    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729690    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729695    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729699    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729704    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729708    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729718    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729723    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:45.796425 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729727    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729731    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729735    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729739    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729744    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729748    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729752    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729756    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729760    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729764    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729768    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729778    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729783    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729787    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729794    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729798    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729805    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729810    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729815    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729820    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:45.801124 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729825    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.729829    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732749    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732762    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732767    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732772    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732778    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732783    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732787    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732791    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732796    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732800    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732804    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732809    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732813    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732817    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732822    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732826    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732830    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732834    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:45.808802 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732839    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732843    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732847    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732851    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732856    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732862    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732868    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732874    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732878    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732884    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732890    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732895    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732900    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732906    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732911    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732915    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732920    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732924    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732930    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:45.812619 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732935    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732940    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732945    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732973    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732978    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732983    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732987    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732992    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.732996    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733000    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733005    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733009    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733013    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733019    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733023    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733027    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733032    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733036    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733040    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:45.834088 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733044    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:45.823542 ip-10-0-135-235 systemd[1]: Started Kubernetes Kubelet.
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733048    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733053    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733057    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733062    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733066    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733070    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733075    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733080    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733084    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733089    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733093    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733098    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733102    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733106    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733111    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733116    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733120    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733126    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733132    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:45.836421 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733137    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733148    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733152    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733157    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733162    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733166    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733172    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733177    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733182    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733188    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733193    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733197    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733202    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733208    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733213    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733218    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733223    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733227    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733232    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733236    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:45.853509 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733241    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733245    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733249    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733902    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733912    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733917    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733922    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733926    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733931    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733935    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733940    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733944    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733979    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.733996    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734002    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734006    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734011    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734015    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734019    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:45.857196 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734025    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734029    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734033    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734037    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734041    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734046    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734050    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734054    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734058    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734062    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734066    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734071    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734075    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734079    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734083    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734087    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734091    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734095    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734100    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734104    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:45.872142 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734109    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734114    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734118    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734122    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734126    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734133    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734140    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734147    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734152    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734158    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734163    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734167    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734172    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734177    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734181    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734185    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734188    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734194    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734198    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:45.878898 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734201    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734205    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734209    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734213    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734217    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734220    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734224    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734228    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734235    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734239    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734247    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734252    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734258    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734262    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734266    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734270    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734274    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734277    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734280    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734284    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:46.044360 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734288    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734293    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734297    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734302    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734306    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734310    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734313    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734317    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734321    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734326    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734330    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734334    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734338    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734342    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734347    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734351    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734355    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734360    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734366    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:46.058154 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734371    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734378    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734382    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734387    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.734392    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734499    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734510    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734519    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734525    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734532    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734537    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734542    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734549    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734554    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734559    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734564    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734569    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734574    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734579    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734583    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734588    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734593    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734598    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 11 03:48:46.066536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734606    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734611    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734616    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734620    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734625    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734631    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734635    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734640    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734644    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734649    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734657    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734661    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734667    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734671    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734677    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734682    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734686    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734690    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734694    2576 flags.go:64] FLAG: --enable-server="true"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734698    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734705    2576 flags.go:64] FLAG: --event-burst="100"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734709    2576 flags.go:64] FLAG: --event-qps="50"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734713    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734718    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 11 03:48:46.068049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734722    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734727    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734731    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734735    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734740    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734744    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734748    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734753    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734758    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734762    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734766    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734771    2576 flags.go:64] FLAG: --feature-gates=""
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734777    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734781    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734786    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734790    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734795    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734799    2576 flags.go:64] FLAG: --help="false"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734805    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-135-235.ec2.internal"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734810    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734817    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734822    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734827    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 11 03:48:46.072166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734832    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734837    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734841    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734845    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734850    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734855    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734859    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734864    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734869    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734873    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734878    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734883    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734887    2576 flags.go:64] FLAG: --lock-file=""
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734891    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734896    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734901    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734909    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734914    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734918    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734923    2576 flags.go:64] FLAG: --logging-format="text"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734927    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734932    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734936    2576 flags.go:64] FLAG: --manifest-url=""
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734940    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734946    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 11 03:48:46.073707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734970    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734977    2576 flags.go:64] FLAG: --max-pods="110"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734983    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734987    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734993    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.734998    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735003    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735008    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735012    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735023    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735027    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735032    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735036    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735040    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735049    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735055    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735059    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735064    2576 flags.go:64] FLAG: --port="10250"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735068    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735073    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0266b6468338305a7"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735078    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735083    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735088    2576 flags.go:64] FLAG: --register-node="true"
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735092    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 11 03:48:46.077442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735098    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735103    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735108    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735113    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735119    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735124    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735129    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735134    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735138    2576 flags.go:64] FLAG: --runonce="false"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735143    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735148    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735155    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735161    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735166    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735171    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735176    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735180    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735185    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735190    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735195    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735199    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735204    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735209    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735213    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735223    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 11 03:48:46.078509 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735227    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735232    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735239    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735244    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735248    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735253    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735257    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735262    2576 flags.go:64] FLAG: --v="2"
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735276    2576 flags.go:64] FLAG: --version="false"
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735284    2576 flags.go:64] FLAG: --vmodule=""
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735290    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.735295    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735505    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735512    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735518    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735522    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735527    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735531    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735538    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735544    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735548    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735552    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:46.084267 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735556    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735560    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735564    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735569    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735573    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735577    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735581    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735585    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735589    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735593    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735599    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735605    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735609    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735613    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735618    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735622    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735626    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735630    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735634    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735638    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:46.085348 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735642    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735646    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735651    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735654    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735658    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735662    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735666    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735670    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735675    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735683    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735688    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735693    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735698    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735702    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735707    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735712    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735717    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735721    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735725    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735730    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:46.087227 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735734    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735738    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735743    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735747    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735751    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735755    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735759    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735763    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735767    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735771    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735775    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735778    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735782    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735787    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735791    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735795    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735799    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735803    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735807    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735811    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:46.087815 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735818    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735825    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735830    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735834    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735838    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735842    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735847    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735850    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735854    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735858    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735862    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735866    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735869    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735873    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735877    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735880    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735884    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735888    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735892    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735896    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:46.088554 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735900    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735904    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735908    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735912    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735916    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735920    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735924    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735928    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.735932    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.737093    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.763366    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.763383    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.763397    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.763404    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 11 03:48:46.089155 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763463    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763468    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763471    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763475    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763478    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763481    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763484    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763487    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763490    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763493    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763496    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763499    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763502    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763505    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763508    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763511    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763514    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763516    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763519    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:46.089719 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763522    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763525    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763527    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763530    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763534    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763538    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763541    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763545    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763550    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763553    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763556    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763559    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763562    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763564    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763567    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763570    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763573    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763577    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763580    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:46.090317 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763582    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763585    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763588    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763591    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763593    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763596    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763598    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763601    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763604    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763606    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763609    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763611    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763614    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763617    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763619    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763622    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763626    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763632    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763634    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763637    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:46.195368 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763640    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763644    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763647    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763649    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763652    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763655    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763658    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763660    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763663    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763665    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763668    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763670    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763673    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763676    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763678    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763681    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763684    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763686    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763689    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763691    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:46.196382 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763694    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763697    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763699    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763701    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763704    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763706    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763709    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763711    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763714    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763718    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763720    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763723    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763725    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763729    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763732    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763734    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763737    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763740    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763742    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763745    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:46.202255 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763748    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.763753    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763905    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763910    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763913    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763916    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763919    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763922    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763924    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763927    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763930    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763934    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763937    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763939    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763942    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 03:48:46.203282 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763945    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763947    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763964    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763968    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763970    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763973    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763977    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763980    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763982    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763985    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763988    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763992    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763995    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.763997    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764000    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764003    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764006    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764009    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764011    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764014    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 03:48:46.204299 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764016    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764019    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764023    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764027    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764030    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764032    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764035    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764037    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764040    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764042    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764045    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764047    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764050    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764053    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764056    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764058    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764061    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764063    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764067    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 03:48:46.209301 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764070    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764072    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764076    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764080    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764084    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764087    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764089    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764092    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764095    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764102    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764105    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764107    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764110    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764113    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764115    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764118    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764120    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764123    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764125    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 03:48:46.210308 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764128    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764130    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764133    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764136    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764138    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764141    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764143    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764146    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764148    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764151    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764154    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764157    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764160    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764163    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764165    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764168    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764170    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764174    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764177    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764180    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 03:48:46.211330 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764182    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764184    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764187    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764190    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764193    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764195    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764199    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:45.764202    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.764207    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.764336    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.766857    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.769060    2576 server.go:1019] "Starting client certificate rotation"
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.769161    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 03:48:46.214133 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.769194    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 03:48:46.215088 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.771647    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 03:48:46.215088 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.772878    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 03:48:46.215088 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.788428    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 11 03:48:46.215088 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.793179    2576 log.go:25] "Validated CRI v1 image API"
Jul 11 03:48:46.215088 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.794063    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 11 03:48:46.215088 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.797521    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ef01c28e-b6b4-4891-b1dd-08fa75b273ce:/dev/nvme0n1p3 f35b9a30-8beb-41a3-ba90-6b61fdd95372:/dev/nvme0n1p4]
Jul 11 03:48:46.215088 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.797542    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 11 03:48:46.215088 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.799328    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.804116    2576 manager.go:216] Machine: {Timestamp:2026-07-11 03:48:45.802411295 +0000 UTC m=+0.407938291 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101918 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2859f7d5331f1c468c356bdaec19d8 SystemUUID:ec2859f7-d533-1f1c-468c-356bdaec19d8 BootID:c53d47e0-d11a-4eb2-aad9-a5d74489f364 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a2:b5:48:e0:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a2:b5:48:e0:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:1e:1e:e7:b3:2b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.804241    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.804386    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.807695    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.807725    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-235.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.808596    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.808611    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.808622    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.808635    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.810139    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.813354    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.813490    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.813520    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.813533    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.813554    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.813565    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.813575    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 11 03:48:46.218677 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.813962    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.813979    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.816321    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.818115    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.818142    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819101    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819128    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819137    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819154    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819168    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819176    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819185    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819190    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819197    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819202    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819215    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819221    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819243    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819251    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.819731    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bh57w"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.822590    2576 server.go:1268] "Started kubelet"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.822992    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.823090    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.823326    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.824729    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-235.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.824752    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:45.824745    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.824799    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.824863    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bh57w"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:45.830009    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.833715    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.833724    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:45.833840    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834563    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834578    2576 factory.go:55] Registering systemd factory
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834580    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834580    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834619    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834586    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834708    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834716    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834917    2576 factory.go:153] Registering CRI-O factory
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834930    2576 factory.go:223] Registration of the crio container factory successfully
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834968    2576 factory.go:103] Registering Raw factory
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.834980    2576 manager.go:1196] Started watching for new ooms in manager
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.835354    2576 manager.go:349] Starting recovery of all containers
Jul 11 03:48:46.320004 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:45.836555    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:45.836651    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-235.ec2.internal.18c11fa622b21858  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-235.ec2.internal,UID:ip-10-0-135-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-235.ec2.internal,},FirstTimestamp:2026-07-11 03:48:45.822556248 +0000 UTC m=+0.428083221,LastTimestamp:2026-07-11 03:48:45.822556248 +0000 UTC m=+0.428083221,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-235.ec2.internal,}"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.842209    2576 manager.go:354] Recovery completed
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.847061    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.848452    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.849303    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.849329    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.849338    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:45.851156    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-235.ec2.internal\" not found" node="ip-10-0-135-235.ec2.internal"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.851244    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.851253    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.851263    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.851268    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.852051    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.852080    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.852089    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.852576    2576 policy_none.go:49] "None policy: Start"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.852594    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.852607    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.853854    2576 policy_none.go:47] "Start"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.907651    2576 manager.go:337] "Starting Device Plugin manager"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:45.907898    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.907910    2576 server.go:87] "Starting device plugin registration server"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.908172    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.908183    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.908276    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.908366    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:45.908375    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:45.908843    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:45.908889    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.009169    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.010391    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.010419    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.010429    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.010459    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-235.ec2.internal"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.019439    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-235.ec2.internal"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:46.019462    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-235.ec2.internal\": node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:46.033968    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.048906    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.050293    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.050334    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.050355    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 11 03:48:46.322069 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:46.050392    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 11 03:48:46.429495 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.052601    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:46.429495 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:46.134835    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:46.429495 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:46.235154    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:46.429495 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:46.335475    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:46.436760 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:46.435775    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:46.473578 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.473544    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal"]
Jul 11 03:48:46.473656 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.473625    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:46.474749 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.474729    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:46.474861 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.474759    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:46.474861 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.474769    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:46.475962 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.475941    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:46.476054 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.476039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:46.476110 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.476070    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:46.476691 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.476676    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:46.476753 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.476701    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:46.476753 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.476710    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:46.476812 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.476675    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:46.476812 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.476775    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:46.476812 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:46.476788    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:47.898370 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:47.898357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:47.898413 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:47.898382    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 03:48:47.899020 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:47.899005    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 03:48:47.899076 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:47.899034    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 03:48:47.899076 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:47.899047    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeHasSufficientPID"
Jul 11 03:48:47.925925 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:47.925904    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-235.ec2.internal\" not found" node="ip-10-0-135-235.ec2.internal"
Jul 11 03:48:47.930267 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:47.930252    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-235.ec2.internal\" not found" node="ip-10-0-135-235.ec2.internal"
Jul 11 03:48:47.956914 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:47.956894    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:47.959082 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:47.959064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43d84e137de07e283f5f187cad00caca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"43d84e137de07e283f5f187cad00caca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:47.959136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:47.959094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43d84e137de07e283f5f187cad00caca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"43d84e137de07e283f5f187cad00caca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:47.959136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:47.959112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60c99255ba345f0d3db4e9acfa74cae1-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.ec2.internal\" (UID: \"60c99255ba345f0d3db4e9acfa74cae1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:48.057440 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:48.057363    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:48.059574 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.059547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43d84e137de07e283f5f187cad00caca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"43d84e137de07e283f5f187cad00caca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:48.059708 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.059579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43d84e137de07e283f5f187cad00caca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"43d84e137de07e283f5f187cad00caca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:48.059708 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.059596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60c99255ba345f0d3db4e9acfa74cae1-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.ec2.internal\" (UID: \"60c99255ba345f0d3db4e9acfa74cae1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:48.059708 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.059643    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/60c99255ba345f0d3db4e9acfa74cae1-config\") pod \"kube-apiserver-proxy-ip-10-0-135-235.ec2.internal\" (UID: \"60c99255ba345f0d3db4e9acfa74cae1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:48.059708 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.059664    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43d84e137de07e283f5f187cad00caca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"43d84e137de07e283f5f187cad00caca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:48.059708 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.059665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43d84e137de07e283f5f187cad00caca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal\" (UID: \"43d84e137de07e283f5f187cad00caca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:48.157964 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:48.157921    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:48.188251 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.188230    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 11 03:48:48.188414 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.188397    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 11 03:48:48.188452 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.188412    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 11 03:48:48.227614 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.227573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:48.233380 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.233363    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:48.250637 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.250605    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 03:43:47 +0000 UTC" deadline="2028-02-06 08:32:47.990965099 +0000 UTC"
Jul 11 03:48:48.250637 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.250634    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13804h43m59.740336244s"
Jul 11 03:48:48.258799 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:48.258778    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:48.359158 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:48.359070    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:48.428020 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.427988    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:48.459779 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:48.459755    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-235.ec2.internal\" not found"
Jul 11 03:48:48.557370 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.557347    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:48.655065 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.655043    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:48.665222 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.665205    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 03:48:48.666184 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.666168    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal"
Jul 11 03:48:48.673623 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.673606    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 03:48:48.764732 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:48.764702    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d84e137de07e283f5f187cad00caca.slice/crio-c035f1ab3ac976eb812d050c6d66864f8d32b087c82555560a1429c097a4a3a5 WatchSource:0}: Error finding container c035f1ab3ac976eb812d050c6d66864f8d32b087c82555560a1429c097a4a3a5: Status 404 returned error can't find the container with id c035f1ab3ac976eb812d050c6d66864f8d32b087c82555560a1429c097a4a3a5
Jul 11 03:48:48.765237 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:48.765218    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c99255ba345f0d3db4e9acfa74cae1.slice/crio-3066d9552684c44b5e9a1cbb561b8598a3c241a90837bbdae86482b65849bd1c WatchSource:0}: Error finding container 3066d9552684c44b5e9a1cbb561b8598a3c241a90837bbdae86482b65849bd1c: Status 404 returned error can't find the container with id 3066d9552684c44b5e9a1cbb561b8598a3c241a90837bbdae86482b65849bd1c
Jul 11 03:48:48.768689 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:48.768676    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 03:48:49.100516 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.100444    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:49.169429 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.169400    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 03:48:49.235157 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.235138    2576 apiserver.go:52] "Watching apiserver"
Jul 11 03:48:49.240868 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.240849    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 11 03:48:49.241858 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.241830    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal","openshift-multus/multus-additional-cni-plugins-4q8zm","openshift-multus/multus-v4wlk","openshift-multus/network-metrics-daemon-mbj8w","openshift-network-operator/iptables-alerter-s2v4d","openshift-ovn-kubernetes/ovnkube-node-swq4p","kube-system/global-pull-secret-syncer-tf67l","kube-system/konnectivity-agent-x5m6q","openshift-cluster-node-tuning-operator/tuned-k6fbh","openshift-dns/node-resolver-qqqn6","openshift-image-registry/node-ca-lpvjc","openshift-network-diagnostics/network-check-target-9b4n4","kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal"]
Jul 11 03:48:49.244579 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.244557    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.246828 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.246807    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:49.247010 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.246886    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:48:49.247199 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.247154    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 11 03:48:49.247411 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.247388    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 11 03:48:49.247521 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.247423    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 11 03:48:49.247521 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.247503    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lcm2j\""
Jul 11 03:48:49.247816 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.247795    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 11 03:48:49.247907 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.247796    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 11 03:48:49.247907 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.247853    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 11 03:48:49.249145 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.249125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.251527 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.251106    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jq2l5\""
Jul 11 03:48:49.251527 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.251118    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 11 03:48:49.251527 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.251236    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 11 03:48:49.251527 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.251283    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 11 03:48:49.251527 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.251346    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 11 03:48:49.251527 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.251477    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 11 03:48:49.251807 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.251679    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.253616 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.253467    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 11 03:48:49.253616 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.253504    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lbxmz\""
Jul 11 03:48:49.253919 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.253895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:49.254011 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.253979    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:48:49.255936 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.255917    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 11 03:48:49.256214 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.256192    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s2v4d"
Jul 11 03:48:49.258503 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.258486    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 11 03:48:49.258603 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.258521    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:48:49.258603 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.258528    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f422c\""
Jul 11 03:48:49.258893 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.258750    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 11 03:48:49.258893 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.258786    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:48:49.261051 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.261033    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6wgwp\""
Jul 11 03:48:49.261485 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.261306    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 11 03:48:49.261485 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.261454    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 11 03:48:49.262432 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.262412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.264297 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.264279    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 11 03:48:49.264404 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.264299    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 11 03:48:49.264404 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.264341    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rkc6p\""
Jul 11 03:48:49.264557 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.264541    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 11 03:48:49.264847 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.264822    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:49.264942 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.264892    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:48:49.265016 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.264999    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 03:48:49.265378 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-run-systemd\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.265378 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df6b9282-b6c8-4cda-b7b1-f13643bdb788-ovn-node-metrics-cert\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.265378 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pf7l\" (UniqueName: \"kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l\") pod \"network-check-target-9b4n4\" (UID: \"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e\") " pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:49.265588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-system-cni-dir\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.265588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-os-release\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.265588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-conf-dir\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.265588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df6b9282-b6c8-4cda-b7b1-f13643bdb788-ovnkube-config\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.265588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxfbb\" (UniqueName: \"kubernetes.io/projected/df6b9282-b6c8-4cda-b7b1-f13643bdb788-kube-api-access-fxfbb\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.265588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0f52cfa-a9db-409f-8edb-c4f10af04750-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.265588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0f52cfa-a9db-409f-8edb-c4f10af04750-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-cni-dir\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-var-lib-cni-bin\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-run-ovn\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-run-ovn-kubernetes\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df6b9282-b6c8-4cda-b7b1-f13643bdb788-env-overrides\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df6b9282-b6c8-4cda-b7b1-f13643bdb788-ovnkube-script-lib\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0f52cfa-a9db-409f-8edb-c4f10af04750-cni-binary-copy\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-hostroot\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96-host-slash\") pod \"iptables-alerter-s2v4d\" (UID: \"2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96\") " pod="openshift-network-operator/iptables-alerter-s2v4d"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-kubelet\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.265913 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-slash\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-cni-bin\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-cni-netd\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.265963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f364bdf1-bfa9-46cb-a769-14ddeec413b6-cni-binary-copy\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-var-lib-kubelet\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96-iptables-alerter-script\") pod \"iptables-alerter-s2v4d\" (UID: \"2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96\") " pod="openshift-network-operator/iptables-alerter-s2v4d"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdfl6\" (UniqueName: \"kubernetes.io/projected/f0f52cfa-a9db-409f-8edb-c4f10af04750-kube-api-access-rdfl6\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-run-multus-certs\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwltp\" (UniqueName: \"kubernetes.io/projected/f364bdf1-bfa9-46cb-a769-14ddeec413b6-kube-api-access-rwltp\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45z2j\" (UniqueName: \"kubernetes.io/projected/7e5d2e71-1f18-45d0-8c51-c427699635a2-kube-api-access-45z2j\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266195    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp4c4\" (UniqueName: \"kubernetes.io/projected/2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96-kube-api-access-cp4c4\") pod \"iptables-alerter-s2v4d\" (UID: \"2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96\") " pod="openshift-network-operator/iptables-alerter-s2v4d"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-var-lib-openvswitch\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-etc-openvswitch\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-node-log\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-log-socket\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.266513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-cnibin\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-system-cni-dir\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-cnibin\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-systemd-units\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-run-netns\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-os-release\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-var-lib-cni-multus\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-daemon-config\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266542    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-run-openvswitch\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-socket-dir-parent\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-run-k8s-cni-cncf-io\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-run-netns\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.267136 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.266645    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-etc-kubernetes\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.267670 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.267416    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.269392 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.269374    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4j5f2\""
Jul 11 03:48:49.269392 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.269382    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:48:49.269531 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.269401    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 11 03:48:49.269927 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.269752    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qqqn6"
Jul 11 03:48:49.271564 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.271547    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7pq4s\""
Jul 11 03:48:49.271653 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.271553    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 11 03:48:49.271985 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.271970    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 11 03:48:49.272523 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.272498    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lpvjc"
Jul 11 03:48:49.274340 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.274309    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 11 03:48:49.274584 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.274566    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 11 03:48:49.274659 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.274612    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8kkdx\""
Jul 11 03:48:49.275442 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.275422    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 11 03:48:49.284857 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.284835    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xgtgs"
Jul 11 03:48:49.289955 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.289937    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xgtgs"
Jul 11 03:48:49.356368 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.356291    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.367736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-conf-dir\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.367776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-run-ovn\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.367804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df6b9282-b6c8-4cda-b7b1-f13643bdb788-ovnkube-script-lib\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.367832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-device-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.367857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-run\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.367882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kgcl\" (UniqueName: \"kubernetes.io/projected/ebe1a2df-bb0d-4d20-854d-3491761f447f-kube-api-access-4kgcl\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.367906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ca8fb3b-f82b-4e71-8282-8bba0e901ad2-konnectivity-ca\") pod \"konnectivity-agent-x5m6q\" (UID: \"2ca8fb3b-f82b-4e71-8282-8bba0e901ad2\") " pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.367929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-slash\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.367955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.367978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-var-lib-kubelet\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.367996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdfl6\" (UniqueName: \"kubernetes.io/projected/f0f52cfa-a9db-409f-8edb-c4f10af04750-kube-api-access-rdfl6\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-run-multus-certs\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-var-lib-openvswitch\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-system-cni-dir\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-cnibin\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-daemon-config\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.370151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-etc-selinux\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-kubernetes\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-systemd\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-tuned\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-systemd-units\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-run-netns\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-var-lib-cni-multus\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-run-k8s-cni-cncf-io\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-run-netns\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-etc-kubernetes\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7z6c\" (UniqueName: \"kubernetes.io/projected/f9671b82-8571-4728-885f-f6ea90cd0d63-kube-api-access-h7z6c\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-var-lib-kubelet\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkch6\" (UniqueName: \"kubernetes.io/projected/520f5f45-088b-42b0-8dbd-e2dbea4e16aa-kube-api-access-xkch6\") pod \"node-ca-lpvjc\" (UID: \"520f5f45-088b-42b0-8dbd-e2dbea4e16aa\") " pod="openshift-image-registry/node-ca-lpvjc"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df6b9282-b6c8-4cda-b7b1-f13643bdb788-ovn-node-metrics-cert\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-os-release\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-sysconfig\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-sysctl-d\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.371085 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-cnibin\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-sys\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368538    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-conf-dir\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebe1a2df-bb0d-4d20-854d-3491761f447f-tmp\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/346ec1a0-1923-4eb9-b674-34726aa9d2fa-hosts-file\") pod \"node-resolver-qqqn6\" (UID: \"346ec1a0-1923-4eb9-b674-34726aa9d2fa\") " pod="openshift-dns/node-resolver-qqqn6"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368584    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-run-ovn\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df6b9282-b6c8-4cda-b7b1-f13643bdb788-ovnkube-config\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368628    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-var-lib-kubelet\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxfbb\" (UniqueName: \"kubernetes.io/projected/df6b9282-b6c8-4cda-b7b1-f13643bdb788-kube-api-access-fxfbb\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368645    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-slash\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0f52cfa-a9db-409f-8edb-c4f10af04750-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-cni-dir\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-lib-modules\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-run-ovn-kubernetes\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df6b9282-b6c8-4cda-b7b1-f13643bdb788-env-overrides\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.372172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0f52cfa-a9db-409f-8edb-c4f10af04750-cni-binary-copy\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-hostroot\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a9da7d4-021f-4706-b439-b2ddd6a0920f-kubelet-config\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368971    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96-host-slash\") pod \"iptables-alerter-s2v4d\" (UID: \"2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96\") " pod="openshift-network-operator/iptables-alerter-s2v4d"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-kubelet\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-cni-bin\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-cni-netd\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f364bdf1-bfa9-46cb-a769-14ddeec413b6-cni-binary-copy\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369099    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-sysctl-conf\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/520f5f45-088b-42b0-8dbd-e2dbea4e16aa-serviceca\") pod \"node-ca-lpvjc\" (UID: \"520f5f45-088b-42b0-8dbd-e2dbea4e16aa\") " pod="openshift-image-registry/node-ca-lpvjc"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96-iptables-alerter-script\") pod \"iptables-alerter-s2v4d\" (UID: \"2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96\") " pod="openshift-network-operator/iptables-alerter-s2v4d"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwltp\" (UniqueName: \"kubernetes.io/projected/f364bdf1-bfa9-46cb-a769-14ddeec413b6-kube-api-access-rwltp\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45z2j\" (UniqueName: \"kubernetes.io/projected/7e5d2e71-1f18-45d0-8c51-c427699635a2-kube-api-access-45z2j\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a9da7d4-021f-4706-b439-b2ddd6a0920f-dbus\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/520f5f45-088b-42b0-8dbd-e2dbea4e16aa-host\") pod \"node-ca-lpvjc\" (UID: \"520f5f45-088b-42b0-8dbd-e2dbea4e16aa\") " pod="openshift-image-registry/node-ca-lpvjc"
Jul 11 03:48:49.373264 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ca8fb3b-f82b-4e71-8282-8bba0e901ad2-agent-certs\") pod \"konnectivity-agent-x5m6q\" (UID: \"2ca8fb3b-f82b-4e71-8282-8bba0e901ad2\") " pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp4c4\" (UniqueName: \"kubernetes.io/projected/2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96-kube-api-access-cp4c4\") pod \"iptables-alerter-s2v4d\" (UID: \"2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96\") " pod="openshift-network-operator/iptables-alerter-s2v4d"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-etc-openvswitch\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-node-log\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0f52cfa-a9db-409f-8edb-c4f10af04750-cni-binary-copy\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-log-socket\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-cnibin\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.368741    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-run-multus-certs\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369510    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96-host-slash\") pod \"iptables-alerter-s2v4d\" (UID: \"2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96\") " pod="openshift-network-operator/iptables-alerter-s2v4d"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-daemon-config\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369514    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-systemd-units\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369620    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-etc-openvswitch\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369624    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-cnibin\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-hostroot\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369668    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-log-socket\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369694    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-os-release\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369700    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-cni-netd\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-var-lib-cni-multus\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.374090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-run-ovn-kubernetes\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df6b9282-b6c8-4cda-b7b1-f13643bdb788-ovnkube-script-lib\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369750    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-run-netns\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-os-release\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369795    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-node-log\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-etc-kubernetes\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/346ec1a0-1923-4eb9-b674-34726aa9d2fa-tmp-dir\") pod \"node-resolver-qqqn6\" (UID: \"346ec1a0-1923-4eb9-b674-34726aa9d2fa\") " pod="openshift-dns/node-resolver-qqqn6"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-run-openvswitch\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369890    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.369920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-socket-dir-parent\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370003    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-run-k8s-cni-cncf-io\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-registration-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-sys-fs\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnw6v\" (UniqueName: \"kubernetes.io/projected/346ec1a0-1923-4eb9-b674-34726aa9d2fa-kube-api-access-vnw6v\") pod \"node-resolver-qqqn6\" (UID: \"346ec1a0-1923-4eb9-b674-34726aa9d2fa\") " pod="openshift-dns/node-resolver-qqqn6"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df6b9282-b6c8-4cda-b7b1-f13643bdb788-ovnkube-config\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-run-systemd\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370240    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f364bdf1-bfa9-46cb-a769-14ddeec413b6-cni-binary-copy\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.374972 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pf7l\" (UniqueName: \"kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l\") pod \"network-check-target-9b4n4\" (UID: \"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e\") " pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-system-cni-dir\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-system-cni-dir\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-socket-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-modprobe-d\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-host\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-socket-dir-parent\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0f52cfa-a9db-409f-8edb-c4f10af04750-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0f52cfa-a9db-409f-8edb-c4f10af04750-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-var-lib-cni-bin\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370460    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-cni-bin\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.370536    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370584    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-multus-cni-dir\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370637    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-os-release\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.370642    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs podName:7e5d2e71-1f18-45d0-8c51-c427699635a2 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:49.870590982 +0000 UTC m=+3.055743431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs") pod "network-metrics-daemon-mbj8w" (UID: "7e5d2e71-1f18-45d0-8c51-c427699635a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370676    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f364bdf1-bfa9-46cb-a769-14ddeec413b6-host-var-lib-cni-bin\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.376397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-run-netns\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370761    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-run-systemd\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370792    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-var-lib-openvswitch\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370358    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-host-kubelet\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96-iptables-alerter-script\") pod \"iptables-alerter-s2v4d\" (UID: \"2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96\") " pod="openshift-network-operator/iptables-alerter-s2v4d"
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.370857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df6b9282-b6c8-4cda-b7b1-f13643bdb788-env-overrides\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.371041    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0f52cfa-a9db-409f-8edb-c4f10af04750-system-cni-dir\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.371061    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df6b9282-b6c8-4cda-b7b1-f13643bdb788-run-openvswitch\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.372031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0f52cfa-a9db-409f-8edb-c4f10af04750-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.375284    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df6b9282-b6c8-4cda-b7b1-f13643bdb788-ovn-node-metrics-cert\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.376005    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.376024    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.376040    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8pf7l for pod openshift-network-diagnostics/network-check-target-9b4n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:49.377235 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.376103    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l podName:ef9cd125-a8d4-4fe4-9be1-afbe87875c1e nodeName:}" failed. No retries permitted until 2026-07-11 03:48:49.876072732 +0000 UTC m=+3.061225180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8pf7l" (UniqueName: "kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l") pod "network-check-target-9b4n4" (UID: "ef9cd125-a8d4-4fe4-9be1-afbe87875c1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:49.378588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.378117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxfbb\" (UniqueName: \"kubernetes.io/projected/df6b9282-b6c8-4cda-b7b1-f13643bdb788-kube-api-access-fxfbb\") pod \"ovnkube-node-swq4p\" (UID: \"df6b9282-b6c8-4cda-b7b1-f13643bdb788\") " pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.378588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.378553    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45z2j\" (UniqueName: \"kubernetes.io/projected/7e5d2e71-1f18-45d0-8c51-c427699635a2-kube-api-access-45z2j\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:49.380023 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.380000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp4c4\" (UniqueName: \"kubernetes.io/projected/2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96-kube-api-access-cp4c4\") pod \"iptables-alerter-s2v4d\" (UID: \"2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96\") " pod="openshift-network-operator/iptables-alerter-s2v4d"
Jul 11 03:48:49.380130 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.380111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdfl6\" (UniqueName: \"kubernetes.io/projected/f0f52cfa-a9db-409f-8edb-c4f10af04750-kube-api-access-rdfl6\") pod \"multus-additional-cni-plugins-4q8zm\" (UID: \"f0f52cfa-a9db-409f-8edb-c4f10af04750\") " pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.381601 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.381581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwltp\" (UniqueName: \"kubernetes.io/projected/f364bdf1-bfa9-46cb-a769-14ddeec413b6-kube-api-access-rwltp\") pod \"multus-v4wlk\" (UID: \"f364bdf1-bfa9-46cb-a769-14ddeec413b6\") " pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.471098 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a9da7d4-021f-4706-b439-b2ddd6a0920f-dbus\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:49.471253 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/520f5f45-088b-42b0-8dbd-e2dbea4e16aa-host\") pod \"node-ca-lpvjc\" (UID: \"520f5f45-088b-42b0-8dbd-e2dbea4e16aa\") " pod="openshift-image-registry/node-ca-lpvjc"
Jul 11 03:48:49.471253 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ca8fb3b-f82b-4e71-8282-8bba0e901ad2-agent-certs\") pod \"konnectivity-agent-x5m6q\" (UID: \"2ca8fb3b-f82b-4e71-8282-8bba0e901ad2\") " pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:48:49.471253 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/346ec1a0-1923-4eb9-b674-34726aa9d2fa-tmp-dir\") pod \"node-resolver-qqqn6\" (UID: \"346ec1a0-1923-4eb9-b674-34726aa9d2fa\") " pod="openshift-dns/node-resolver-qqqn6"
Jul 11 03:48:49.471253 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-registration-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.471253 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-sys-fs\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.471253 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnw6v\" (UniqueName: \"kubernetes.io/projected/346ec1a0-1923-4eb9-b674-34726aa9d2fa-kube-api-access-vnw6v\") pod \"node-resolver-qqqn6\" (UID: \"346ec1a0-1923-4eb9-b674-34726aa9d2fa\") " pod="openshift-dns/node-resolver-qqqn6"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-socket-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-modprobe-d\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-host\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-device-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-run\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kgcl\" (UniqueName: \"kubernetes.io/projected/ebe1a2df-bb0d-4d20-854d-3491761f447f-kube-api-access-4kgcl\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ca8fb3b-f82b-4e71-8282-8bba0e901ad2-konnectivity-ca\") pod \"konnectivity-agent-x5m6q\" (UID: \"2ca8fb3b-f82b-4e71-8282-8bba0e901ad2\") " pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-etc-selinux\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-kubernetes\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-systemd\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-tuned\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7z6c\" (UniqueName: \"kubernetes.io/projected/f9671b82-8571-4728-885f-f6ea90cd0d63-kube-api-access-h7z6c\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.471587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-var-lib-kubelet\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkch6\" (UniqueName: \"kubernetes.io/projected/520f5f45-088b-42b0-8dbd-e2dbea4e16aa-kube-api-access-xkch6\") pod \"node-ca-lpvjc\" (UID: \"520f5f45-088b-42b0-8dbd-e2dbea4e16aa\") " pod="openshift-image-registry/node-ca-lpvjc"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471634    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-sysconfig\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-sysctl-d\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-sys\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471707    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebe1a2df-bb0d-4d20-854d-3491761f447f-tmp\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/346ec1a0-1923-4eb9-b674-34726aa9d2fa-hosts-file\") pod \"node-resolver-qqqn6\" (UID: \"346ec1a0-1923-4eb9-b674-34726aa9d2fa\") " pod="openshift-dns/node-resolver-qqqn6"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-lib-modules\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a9da7d4-021f-4706-b439-b2ddd6a0920f-kubelet-config\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.471917    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-sysctl-conf\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472002    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-systemd\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472036    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-etc-selinux\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.472201 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472167    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-sysctl-conf\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472862 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472280    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-socket-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.472862 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472284    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a9da7d4-021f-4706-b439-b2ddd6a0920f-dbus\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:49.472862 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472350    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/520f5f45-088b-42b0-8dbd-e2dbea4e16aa-host\") pod \"node-ca-lpvjc\" (UID: \"520f5f45-088b-42b0-8dbd-e2dbea4e16aa\") " pod="openshift-image-registry/node-ca-lpvjc"
Jul 11 03:48:49.472862 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-modprobe-d\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472862 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-host\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472862 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-device-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.472862 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472524    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-run\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.472862 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472810    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-sys\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.473287 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.472911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/346ec1a0-1923-4eb9-b674-34726aa9d2fa-hosts-file\") pod \"node-resolver-qqqn6\" (UID: \"346ec1a0-1923-4eb9-b674-34726aa9d2fa\") " pod="openshift-dns/node-resolver-qqqn6"
Jul 11 03:48:49.473287 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.473000    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:49.473287 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.473062    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret podName:1a9da7d4-021f-4706-b439-b2ddd6a0920f nodeName:}" failed. No retries permitted until 2026-07-11 03:48:49.973046617 +0000 UTC m=+3.158199059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret") pod "global-pull-secret-syncer-tf67l" (UID: "1a9da7d4-021f-4706-b439-b2ddd6a0920f") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:49.473287 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.473125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-registration-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.473287 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.473205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ca8fb3b-f82b-4e71-8282-8bba0e901ad2-konnectivity-ca\") pod \"konnectivity-agent-x5m6q\" (UID: \"2ca8fb3b-f82b-4e71-8282-8bba0e901ad2\") " pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:48:49.473287 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.473255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/520f5f45-088b-42b0-8dbd-e2dbea4e16aa-serviceca\") pod \"node-ca-lpvjc\" (UID: \"520f5f45-088b-42b0-8dbd-e2dbea4e16aa\") " pod="openshift-image-registry/node-ca-lpvjc"
Jul 11 03:48:49.473604 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.473318    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-lib-modules\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.473604 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.473389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a9da7d4-021f-4706-b439-b2ddd6a0920f-kubelet-config\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:49.473604 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.473437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.473604 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.473442    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/346ec1a0-1923-4eb9-b674-34726aa9d2fa-tmp-dir\") pod \"node-resolver-qqqn6\" (UID: \"346ec1a0-1923-4eb9-b674-34726aa9d2fa\") " pod="openshift-dns/node-resolver-qqqn6"
Jul 11 03:48:49.473604 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.473487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f9671b82-8571-4728-885f-f6ea90cd0d63-sys-fs\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.473604 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.473530    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-sysconfig\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.473604 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.473572    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-kubernetes\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.474713 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.474682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-var-lib-kubelet\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.475126 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.475104    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-sysctl-d\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.475241 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.475223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/520f5f45-088b-42b0-8dbd-e2dbea4e16aa-serviceca\") pod \"node-ca-lpvjc\" (UID: \"520f5f45-088b-42b0-8dbd-e2dbea4e16aa\") " pod="openshift-image-registry/node-ca-lpvjc"
Jul 11 03:48:49.479353 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.478712    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ca8fb3b-f82b-4e71-8282-8bba0e901ad2-agent-certs\") pod \"konnectivity-agent-x5m6q\" (UID: \"2ca8fb3b-f82b-4e71-8282-8bba0e901ad2\") " pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:48:49.479774 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.479735    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebe1a2df-bb0d-4d20-854d-3491761f447f-etc-tuned\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.479950 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.479762    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebe1a2df-bb0d-4d20-854d-3491761f447f-tmp\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.483700 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.483609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kgcl\" (UniqueName: \"kubernetes.io/projected/ebe1a2df-bb0d-4d20-854d-3491761f447f-kube-api-access-4kgcl\") pod \"tuned-k6fbh\" (UID: \"ebe1a2df-bb0d-4d20-854d-3491761f447f\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.485363 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.485307    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnw6v\" (UniqueName: \"kubernetes.io/projected/346ec1a0-1923-4eb9-b674-34726aa9d2fa-kube-api-access-vnw6v\") pod \"node-resolver-qqqn6\" (UID: \"346ec1a0-1923-4eb9-b674-34726aa9d2fa\") " pod="openshift-dns/node-resolver-qqqn6"
Jul 11 03:48:49.486492 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.486449    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7z6c\" (UniqueName: \"kubernetes.io/projected/f9671b82-8571-4728-885f-f6ea90cd0d63-kube-api-access-h7z6c\") pod \"aws-ebs-csi-driver-node-bhc8n\" (UID: \"f9671b82-8571-4728-885f-f6ea90cd0d63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.486588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.486552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkch6\" (UniqueName: \"kubernetes.io/projected/520f5f45-088b-42b0-8dbd-e2dbea4e16aa-kube-api-access-xkch6\") pod \"node-ca-lpvjc\" (UID: \"520f5f45-088b-42b0-8dbd-e2dbea4e16aa\") " pod="openshift-image-registry/node-ca-lpvjc"
Jul 11 03:48:49.487478 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.487393    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" event={"ID":"43d84e137de07e283f5f187cad00caca","Type":"ContainerStarted","Data":"c035f1ab3ac976eb812d050c6d66864f8d32b087c82555560a1429c097a4a3a5"}
Jul 11 03:48:49.488647 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.488581    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" event={"ID":"60c99255ba345f0d3db4e9acfa74cae1","Type":"ContainerStarted","Data":"3066d9552684c44b5e9a1cbb561b8598a3c241a90837bbdae86482b65849bd1c"}
Jul 11 03:48:49.557565 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.557298    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:48:49.565121 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.565093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4q8zm"
Jul 11 03:48:49.570674 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:49.570647    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6b9282_b6c8_4cda_b7b1_f13643bdb788.slice/crio-95af1578fcd1928e6be6fa52a6f528fb7df3711341e9028b4b5444ac943f58f5 WatchSource:0}: Error finding container 95af1578fcd1928e6be6fa52a6f528fb7df3711341e9028b4b5444ac943f58f5: Status 404 returned error can't find the container with id 95af1578fcd1928e6be6fa52a6f528fb7df3711341e9028b4b5444ac943f58f5
Jul 11 03:48:49.573053 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.572953    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v4wlk"
Jul 11 03:48:49.576293 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:49.576271    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f52cfa_a9db_409f_8edb_c4f10af04750.slice/crio-84c1e5d144085cff0d54d20193bc7585cc21ef44602d28f432ac29f96a077f6f WatchSource:0}: Error finding container 84c1e5d144085cff0d54d20193bc7585cc21ef44602d28f432ac29f96a077f6f: Status 404 returned error can't find the container with id 84c1e5d144085cff0d54d20193bc7585cc21ef44602d28f432ac29f96a077f6f
Jul 11 03:48:49.582139 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.582118    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s2v4d"
Jul 11 03:48:49.584073 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:49.584045    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf364bdf1_bfa9_46cb_a769_14ddeec413b6.slice/crio-cfeec271c4c456973503942b528554cedb393e47e4328624bec6b1263d54c7b8 WatchSource:0}: Error finding container cfeec271c4c456973503942b528554cedb393e47e4328624bec6b1263d54c7b8: Status 404 returned error can't find the container with id cfeec271c4c456973503942b528554cedb393e47e4328624bec6b1263d54c7b8
Jul 11 03:48:49.589082 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.589005    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:48:49.595488 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.595473    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n"
Jul 11 03:48:49.602749 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.602725    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k6fbh"
Jul 11 03:48:49.612254 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.612115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qqqn6"
Jul 11 03:48:49.613752 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:49.613729    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9671b82_8571_4728_885f_f6ea90cd0d63.slice/crio-9bcefa75e8372caeca49e086a3b912dacd3f689b08bd7701980ab15bb8be5055 WatchSource:0}: Error finding container 9bcefa75e8372caeca49e086a3b912dacd3f689b08bd7701980ab15bb8be5055: Status 404 returned error can't find the container with id 9bcefa75e8372caeca49e086a3b912dacd3f689b08bd7701980ab15bb8be5055
Jul 11 03:48:49.614892 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:49.614847    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe1a2df_bb0d_4d20_854d_3491761f447f.slice/crio-cfa809f0462ba5c8603df8460ba582fd912e0ed3769accee8698d99187434e91 WatchSource:0}: Error finding container cfa809f0462ba5c8603df8460ba582fd912e0ed3769accee8698d99187434e91: Status 404 returned error can't find the container with id cfa809f0462ba5c8603df8460ba582fd912e0ed3769accee8698d99187434e91
Jul 11 03:48:49.615498 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.615360    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lpvjc"
Jul 11 03:48:49.631536 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:49.631504    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520f5f45_088b_42b0_8dbd_e2dbea4e16aa.slice/crio-ae18a6c06b4db3fcea1f50945a8614dcb786bfa79333f0b1d6f4c5131599bfc4 WatchSource:0}: Error finding container ae18a6c06b4db3fcea1f50945a8614dcb786bfa79333f0b1d6f4c5131599bfc4: Status 404 returned error can't find the container with id ae18a6c06b4db3fcea1f50945a8614dcb786bfa79333f0b1d6f4c5131599bfc4
Jul 11 03:48:49.634268 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:48:49.634200    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346ec1a0_1923_4eb9_b674_34726aa9d2fa.slice/crio-0bad256382049a6b2db749ecc9e8dd1ca92e1561ec24ad90593747e923fb3083 WatchSource:0}: Error finding container 0bad256382049a6b2db749ecc9e8dd1ca92e1561ec24ad90593747e923fb3083: Status 404 returned error can't find the container with id 0bad256382049a6b2db749ecc9e8dd1ca92e1561ec24ad90593747e923fb3083
Jul 11 03:48:49.875810 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.875729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:49.875957 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.875852    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:49.875957 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.875920    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs podName:7e5d2e71-1f18-45d0-8c51-c427699635a2 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:50.875902541 +0000 UTC m=+4.061054988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs") pod "network-metrics-daemon-mbj8w" (UID: "7e5d2e71-1f18-45d0-8c51-c427699635a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:49.976899 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.976853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pf7l\" (UniqueName: \"kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l\") pod \"network-check-target-9b4n4\" (UID: \"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e\") " pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:49.977079 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:49.976936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:49.977079 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.977059    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:49.977176 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.977087    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:49.977176 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.977099    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:49.977176 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.977169    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret podName:1a9da7d4-021f-4706-b439-b2ddd6a0920f nodeName:}" failed. No retries permitted until 2026-07-11 03:48:50.977151183 +0000 UTC m=+4.162303616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret") pod "global-pull-secret-syncer-tf67l" (UID: "1a9da7d4-021f-4706-b439-b2ddd6a0920f") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:49.977464 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.977102    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8pf7l for pod openshift-network-diagnostics/network-check-target-9b4n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:49.977464 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:49.977254    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l podName:ef9cd125-a8d4-4fe4-9be1-afbe87875c1e nodeName:}" failed. No retries permitted until 2026-07-11 03:48:50.977235429 +0000 UTC m=+4.162387869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pf7l" (UniqueName: "kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l") pod "network-check-target-9b4n4" (UID: "ef9cd125-a8d4-4fe4-9be1-afbe87875c1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:50.292980 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.292899    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 03:43:49 +0000 UTC" deadline="2027-12-22 14:38:35.886130434 +0000 UTC"
Jul 11 03:48:50.292980 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.292937    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12706h49m45.593196368s"
Jul 11 03:48:50.471678 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.471642    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:50.471832 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:50.471781    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:48:50.471883 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.471840    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:50.471980 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:50.471958    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:48:50.491851 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.491789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lpvjc" event={"ID":"520f5f45-088b-42b0-8dbd-e2dbea4e16aa","Type":"ContainerStarted","Data":"ae18a6c06b4db3fcea1f50945a8614dcb786bfa79333f0b1d6f4c5131599bfc4"}
Jul 11 03:48:50.493016 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.492982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qqqn6" event={"ID":"346ec1a0-1923-4eb9-b674-34726aa9d2fa","Type":"ContainerStarted","Data":"0bad256382049a6b2db749ecc9e8dd1ca92e1561ec24ad90593747e923fb3083"}
Jul 11 03:48:50.494397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.494305    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k6fbh" event={"ID":"ebe1a2df-bb0d-4d20-854d-3491761f447f","Type":"ContainerStarted","Data":"cfa809f0462ba5c8603df8460ba582fd912e0ed3769accee8698d99187434e91"}
Jul 11 03:48:50.495613 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.495555    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n" event={"ID":"f9671b82-8571-4728-885f-f6ea90cd0d63","Type":"ContainerStarted","Data":"9bcefa75e8372caeca49e086a3b912dacd3f689b08bd7701980ab15bb8be5055"}
Jul 11 03:48:50.496879 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.496856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v4wlk" event={"ID":"f364bdf1-bfa9-46cb-a769-14ddeec413b6","Type":"ContainerStarted","Data":"cfeec271c4c456973503942b528554cedb393e47e4328624bec6b1263d54c7b8"}
Jul 11 03:48:50.498138 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.498114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x5m6q" event={"ID":"2ca8fb3b-f82b-4e71-8282-8bba0e901ad2","Type":"ContainerStarted","Data":"27e61998374b0d2a9e0cdd85f2fcc64e24c693fe405af2987805a9e5d9bce360"}
Jul 11 03:48:50.499832 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.499780    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s2v4d" event={"ID":"2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96","Type":"ContainerStarted","Data":"cad2a1540fd4514f7970fcdfad04bc84622fda5b7b47fe55913459934479d171"}
Jul 11 03:48:50.501087 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.501062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4q8zm" event={"ID":"f0f52cfa-a9db-409f-8edb-c4f10af04750","Type":"ContainerStarted","Data":"84c1e5d144085cff0d54d20193bc7585cc21ef44602d28f432ac29f96a077f6f"}
Jul 11 03:48:50.502602 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.502555    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p" event={"ID":"df6b9282-b6c8-4cda-b7b1-f13643bdb788","Type":"ContainerStarted","Data":"95af1578fcd1928e6be6fa52a6f528fb7df3711341e9028b4b5444ac943f58f5"}
Jul 11 03:48:50.883844 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.883808    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:50.884044 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:50.883961    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:50.884044 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:50.884022    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs podName:7e5d2e71-1f18-45d0-8c51-c427699635a2 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:52.884004319 +0000 UTC m=+6.069156757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs") pod "network-metrics-daemon-mbj8w" (UID: "7e5d2e71-1f18-45d0-8c51-c427699635a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:50.984987 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.984951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pf7l\" (UniqueName: \"kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l\") pod \"network-check-target-9b4n4\" (UID: \"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e\") " pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:50.985172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:50.985029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:50.985172 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:50.985143    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:50.985284 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:50.985205    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret podName:1a9da7d4-021f-4706-b439-b2ddd6a0920f nodeName:}" failed. No retries permitted until 2026-07-11 03:48:52.985188647 +0000 UTC m=+6.170341098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret") pod "global-pull-secret-syncer-tf67l" (UID: "1a9da7d4-021f-4706-b439-b2ddd6a0920f") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:50.985381 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:50.985295    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:50.985381 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:50.985310    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:50.985381 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:50.985322    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8pf7l for pod openshift-network-diagnostics/network-check-target-9b4n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:50.985381 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:50.985381    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l podName:ef9cd125-a8d4-4fe4-9be1-afbe87875c1e nodeName:}" failed. No retries permitted until 2026-07-11 03:48:52.985368344 +0000 UTC m=+6.170520779 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pf7l" (UniqueName: "kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l") pod "network-check-target-9b4n4" (UID: "ef9cd125-a8d4-4fe4-9be1-afbe87875c1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:51.293487 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:51.293405    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 03:43:49 +0000 UTC" deadline="2028-02-08 16:05:40.038884647 +0000 UTC"
Jul 11 03:48:51.293487 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:51.293444    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13860h16m48.745445457s"
Jul 11 03:48:51.474906 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:51.474226    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:51.474906 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:51.474537    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:48:51.529235 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:51.528539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" event={"ID":"60c99255ba345f0d3db4e9acfa74cae1","Type":"ContainerStarted","Data":"e5051ae523f987f181c179800dc9fe1b41b93e93970c22c4369c800b95d32c7c"}
Jul 11 03:48:52.471238 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:52.471204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:52.471718 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:52.471363    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:48:52.471789 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:52.471770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:52.471875 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:52.471853    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:48:52.557115 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:52.554154    2576 generic.go:356] "Generic (PLEG): container finished" podID="43d84e137de07e283f5f187cad00caca" containerID="00888abe39b03f983f8a587fe1dce6284aa59f7a979e37d3b0d06153c5326179" exitCode=0
Jul 11 03:48:52.557115 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:52.554864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" event={"ID":"43d84e137de07e283f5f187cad00caca","Type":"ContainerDied","Data":"00888abe39b03f983f8a587fe1dce6284aa59f7a979e37d3b0d06153c5326179"}
Jul 11 03:48:52.899386 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:52.899291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:52.899550 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:52.899512    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:52.899612 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:52.899578    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs podName:7e5d2e71-1f18-45d0-8c51-c427699635a2 nodeName:}" failed. No retries permitted until 2026-07-11 03:48:56.899557601 +0000 UTC m=+10.084710050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs") pod "network-metrics-daemon-mbj8w" (UID: "7e5d2e71-1f18-45d0-8c51-c427699635a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:53.000542 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:53.000507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:53.000715 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:53.000586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pf7l\" (UniqueName: \"kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l\") pod \"network-check-target-9b4n4\" (UID: \"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e\") " pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:53.000777 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:53.000740    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:53.000777 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:53.000757    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:53.000777 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:53.000771    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8pf7l for pod openshift-network-diagnostics/network-check-target-9b4n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:53.000930 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:53.000829    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l podName:ef9cd125-a8d4-4fe4-9be1-afbe87875c1e nodeName:}" failed. No retries permitted until 2026-07-11 03:48:57.00080961 +0000 UTC m=+10.185962060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pf7l" (UniqueName: "kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l") pod "network-check-target-9b4n4" (UID: "ef9cd125-a8d4-4fe4-9be1-afbe87875c1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:53.001304 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:53.001217    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:53.001304 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:53.001271    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret podName:1a9da7d4-021f-4706-b439-b2ddd6a0920f nodeName:}" failed. No retries permitted until 2026-07-11 03:48:57.001257082 +0000 UTC m=+10.186409548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret") pod "global-pull-secret-syncer-tf67l" (UID: "1a9da7d4-021f-4706-b439-b2ddd6a0920f") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:53.476439 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:53.475960    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:53.476439 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:53.476093    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:48:53.570076 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:53.569702    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-235.ec2.internal" podStartSLOduration=5.569681821 podStartE2EDuration="5.569681821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:48:51.542134649 +0000 UTC m=+4.727287099" watchObservedRunningTime="2026-07-11 03:48:53.569681821 +0000 UTC m=+6.754834278"
Jul 11 03:48:54.471757 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:54.471574    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:54.471757 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:54.471588    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:54.471757 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:54.471721    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:48:54.471757 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:54.471745    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:48:55.470936 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:55.470907    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:55.471392 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:55.471035    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:48:56.472255 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:56.471851    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:56.472255 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:56.471988    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:48:56.472255 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:56.471851    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:56.472844 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:56.472313    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:48:56.933415 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:56.933311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:56.933587 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:56.933444    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:56.933587 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:56.933517    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs podName:7e5d2e71-1f18-45d0-8c51-c427699635a2 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:04.933496187 +0000 UTC m=+18.118648634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs") pod "network-metrics-daemon-mbj8w" (UID: "7e5d2e71-1f18-45d0-8c51-c427699635a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:48:57.034050 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:57.034008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pf7l\" (UniqueName: \"kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l\") pod \"network-check-target-9b4n4\" (UID: \"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e\") " pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:57.034228 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:57.034084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:57.034228 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:57.034208    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:57.034414 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:57.034238    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:48:57.034414 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:57.034262    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:48:57.034414 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:57.034277    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8pf7l for pod openshift-network-diagnostics/network-check-target-9b4n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:57.034414 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:57.034264    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret podName:1a9da7d4-021f-4706-b439-b2ddd6a0920f nodeName:}" failed. No retries permitted until 2026-07-11 03:49:05.034246658 +0000 UTC m=+18.219399102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret") pod "global-pull-secret-syncer-tf67l" (UID: "1a9da7d4-021f-4706-b439-b2ddd6a0920f") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:48:57.034414 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:57.034358    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l podName:ef9cd125-a8d4-4fe4-9be1-afbe87875c1e nodeName:}" failed. No retries permitted until 2026-07-11 03:49:05.034340914 +0000 UTC m=+18.219493355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pf7l" (UniqueName: "kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l") pod "network-check-target-9b4n4" (UID: "ef9cd125-a8d4-4fe4-9be1-afbe87875c1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:48:57.475535 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:57.475475    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:57.475876 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:57.475682    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:48:58.471940 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:58.471901    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:48:58.472116 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:58.472047    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:48:58.472372 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:58.471901    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:48:58.472372 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:58.472340    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:48:59.472247 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:48:59.471746    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:48:59.472247 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:48:59.471876    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:00.471242 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:00.471216    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:00.471419 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:00.471248    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:00.471419 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:00.471392    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:00.471537 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:00.471517    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:01.471580 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:01.471547    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:01.471976 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:01.471689    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:02.471351 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:02.471303    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:02.471521 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:02.471301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:02.471521 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:02.471455    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:02.471920 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:02.471577    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:03.471322 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:03.471291    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:03.471480 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:03.471415    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:04.471657 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:04.471630    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:04.472020 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:04.471635    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:04.472020 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:04.471725    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:04.472020 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:04.471814    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:04.994733 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:04.994696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:04.994909 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:04.994853    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:49:04.994952 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:04.994928    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs podName:7e5d2e71-1f18-45d0-8c51-c427699635a2 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:20.994910602 +0000 UTC m=+34.180063055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs") pod "network-metrics-daemon-mbj8w" (UID: "7e5d2e71-1f18-45d0-8c51-c427699635a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:49:05.095075 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:05.095026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:05.095237 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:05.095107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pf7l\" (UniqueName: \"kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l\") pod \"network-check-target-9b4n4\" (UID: \"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e\") " pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:05.095237 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:05.095171    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:49:05.095237 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:05.095219    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:49:05.095237 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:05.095232    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:49:05.095413 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:05.095243    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8pf7l for pod openshift-network-diagnostics/network-check-target-9b4n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:49:05.095413 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:05.095249    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret podName:1a9da7d4-021f-4706-b439-b2ddd6a0920f nodeName:}" failed. No retries permitted until 2026-07-11 03:49:21.095229514 +0000 UTC m=+34.280381950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret") pod "global-pull-secret-syncer-tf67l" (UID: "1a9da7d4-021f-4706-b439-b2ddd6a0920f") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:49:05.095413 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:05.095288    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l podName:ef9cd125-a8d4-4fe4-9be1-afbe87875c1e nodeName:}" failed. No retries permitted until 2026-07-11 03:49:21.095276239 +0000 UTC m=+34.280428676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pf7l" (UniqueName: "kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l") pod "network-check-target-9b4n4" (UID: "ef9cd125-a8d4-4fe4-9be1-afbe87875c1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:49:05.471485 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:05.471407    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:05.471652 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:05.471546    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:06.471455 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:06.471421    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:06.471864 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:06.471420    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:06.471864 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:06.471564    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:06.471864 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:06.471642    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:07.472341 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:07.472302    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:07.472862 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:07.472415    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:08.471596 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:08.471566    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:08.471758 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:08.471611    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:08.471758 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:08.471700    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:08.471864 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:08.471816    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:09.472169 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.471869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:09.472731 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:09.472267    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:09.586115 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.586090    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n" event={"ID":"f9671b82-8571-4728-885f-f6ea90cd0d63","Type":"ContainerStarted","Data":"4fca37b2a1d9783fc10d1b82c643a2dafb4d14f9e6240b38d0148ad50cbfa59a"}
Jul 11 03:49:09.587738 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.587706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v4wlk" event={"ID":"f364bdf1-bfa9-46cb-a769-14ddeec413b6","Type":"ContainerStarted","Data":"2f27a1a14233f914cb244980b6fc42a23f248dc8070fb92f6064e0c1a33410d5"}
Jul 11 03:49:09.589743 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.589720    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" event={"ID":"43d84e137de07e283f5f187cad00caca","Type":"ContainerStarted","Data":"c6da509fd331b6055d74f90bea90b3cd7b66320da12b5d2b563bbad8abc87434"}
Jul 11 03:49:09.591452 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.591430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x5m6q" event={"ID":"2ca8fb3b-f82b-4e71-8282-8bba0e901ad2","Type":"ContainerStarted","Data":"4ab15cd2c0263994098ac8ed09d7de05ef49b9a6ff04144c286b1c888c7c493f"}
Jul 11 03:49:09.593040 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.593014    2576 generic.go:356] "Generic (PLEG): container finished" podID="f0f52cfa-a9db-409f-8edb-c4f10af04750" containerID="e34dccc16576250ab6dda0e3ad577bce5484817ff0995802ae30741e9e291bb1" exitCode=0
Jul 11 03:49:09.593139 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.593058    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4q8zm" event={"ID":"f0f52cfa-a9db-409f-8edb-c4f10af04750","Type":"ContainerDied","Data":"e34dccc16576250ab6dda0e3ad577bce5484817ff0995802ae30741e9e291bb1"}
Jul 11 03:49:09.596911 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.596868    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p" event={"ID":"df6b9282-b6c8-4cda-b7b1-f13643bdb788","Type":"ContainerStarted","Data":"e05f2a25e7c23342af117707f98b053f87d8918f9a71b03c13fef09ee7323b11"}
Jul 11 03:49:09.597006 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.596947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p" event={"ID":"df6b9282-b6c8-4cda-b7b1-f13643bdb788","Type":"ContainerStarted","Data":"a189be6af4b6128a72c0924251eb94fd19bcf2fd54ea942326c734893637a3fa"}
Jul 11 03:49:09.597006 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.596996    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p" event={"ID":"df6b9282-b6c8-4cda-b7b1-f13643bdb788","Type":"ContainerStarted","Data":"9ca7d99af816364fb94d314b8bdbb8417b86d4459103270b245eab386617937a"}
Jul 11 03:49:09.597127 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.597044    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p" event={"ID":"df6b9282-b6c8-4cda-b7b1-f13643bdb788","Type":"ContainerStarted","Data":"de2014014a8b9c9c4592e82c1877e08137d31d0d2044e6be75f33099cceeaec8"}
Jul 11 03:49:09.597127 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.597091    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p" event={"ID":"df6b9282-b6c8-4cda-b7b1-f13643bdb788","Type":"ContainerStarted","Data":"bedf900d4370b6a711dffef25a9f75dbe8364db2a0b491baa2c0b45047c501d7"}
Jul 11 03:49:09.598310 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.598289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lpvjc" event={"ID":"520f5f45-088b-42b0-8dbd-e2dbea4e16aa","Type":"ContainerStarted","Data":"00900c5919777874db4a3f0522a30eee9345ddfb8ab84201959ec5db5f8dca06"}
Jul 11 03:49:09.599748 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.599729    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qqqn6" event={"ID":"346ec1a0-1923-4eb9-b674-34726aa9d2fa","Type":"ContainerStarted","Data":"657abb3649ac4a63daafec83a83bfb2d0578afab314d920af0aa37b68dd8cce7"}
Jul 11 03:49:09.601556 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.601533    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k6fbh" event={"ID":"ebe1a2df-bb0d-4d20-854d-3491761f447f","Type":"ContainerStarted","Data":"e8a9a967373166da481409c91de2b11552f445688c096ffa9c4be1465ecbf346"}
Jul 11 03:49:09.602596 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.602553    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v4wlk" podStartSLOduration=3.371939111 podStartE2EDuration="22.602538115s" totalImagesPullingTime="19.230599004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:09.602126423 +0000 UTC m=+22.787278879" watchObservedRunningTime="2026-07-11 03:49:09.602538115 +0000 UTC m=+22.787690571"
Jul 11 03:49:09.631368 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.631313    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k6fbh" podStartSLOduration=3.510456821 podStartE2EDuration="22.631300077s" totalImagesPullingTime="19.120843256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:09.618966652 +0000 UTC m=+22.804119099" watchObservedRunningTime="2026-07-11 03:49:09.631300077 +0000 UTC m=+22.816452532"
Jul 11 03:49:09.631478 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.631448    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qqqn6" podStartSLOduration=3.519645813 podStartE2EDuration="22.631439223s" totalImagesPullingTime="19.11179341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:09.630988493 +0000 UTC m=+22.816140947" watchObservedRunningTime="2026-07-11 03:49:09.631439223 +0000 UTC m=+22.816591679"
Jul 11 03:49:09.643370 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.643320    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-235.ec2.internal" podStartSLOduration=21.643306823 podStartE2EDuration="21.643306823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:09.643156397 +0000 UTC m=+22.828308853" watchObservedRunningTime="2026-07-11 03:49:09.643306823 +0000 UTC m=+22.828459278"
Jul 11 03:49:09.670010 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.669973    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x5m6q" podStartSLOduration=3.529319414 podStartE2EDuration="22.669962095s" totalImagesPullingTime="19.140642681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:09.65582423 +0000 UTC m=+22.840976684" watchObservedRunningTime="2026-07-11 03:49:09.669962095 +0000 UTC m=+22.855114562"
Jul 11 03:49:09.670120 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:09.670103    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lpvjc" podStartSLOduration=3.556053808 podStartE2EDuration="22.670098006s" totalImagesPullingTime="19.114044198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:09.669785311 +0000 UTC m=+22.854937766" watchObservedRunningTime="2026-07-11 03:49:09.670098006 +0000 UTC m=+22.855250460"
Jul 11 03:49:10.317055 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:10.317022    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 11 03:49:10.344011 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:10.343877    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T03:49:10.317040546Z","UUID":"f8bfb706-5b06-4b62-bfd6-3792e140010d","Handler":null,"Name":"","Endpoint":""}
Jul 11 03:49:10.345446 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:10.345426    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 11 03:49:10.345542 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:10.345461    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 11 03:49:10.471633 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:10.471607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:10.471830 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:10.471701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:10.471830 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:10.471706    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:10.471939 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:10.471834    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:10.606010 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:10.605932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n" event={"ID":"f9671b82-8571-4728-885f-f6ea90cd0d63","Type":"ContainerStarted","Data":"bff2ea6d44e8c65aae8e003360bd45d820f02148da8c657886e5da08357a5f6b"}
Jul 11 03:49:10.607531 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:10.607506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s2v4d" event={"ID":"2edc2d2b-403e-4dc0-ac97-1f12aa3a7d96","Type":"ContainerStarted","Data":"a56dfba484488e7d45ff43e09ba5e95e5695fa77e4e827e893a7c20e92dbc0be"}
Jul 11 03:49:10.610539 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:10.610475    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p" event={"ID":"df6b9282-b6c8-4cda-b7b1-f13643bdb788","Type":"ContainerStarted","Data":"933eb90e05debc8d68cd3da13dc95df0b3e197b135e14e8d6bf0bb13d5da525e"}
Jul 11 03:49:10.621356 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:10.621303    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s2v4d" podStartSLOduration=4.446905144 podStartE2EDuration="23.621289143s" totalImagesPullingTime="19.174383999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:10.621076525 +0000 UTC m=+23.806228982" watchObservedRunningTime="2026-07-11 03:49:10.621289143 +0000 UTC m=+23.806441597"
Jul 11 03:49:11.471256 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:11.471224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:11.471631 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:11.471362    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:12.471385 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:12.471195    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:12.471930 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:12.471263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:12.471930 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:12.471486    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:12.471930 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:12.471543    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:12.617952 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:12.617909    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n" event={"ID":"f9671b82-8571-4728-885f-f6ea90cd0d63","Type":"ContainerStarted","Data":"b1085478b5f02edb4fa9046c6eae9f37d3466916dbb785d6ab4f9bef93fe2cd2"}
Jul 11 03:49:12.621577 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:12.621552    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p" event={"ID":"df6b9282-b6c8-4cda-b7b1-f13643bdb788","Type":"ContainerStarted","Data":"718707b332963dd2c1ece1545acbb4eef1ce3f9edb7977aee302dd9ba5c4a6a7"}
Jul 11 03:49:12.638187 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:12.638150    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bhc8n" podStartSLOduration=3.936871956 podStartE2EDuration="25.638139304s" totalImagesPullingTime="21.701267348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:12.637144496 +0000 UTC m=+25.822296951" watchObservedRunningTime="2026-07-11 03:49:12.638139304 +0000 UTC m=+25.823291758"
Jul 11 03:49:12.781550 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:12.781481    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:49:12.782040 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:12.782021    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:49:13.471740 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:13.471702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:13.472354 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:13.471827    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:13.623966 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:13.623932    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:49:13.624453 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:13.624431    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x5m6q"
Jul 11 03:49:14.470964 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:14.470903    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:14.471321 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:14.471019    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:14.471321 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:14.471078    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:14.471321 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:14.471176    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:14.629283 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:14.629113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p" event={"ID":"df6b9282-b6c8-4cda-b7b1-f13643bdb788","Type":"ContainerStarted","Data":"a809224e3fe5e6b84f252c4bf2c666c57962d20a0b071db2bfb65b9b33ad75de"}
Jul 11 03:49:14.655648 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:14.654099    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p" podStartSLOduration=8.387357798 podStartE2EDuration="27.654079822s" totalImagesPullingTime="19.266722024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:14.653186065 +0000 UTC m=+27.838338521" watchObservedRunningTime="2026-07-11 03:49:14.654079822 +0000 UTC m=+27.839232277"
Jul 11 03:49:15.471925 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:15.471890    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:15.472093 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:15.471999    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:15.632725 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:15.632687    2576 generic.go:356] "Generic (PLEG): container finished" podID="f0f52cfa-a9db-409f-8edb-c4f10af04750" containerID="871dfdf6ce58e74157c7142ab0781acff78a213d897beea5835b744c8fcb814a" exitCode=0
Jul 11 03:49:15.633125 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:15.632761    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4q8zm" event={"ID":"f0f52cfa-a9db-409f-8edb-c4f10af04750","Type":"ContainerDied","Data":"871dfdf6ce58e74157c7142ab0781acff78a213d897beea5835b744c8fcb814a"}
Jul 11 03:49:15.633365 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:15.633303    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:49:15.633477 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:15.633390    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:49:15.633477 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:15.633438    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:49:15.648511 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:15.648488    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:49:15.648623 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:15.648600    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:49:16.471064 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:16.471032    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:16.471064 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:16.471071    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:16.471364 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:16.471162    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:16.471364 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:16.471269    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:17.472450 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:17.472412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:17.472918 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:17.472506    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:17.638473 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:17.638440    2576 generic.go:356] "Generic (PLEG): container finished" podID="f0f52cfa-a9db-409f-8edb-c4f10af04750" containerID="aa2c3dd87233677f8f57876bed3594dcc225e7297a3b3b9c6f5bf340d0b1df9d" exitCode=0
Jul 11 03:49:17.638632 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:17.638520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4q8zm" event={"ID":"f0f52cfa-a9db-409f-8edb-c4f10af04750","Type":"ContainerDied","Data":"aa2c3dd87233677f8f57876bed3594dcc225e7297a3b3b9c6f5bf340d0b1df9d"}
Jul 11 03:49:18.471801 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:18.471765    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:18.471952 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:18.471921    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:18.472027 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:18.471952    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:18.472115 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:18.472092    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:19.471144 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:19.471117    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:19.471628 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:19.471593    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:19.645063 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:19.645027    2576 generic.go:356] "Generic (PLEG): container finished" podID="f0f52cfa-a9db-409f-8edb-c4f10af04750" containerID="e509535d46b70ce03df98fcbceb717a3f79dec747aeb21335ec57ddfedee2eac" exitCode=0
Jul 11 03:49:19.645209 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:19.645104    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4q8zm" event={"ID":"f0f52cfa-a9db-409f-8edb-c4f10af04750","Type":"ContainerDied","Data":"e509535d46b70ce03df98fcbceb717a3f79dec747aeb21335ec57ddfedee2eac"}
Jul 11 03:49:20.471911 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:20.471883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:20.472417 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:20.471883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:20.472417 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:20.472003    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:20.472417 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:20.472057    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:21.013802 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:21.013766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:21.013994 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:21.013906    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:49:21.013994 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:21.013963    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs podName:7e5d2e71-1f18-45d0-8c51-c427699635a2 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:53.013946225 +0000 UTC m=+66.199098676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs") pod "network-metrics-daemon-mbj8w" (UID: "7e5d2e71-1f18-45d0-8c51-c427699635a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 03:49:21.114100 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:21.114069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pf7l\" (UniqueName: \"kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l\") pod \"network-check-target-9b4n4\" (UID: \"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e\") " pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:21.114292 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:21.114118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:21.114292 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:21.114224    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 03:49:21.114292 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:21.114254    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 03:49:21.114292 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:21.114277    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret podName:1a9da7d4-021f-4706-b439-b2ddd6a0920f nodeName:}" failed. No retries permitted until 2026-07-11 03:49:53.114260752 +0000 UTC m=+66.299413190 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret") pod "global-pull-secret-syncer-tf67l" (UID: "1a9da7d4-021f-4706-b439-b2ddd6a0920f") : object "kube-system"/"original-pull-secret" not registered
Jul 11 03:49:21.114292 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:21.114277    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 03:49:21.114292 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:21.114293    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8pf7l for pod openshift-network-diagnostics/network-check-target-9b4n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:49:21.114650 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:21.114317    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l podName:ef9cd125-a8d4-4fe4-9be1-afbe87875c1e nodeName:}" failed. No retries permitted until 2026-07-11 03:49:53.114309537 +0000 UTC m=+66.299461970 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8pf7l" (UniqueName: "kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l") pod "network-check-target-9b4n4" (UID: "ef9cd125-a8d4-4fe4-9be1-afbe87875c1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 03:49:21.471171 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:21.471090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:21.471355 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:21.471229    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:22.471430 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:22.471395    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:22.471870 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:22.471396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:22.471870 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:22.471532    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:22.471870 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:22.471631    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:23.471523 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:23.471489    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:23.471967 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:23.471623    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:24.471465 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:24.471424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:24.471573 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:24.471424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:24.471795 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:24.471638    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:24.471795 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:24.471553    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:24.658944 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:24.658858    2576 generic.go:356] "Generic (PLEG): container finished" podID="f0f52cfa-a9db-409f-8edb-c4f10af04750" containerID="2a459ee8b982f636759cd23dcc26f0dc805a92461f23c1d0c60aff457b1f98b8" exitCode=0
Jul 11 03:49:24.658944 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:24.658911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4q8zm" event={"ID":"f0f52cfa-a9db-409f-8edb-c4f10af04750","Type":"ContainerDied","Data":"2a459ee8b982f636759cd23dcc26f0dc805a92461f23c1d0c60aff457b1f98b8"}
Jul 11 03:49:25.471520 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:25.471495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:25.471680 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:25.471587    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:25.663920 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:25.663888    2576 generic.go:356] "Generic (PLEG): container finished" podID="f0f52cfa-a9db-409f-8edb-c4f10af04750" containerID="7132441f54c5a26ccd693fb09d766aa387fd1366461ab720aedf7b95b30e6311" exitCode=0
Jul 11 03:49:25.664065 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:25.663932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4q8zm" event={"ID":"f0f52cfa-a9db-409f-8edb-c4f10af04750","Type":"ContainerDied","Data":"7132441f54c5a26ccd693fb09d766aa387fd1366461ab720aedf7b95b30e6311"}
Jul 11 03:49:26.471645 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:26.471618    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:26.471807 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:26.471713    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:26.471807 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:26.471761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:26.472097 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:26.471852    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:26.668504 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:26.668473    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4q8zm" event={"ID":"f0f52cfa-a9db-409f-8edb-c4f10af04750","Type":"ContainerStarted","Data":"af969819214c5f262b2496ef58fb7a6c6e865490c3a9b0ede2c785deb45d0456"}
Jul 11 03:49:26.689227 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:26.689188    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4q8zm" podStartSLOduration=8.298162629 podStartE2EDuration="39.689175454s" totalImagesPullingTime="31.391012825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:26.687986805 +0000 UTC m=+39.873139259" watchObservedRunningTime="2026-07-11 03:49:26.689175454 +0000 UTC m=+39.874327908"
Jul 11 03:49:27.472521 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:27.472493    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:27.472907 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:27.472573    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:28.470867 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:28.470838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:28.471030 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:28.470841    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:28.471030 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:28.470933    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:28.471030 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:28.471019    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:29.471763 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:29.471724    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:29.472256 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:29.471887    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:30.471139 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:30.471102    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:30.471139 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:30.471131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:30.471350 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:30.471198    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:30.471350 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:30.471319    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:31.474755 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:31.474727    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:31.475133 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:31.474824    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:32.471281 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:32.471251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:32.471543 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:32.471251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:32.471543 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:32.471380    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:32.471543 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:32.471424    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:32.792358 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:32.792308    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tf67l"]
Jul 11 03:49:32.793121 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:32.792463    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:32.793121 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:32.792568    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:32.793121 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:32.792938    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mbj8w"]
Jul 11 03:49:32.793121 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:32.793016    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:32.793121 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:32.793089    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:32.794506 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:32.794482    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9b4n4"]
Jul 11 03:49:32.794628 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:32.794554    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:32.794692 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:32.794621    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:34.471421 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:34.471385    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:34.471875 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:34.471483    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:34.471875 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:34.471486    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:34.471875 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:34.471514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:34.471875 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:34.471605    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:34.471875 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:34.471702    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:36.471919 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:36.471745    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:36.472409 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:36.471763    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:36.472409 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:36.472010    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf67l" podUID="1a9da7d4-021f-4706-b439-b2ddd6a0920f"
Jul 11 03:49:36.472409 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:36.471766    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:36.472409 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:36.472057    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9b4n4" podUID="ef9cd125-a8d4-4fe4-9be1-afbe87875c1e"
Jul 11 03:49:36.472409 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:36.472128    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbj8w" podUID="7e5d2e71-1f18-45d0-8c51-c427699635a2"
Jul 11 03:49:37.609979 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.609904    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-235.ec2.internal" event="NodeReady"
Jul 11 03:49:37.610473 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.610046    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 11 03:49:37.652533 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.652503    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7r8z7"]
Jul 11 03:49:37.663194 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.663173    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-79qjw"]
Jul 11 03:49:37.663360 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.663318    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.665496 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.665465    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 11 03:49:37.665680 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.665465    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 11 03:49:37.665680 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.665599    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lzk9c\""
Jul 11 03:49:37.671751 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.671695    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7r8z7"]
Jul 11 03:49:37.671751 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.671735    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-79qjw"]
Jul 11 03:49:37.671871 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.671821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.673543 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.673525    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sm7jf"]
Jul 11 03:49:37.674029 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.674007    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 11 03:49:37.674157 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.674142    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 11 03:49:37.674157 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.674151    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 11 03:49:37.674275 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.674156    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 11 03:49:37.674275 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.674249    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cjtvr\""
Jul 11 03:49:37.685145 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.685125    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sm7jf"]
Jul 11 03:49:37.685231 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.685201    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sm7jf"
Jul 11 03:49:37.687234 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.687218    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 11 03:49:37.687359 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.687250    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 11 03:49:37.687476 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.687463    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mltsp\""
Jul 11 03:49:37.687540 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.687494    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 11 03:49:37.734818 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.734785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c39fcb0-6c2f-4123-89be-d9313f6241b6-config-volume\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.734818 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.734813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c39fcb0-6c2f-4123-89be-d9313f6241b6-tmp-dir\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.735041 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.734832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea4917b0-b805-41cf-a23a-e3f00f4dc916-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.735041 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.734906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/298f543f-98b3-4a17-9c72-9fd9af488377-cert\") pod \"ingress-canary-sm7jf\" (UID: \"298f543f-98b3-4a17-9c72-9fd9af488377\") " pod="openshift-ingress-canary/ingress-canary-sm7jf"
Jul 11 03:49:37.735041 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.734940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngdtv\" (UniqueName: \"kubernetes.io/projected/298f543f-98b3-4a17-9c72-9fd9af488377-kube-api-access-ngdtv\") pod \"ingress-canary-sm7jf\" (UID: \"298f543f-98b3-4a17-9c72-9fd9af488377\") " pod="openshift-ingress-canary/ingress-canary-sm7jf"
Jul 11 03:49:37.735041 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.734964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea4917b0-b805-41cf-a23a-e3f00f4dc916-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.735041 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.735024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c39fcb0-6c2f-4123-89be-d9313f6241b6-metrics-tls\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.735230 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.735061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea4917b0-b805-41cf-a23a-e3f00f4dc916-crio-socket\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.735230 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.735114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjnwt\" (UniqueName: \"kubernetes.io/projected/9c39fcb0-6c2f-4123-89be-d9313f6241b6-kube-api-access-vjnwt\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.735230 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.735135    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea4917b0-b805-41cf-a23a-e3f00f4dc916-data-volume\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.735230 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.735154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvzpz\" (UniqueName: \"kubernetes.io/projected/ea4917b0-b805-41cf-a23a-e3f00f4dc916-kube-api-access-cvzpz\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.835909 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.835873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c39fcb0-6c2f-4123-89be-d9313f6241b6-metrics-tls\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.835909 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.835907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea4917b0-b805-41cf-a23a-e3f00f4dc916-crio-socket\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.836095 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.835931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjnwt\" (UniqueName: \"kubernetes.io/projected/9c39fcb0-6c2f-4123-89be-d9313f6241b6-kube-api-access-vjnwt\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.836095 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.835947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea4917b0-b805-41cf-a23a-e3f00f4dc916-data-volume\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.836095 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.835976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvzpz\" (UniqueName: \"kubernetes.io/projected/ea4917b0-b805-41cf-a23a-e3f00f4dc916-kube-api-access-cvzpz\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.836095 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.836010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c39fcb0-6c2f-4123-89be-d9313f6241b6-config-volume\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.836095 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.836032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c39fcb0-6c2f-4123-89be-d9313f6241b6-tmp-dir\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.836095 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.836052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea4917b0-b805-41cf-a23a-e3f00f4dc916-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.836416 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.836118    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea4917b0-b805-41cf-a23a-e3f00f4dc916-crio-socket\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.836416 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.836159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/298f543f-98b3-4a17-9c72-9fd9af488377-cert\") pod \"ingress-canary-sm7jf\" (UID: \"298f543f-98b3-4a17-9c72-9fd9af488377\") " pod="openshift-ingress-canary/ingress-canary-sm7jf"
Jul 11 03:49:37.836416 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.836200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngdtv\" (UniqueName: \"kubernetes.io/projected/298f543f-98b3-4a17-9c72-9fd9af488377-kube-api-access-ngdtv\") pod \"ingress-canary-sm7jf\" (UID: \"298f543f-98b3-4a17-9c72-9fd9af488377\") " pod="openshift-ingress-canary/ingress-canary-sm7jf"
Jul 11 03:49:37.836416 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.836228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea4917b0-b805-41cf-a23a-e3f00f4dc916-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.836416 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.836302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea4917b0-b805-41cf-a23a-e3f00f4dc916-data-volume\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.836665 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.836637    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c39fcb0-6c2f-4123-89be-d9313f6241b6-tmp-dir\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.836794 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.836773    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea4917b0-b805-41cf-a23a-e3f00f4dc916-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.836963 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.836929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c39fcb0-6c2f-4123-89be-d9313f6241b6-config-volume\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.840118 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.840092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/298f543f-98b3-4a17-9c72-9fd9af488377-cert\") pod \"ingress-canary-sm7jf\" (UID: \"298f543f-98b3-4a17-9c72-9fd9af488377\") " pod="openshift-ingress-canary/ingress-canary-sm7jf"
Jul 11 03:49:37.840118 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.840102    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea4917b0-b805-41cf-a23a-e3f00f4dc916-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.840235 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.840102    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c39fcb0-6c2f-4123-89be-d9313f6241b6-metrics-tls\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.842979 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.842952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvzpz\" (UniqueName: \"kubernetes.io/projected/ea4917b0-b805-41cf-a23a-e3f00f4dc916-kube-api-access-cvzpz\") pod \"insights-runtime-extractor-79qjw\" (UID: \"ea4917b0-b805-41cf-a23a-e3f00f4dc916\") " pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.843076 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.843047    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjnwt\" (UniqueName: \"kubernetes.io/projected/9c39fcb0-6c2f-4123-89be-d9313f6241b6-kube-api-access-vjnwt\") pod \"dns-default-7r8z7\" (UID: \"9c39fcb0-6c2f-4123-89be-d9313f6241b6\") " pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.843453 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.843434    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngdtv\" (UniqueName: \"kubernetes.io/projected/298f543f-98b3-4a17-9c72-9fd9af488377-kube-api-access-ngdtv\") pod \"ingress-canary-sm7jf\" (UID: \"298f543f-98b3-4a17-9c72-9fd9af488377\") " pod="openshift-ingress-canary/ingress-canary-sm7jf"
Jul 11 03:49:37.974487 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.974396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:37.981353 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.981305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-79qjw"
Jul 11 03:49:37.993613 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:37.993592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sm7jf"
Jul 11 03:49:38.127891 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.127866    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-79qjw"]
Jul 11 03:49:38.132576 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.132555    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sm7jf"]
Jul 11 03:49:38.135236 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.135212    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7r8z7"]
Jul 11 03:49:38.135514 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:49:38.135496    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod298f543f_98b3_4a17_9c72_9fd9af488377.slice/crio-4633f54d8677784b7cf473932bb603d4a5b3b8a3acef71164670b997455dfd03 WatchSource:0}: Error finding container 4633f54d8677784b7cf473932bb603d4a5b3b8a3acef71164670b997455dfd03: Status 404 returned error can't find the container with id 4633f54d8677784b7cf473932bb603d4a5b3b8a3acef71164670b997455dfd03
Jul 11 03:49:38.138561 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:49:38.138535    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c39fcb0_6c2f_4123_89be_d9313f6241b6.slice/crio-ccc067d217d7d558684bdbb96e74bd4b21b70655bf34ce26496d7b505bf21126 WatchSource:0}: Error finding container ccc067d217d7d558684bdbb96e74bd4b21b70655bf34ce26496d7b505bf21126: Status 404 returned error can't find the container with id ccc067d217d7d558684bdbb96e74bd4b21b70655bf34ce26496d7b505bf21126
Jul 11 03:49:38.471474 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.471438    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:38.471624 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.471527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:38.471696 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.471644    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:38.473947 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.473922    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 03:49:38.474812 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.474788    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kfp2p\""
Jul 11 03:49:38.474922 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.474837    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 03:49:38.474922 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.474836    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 03:49:38.474922 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.474898    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 03:49:38.475053 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.475037    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zgqwh\""
Jul 11 03:49:38.699222 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.699097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sm7jf" event={"ID":"298f543f-98b3-4a17-9c72-9fd9af488377","Type":"ContainerStarted","Data":"4633f54d8677784b7cf473932bb603d4a5b3b8a3acef71164670b997455dfd03"}
Jul 11 03:49:38.702505 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.701895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79qjw" event={"ID":"ea4917b0-b805-41cf-a23a-e3f00f4dc916","Type":"ContainerStarted","Data":"5e0f316767489b6401fec396e955aff74d8efd09cb2a15e5911ab921daa664b1"}
Jul 11 03:49:38.705403 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:38.705375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7r8z7" event={"ID":"9c39fcb0-6c2f-4123-89be-d9313f6241b6","Type":"ContainerStarted","Data":"ccc067d217d7d558684bdbb96e74bd4b21b70655bf34ce26496d7b505bf21126"}
Jul 11 03:49:43.720678 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:43.720473    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7r8z7" event={"ID":"9c39fcb0-6c2f-4123-89be-d9313f6241b6","Type":"ContainerStarted","Data":"7b72be9fb2e73fcf30f254272266d0e1fdd325d075b3dcd0e38dfcd3c363674a"}
Jul 11 03:49:43.721061 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:43.720744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7r8z7" event={"ID":"9c39fcb0-6c2f-4123-89be-d9313f6241b6","Type":"ContainerStarted","Data":"59b243ea74ebe79419870e7f1a8b0cc2a7a97fdb7d85afca7853260d2a61315b"}
Jul 11 03:49:43.721061 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:43.720778    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:43.722021 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:43.721995    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sm7jf" event={"ID":"298f543f-98b3-4a17-9c72-9fd9af488377","Type":"ContainerStarted","Data":"68c557b78614cdfac7be98833781c874d75097b67cae3b69a4b2c4de40c5bf33"}
Jul 11 03:49:43.723662 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:43.723644    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79qjw" event={"ID":"ea4917b0-b805-41cf-a23a-e3f00f4dc916","Type":"ContainerStarted","Data":"5379f65eb165a55acdb01fa9247f6b22a3fe0e17f7b5355b3ba9f93b947dfac8"}
Jul 11 03:49:43.723750 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:43.723681    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79qjw" event={"ID":"ea4917b0-b805-41cf-a23a-e3f00f4dc916","Type":"ContainerStarted","Data":"9158d109f8467af7a34ce24e1725cb9bfcb17a5ed23f271bfa07815080fd69e2"}
Jul 11 03:49:43.751409 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:43.751362    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7r8z7" podStartSLOduration=2.228208272 podStartE2EDuration="6.751349474s" totalImagesPullingTime="4.523141202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:43.734782567 +0000 UTC m=+56.919935022" watchObservedRunningTime="2026-07-11 03:49:43.751349474 +0000 UTC m=+56.936501920"
Jul 11 03:49:43.751671 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:43.751644    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sm7jf" podStartSLOduration=1.905897733 podStartE2EDuration="6.751636968s" totalImagesPullingTime="4.845739235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:43.750973099 +0000 UTC m=+56.936125555" watchObservedRunningTime="2026-07-11 03:49:43.751636968 +0000 UTC m=+56.936789401"
Jul 11 03:49:46.178417 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.178390    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xkmm2"]
Jul 11 03:49:46.180859 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.180845    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.183064 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.183045    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 11 03:49:46.183166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.183053    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 11 03:49:46.184294 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.184275    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6cccj\""
Jul 11 03:49:46.184294 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.184285    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 11 03:49:46.184454 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.184306    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 11 03:49:46.184454 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.184348    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 11 03:49:46.188168 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.188150    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xkmm2"]
Jul 11 03:49:46.201166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.201143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82126a0c-b9a6-43e0-8981-4987232f0372-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.201263 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.201181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82126a0c-b9a6-43e0-8981-4987232f0372-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.201263 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.201244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g72s6\" (UniqueName: \"kubernetes.io/projected/82126a0c-b9a6-43e0-8981-4987232f0372-kube-api-access-g72s6\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.201363 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.201315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82126a0c-b9a6-43e0-8981-4987232f0372-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.302259 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.302236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82126a0c-b9a6-43e0-8981-4987232f0372-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.302393 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.302273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82126a0c-b9a6-43e0-8981-4987232f0372-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.302393 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.302292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82126a0c-b9a6-43e0-8981-4987232f0372-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.302393 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.302348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g72s6\" (UniqueName: \"kubernetes.io/projected/82126a0c-b9a6-43e0-8981-4987232f0372-kube-api-access-g72s6\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.302860 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.302843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82126a0c-b9a6-43e0-8981-4987232f0372-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.305549 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.305498    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82126a0c-b9a6-43e0-8981-4987232f0372-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.305549 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.305506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82126a0c-b9a6-43e0-8981-4987232f0372-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.309798 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.309777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g72s6\" (UniqueName: \"kubernetes.io/projected/82126a0c-b9a6-43e0-8981-4987232f0372-kube-api-access-g72s6\") pod \"prometheus-operator-64785b6675-xkmm2\" (UID: \"82126a0c-b9a6-43e0-8981-4987232f0372\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.489340 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.489276    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2"
Jul 11 03:49:46.605399 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.605372    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xkmm2"]
Jul 11 03:49:46.608453 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:49:46.608429    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82126a0c_b9a6_43e0_8981_4987232f0372.slice/crio-a66636d8a4e1de46533ec571f865c47edf5242f4d825e1f88b11b36b5a521290 WatchSource:0}: Error finding container a66636d8a4e1de46533ec571f865c47edf5242f4d825e1f88b11b36b5a521290: Status 404 returned error can't find the container with id a66636d8a4e1de46533ec571f865c47edf5242f4d825e1f88b11b36b5a521290
Jul 11 03:49:46.734031 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.733990    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79qjw" event={"ID":"ea4917b0-b805-41cf-a23a-e3f00f4dc916","Type":"ContainerStarted","Data":"ee62d3c8ddd83d195f2966d85e73b9983c9581179d826d1ee0708dc1b8be080f"}
Jul 11 03:49:46.735000 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.734977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2" event={"ID":"82126a0c-b9a6-43e0-8981-4987232f0372","Type":"ContainerStarted","Data":"a66636d8a4e1de46533ec571f865c47edf5242f4d825e1f88b11b36b5a521290"}
Jul 11 03:49:46.752970 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:46.750764    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-79qjw" podStartSLOduration=1.9617494290000002 podStartE2EDuration="9.750748349s" totalImagesPullingTime="7.78899892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:49:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:46.750471696 +0000 UTC m=+59.935624152" watchObservedRunningTime="2026-07-11 03:49:46.750748349 +0000 UTC m=+59.935900806"
Jul 11 03:49:47.649382 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:47.649345    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-swq4p"
Jul 11 03:49:48.744257 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:48.744216    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2" event={"ID":"82126a0c-b9a6-43e0-8981-4987232f0372","Type":"ContainerStarted","Data":"af4e48540bcbec8b9e70c9fb5b54485b9fc7b6ae9ab2e42e6b63985708359f9c"}
Jul 11 03:49:48.744731 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:48.744309    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2" event={"ID":"82126a0c-b9a6-43e0-8981-4987232f0372","Type":"ContainerStarted","Data":"759863796fb7b482394de41034295fd703c91a777e66076db38b59ab7e2dc5e0"}
Jul 11 03:49:48.759212 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:48.759150    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-xkmm2" podStartSLOduration=1.396262385 podStartE2EDuration="2.759137532s" totalImagesPullingTime="1.362875147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:48.758213839 +0000 UTC m=+61.943366307" watchObservedRunningTime="2026-07-11 03:49:48.759137532 +0000 UTC m=+61.944289987"
Jul 11 03:49:50.555565 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.555510    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2t9l2"]
Jul 11 03:49:50.558397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.558376    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.560434 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.560412    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 11 03:49:50.560897 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.560877    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6zqpj\""
Jul 11 03:49:50.561008 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.560932    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 11 03:49:50.561084 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.561065    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 11 03:49:50.633680 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.633654    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5def14a0-34d5-4beb-8233-b98b08361599-root\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.633781 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.633701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5def14a0-34d5-4beb-8233-b98b08361599-metrics-client-ca\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.633781 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.633726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4qjl\" (UniqueName: \"kubernetes.io/projected/5def14a0-34d5-4beb-8233-b98b08361599-kube-api-access-g4qjl\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.633781 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.633763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-wtmp\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.633876 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.633794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-textfile\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.633876 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.633839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-accelerators-collector-config\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.633941 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.633876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5def14a0-34d5-4beb-8233-b98b08361599-sys\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.633941 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.633905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-tls\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.633941 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.633921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.734775 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.734750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-textfile\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.734906 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.734782    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-accelerators-collector-config\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.734906 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.734818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5def14a0-34d5-4beb-8233-b98b08361599-sys\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.734906 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.734853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-tls\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.734906 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.734877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.735081 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.734906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5def14a0-34d5-4beb-8233-b98b08361599-root\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.735081 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.734951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5def14a0-34d5-4beb-8233-b98b08361599-metrics-client-ca\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.735081 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.734951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5def14a0-34d5-4beb-8233-b98b08361599-sys\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.735081 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.734975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4qjl\" (UniqueName: \"kubernetes.io/projected/5def14a0-34d5-4beb-8233-b98b08361599-kube-api-access-g4qjl\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.735081 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.734983    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5def14a0-34d5-4beb-8233-b98b08361599-root\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.735081 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.735032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-wtmp\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.735388 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:50.735101    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 11 03:49:50.735388 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.735132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-textfile\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.735388 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:50.735168    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-tls podName:5def14a0-34d5-4beb-8233-b98b08361599 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:51.235147693 +0000 UTC m=+64.420300138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-tls") pod "node-exporter-2t9l2" (UID: "5def14a0-34d5-4beb-8233-b98b08361599") : secret "node-exporter-tls" not found
Jul 11 03:49:50.735388 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.735195    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-wtmp\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.735557 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.735503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5def14a0-34d5-4beb-8233-b98b08361599-metrics-client-ca\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.735557 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.735503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-accelerators-collector-config\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.737123 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.737106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:50.744380 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:50.744360    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4qjl\" (UniqueName: \"kubernetes.io/projected/5def14a0-34d5-4beb-8233-b98b08361599-kube-api-access-g4qjl\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:51.238569 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.238534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-tls\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:51.238706 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:51.238650    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 11 03:49:51.238706 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:51.238701    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-tls podName:5def14a0-34d5-4beb-8233-b98b08361599 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:52.238687917 +0000 UTC m=+65.423840349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-tls") pod "node-exporter-2t9l2" (UID: "5def14a0-34d5-4beb-8233-b98b08361599") : secret "node-exporter-tls" not found
Jul 11 03:49:51.591852 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.591820    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 03:49:51.598042 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.594990    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.598725 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.598694    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 11 03:49:51.598835 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.598728    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 11 03:49:51.598835 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.598771    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 11 03:49:51.598835 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.598784    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 11 03:49:51.598835 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.598822    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 11 03:49:51.598835 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.598774    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 11 03:49:51.599076 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.598962    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 11 03:49:51.599076 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.599012    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 11 03:49:51.599181 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.599075    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zd774\""
Jul 11 03:49:51.599181 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.599095    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 11 03:49:51.609882 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.609862    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 03:49:51.641466 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a380d485-efa0-418b-8a17-5bb0005e29f1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.641599 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641479    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a380d485-efa0-418b-8a17-5bb0005e29f1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.641599 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a380d485-efa0-418b-8a17-5bb0005e29f1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.641682 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a380d485-efa0-418b-8a17-5bb0005e29f1-config-out\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.641682 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641656    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.641682 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.641838 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-config-volume\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.641838 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.641838 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqjbd\" (UniqueName: \"kubernetes.io/projected/a380d485-efa0-418b-8a17-5bb0005e29f1-kube-api-access-hqjbd\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.642036 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-web-config\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.642036 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.642036 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.642036 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.641913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a380d485-efa0-418b-8a17-5bb0005e29f1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742352 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a380d485-efa0-418b-8a17-5bb0005e29f1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742494 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a380d485-efa0-418b-8a17-5bb0005e29f1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742494 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a380d485-efa0-418b-8a17-5bb0005e29f1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742494 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a380d485-efa0-418b-8a17-5bb0005e29f1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742494 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a380d485-efa0-418b-8a17-5bb0005e29f1-config-out\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742494 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742494 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742739 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:49:51.742631    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a380d485-efa0-418b-8a17-5bb0005e29f1-alertmanager-trusted-ca-bundle podName:a380d485-efa0-418b-8a17-5bb0005e29f1 nodeName:}" failed. No retries permitted until 2026-07-11 03:49:52.242609099 +0000 UTC m=+65.427761539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a380d485-efa0-418b-8a17-5bb0005e29f1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a380d485-efa0-418b-8a17-5bb0005e29f1") : configmap references non-existent config key: ca-bundle.crt
Jul 11 03:49:51.742739 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-config-volume\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742739 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742880 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqjbd\" (UniqueName: \"kubernetes.io/projected/a380d485-efa0-418b-8a17-5bb0005e29f1-kube-api-access-hqjbd\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742880 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-web-config\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742880 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.742880 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.742841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.743159 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.743136    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a380d485-efa0-418b-8a17-5bb0005e29f1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.743395 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.743184    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a380d485-efa0-418b-8a17-5bb0005e29f1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.745658 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.745626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.745854 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.745831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-web-config\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.746113 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.746092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.746166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.746151    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-config-volume\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.746239 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.746221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.746367 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.746348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.746468 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.746448    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a380d485-efa0-418b-8a17-5bb0005e29f1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.746530 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.746514    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a380d485-efa0-418b-8a17-5bb0005e29f1-config-out\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.747148 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.747123    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a380d485-efa0-418b-8a17-5bb0005e29f1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:51.752986 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:51.752968    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqjbd\" (UniqueName: \"kubernetes.io/projected/a380d485-efa0-418b-8a17-5bb0005e29f1-kube-api-access-hqjbd\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:52.246756 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:52.246723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a380d485-efa0-418b-8a17-5bb0005e29f1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:52.246756 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:52.246757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-tls\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:52.247480 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:52.247456    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a380d485-efa0-418b-8a17-5bb0005e29f1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a380d485-efa0-418b-8a17-5bb0005e29f1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:52.248887 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:52.248862    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5def14a0-34d5-4beb-8233-b98b08361599-node-exporter-tls\") pod \"node-exporter-2t9l2\" (UID: \"5def14a0-34d5-4beb-8233-b98b08361599\") " pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:52.366912 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:52.366885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2t9l2"
Jul 11 03:49:52.376029 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:49:52.376005    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5def14a0_34d5_4beb_8233_b98b08361599.slice/crio-f75abbfe88cf2527bf05fe66b6c9f0c77eaaca90c67d4f60b4caa1d2bc1a5003 WatchSource:0}: Error finding container f75abbfe88cf2527bf05fe66b6c9f0c77eaaca90c67d4f60b4caa1d2bc1a5003: Status 404 returned error can't find the container with id f75abbfe88cf2527bf05fe66b6c9f0c77eaaca90c67d4f60b4caa1d2bc1a5003
Jul 11 03:49:52.506802 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:52.506735    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 11 03:49:52.632900 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:52.632861    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 11 03:49:52.634706 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:49:52.634687    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda380d485_efa0_418b_8a17_5bb0005e29f1.slice/crio-dfb5914ab30afc3d07db5461abc4ea1706364dee1969be0d5c583508d4daa1cd WatchSource:0}: Error finding container dfb5914ab30afc3d07db5461abc4ea1706364dee1969be0d5c583508d4daa1cd: Status 404 returned error can't find the container with id dfb5914ab30afc3d07db5461abc4ea1706364dee1969be0d5c583508d4daa1cd
Jul 11 03:49:52.758238 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:52.758165    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2t9l2" event={"ID":"5def14a0-34d5-4beb-8233-b98b08361599","Type":"ContainerStarted","Data":"f75abbfe88cf2527bf05fe66b6c9f0c77eaaca90c67d4f60b4caa1d2bc1a5003"}
Jul 11 03:49:52.759249 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:52.759220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a380d485-efa0-418b-8a17-5bb0005e29f1","Type":"ContainerStarted","Data":"dfb5914ab30afc3d07db5461abc4ea1706364dee1969be0d5c583508d4daa1cd"}
Jul 11 03:49:53.054971 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.054939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:53.057969 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.057951    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 03:49:53.068302 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.068273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d2e71-1f18-45d0-8c51-c427699635a2-metrics-certs\") pod \"network-metrics-daemon-mbj8w\" (UID: \"7e5d2e71-1f18-45d0-8c51-c427699635a2\") " pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:53.155763 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.155724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pf7l\" (UniqueName: \"kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l\") pod \"network-check-target-9b4n4\" (UID: \"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e\") " pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:53.155939 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.155789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:53.157910 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.157881    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 03:49:53.157910 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.157902    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 03:49:53.168773 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.168751    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 03:49:53.169404 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.169379    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a9da7d4-021f-4706-b439-b2ddd6a0920f-original-pull-secret\") pod \"global-pull-secret-syncer-tf67l\" (UID: \"1a9da7d4-021f-4706-b439-b2ddd6a0920f\") " pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:53.179594 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.179571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pf7l\" (UniqueName: \"kubernetes.io/projected/ef9cd125-a8d4-4fe4-9be1-afbe87875c1e-kube-api-access-8pf7l\") pod \"network-check-target-9b4n4\" (UID: \"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e\") " pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:53.186379 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.186229    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf67l"
Jul 11 03:49:53.198494 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.198473    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kfp2p\""
Jul 11 03:49:53.204248 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.204225    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zgqwh\""
Jul 11 03:49:53.207027 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.206972    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:53.212578 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.212557    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbj8w"
Jul 11 03:49:53.413213 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.412983    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9b4n4"]
Jul 11 03:49:53.420189 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:49:53.420156    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9cd125_a8d4_4fe4_9be1_afbe87875c1e.slice/crio-2c24ac88869b9b076d28af59d67f064a63b648d442aba48ae35998daa3260d74 WatchSource:0}: Error finding container 2c24ac88869b9b076d28af59d67f064a63b648d442aba48ae35998daa3260d74: Status 404 returned error can't find the container with id 2c24ac88869b9b076d28af59d67f064a63b648d442aba48ae35998daa3260d74
Jul 11 03:49:53.443460 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.443392    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tf67l"]
Jul 11 03:49:53.448468 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.448445    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mbj8w"]
Jul 11 03:49:53.449430 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:49:53.449406    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9da7d4_021f_4706_b439_b2ddd6a0920f.slice/crio-6bde50a10482d116dc5b70b556983f9055adfc6414b0b145895eaf4fa56f5125 WatchSource:0}: Error finding container 6bde50a10482d116dc5b70b556983f9055adfc6414b0b145895eaf4fa56f5125: Status 404 returned error can't find the container with id 6bde50a10482d116dc5b70b556983f9055adfc6414b0b145895eaf4fa56f5125
Jul 11 03:49:53.453020 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:49:53.452290    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5d2e71_1f18_45d0_8c51_c427699635a2.slice/crio-ade63aeb6e0175c1d493fa5ebfaff0590f030096a593f376e44e282dbe282882 WatchSource:0}: Error finding container ade63aeb6e0175c1d493fa5ebfaff0590f030096a593f376e44e282dbe282882: Status 404 returned error can't find the container with id ade63aeb6e0175c1d493fa5ebfaff0590f030096a593f376e44e282dbe282882
Jul 11 03:49:53.728919 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.728831    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7r8z7"
Jul 11 03:49:53.768292 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.768262    2576 generic.go:356] "Generic (PLEG): container finished" podID="5def14a0-34d5-4beb-8233-b98b08361599" containerID="4c8c48a4c3747d46b9a5fbb0edfe6e405a1bc0bb8f502ff887f9ef2935e8b92c" exitCode=0
Jul 11 03:49:53.768455 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.768343    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2t9l2" event={"ID":"5def14a0-34d5-4beb-8233-b98b08361599","Type":"ContainerDied","Data":"4c8c48a4c3747d46b9a5fbb0edfe6e405a1bc0bb8f502ff887f9ef2935e8b92c"}
Jul 11 03:49:53.769845 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.769821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbj8w" event={"ID":"7e5d2e71-1f18-45d0-8c51-c427699635a2","Type":"ContainerStarted","Data":"ade63aeb6e0175c1d493fa5ebfaff0590f030096a593f376e44e282dbe282882"}
Jul 11 03:49:53.771125 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.771076    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9b4n4" event={"ID":"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e","Type":"ContainerStarted","Data":"2c24ac88869b9b076d28af59d67f064a63b648d442aba48ae35998daa3260d74"}
Jul 11 03:49:53.772425 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:53.772400    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tf67l" event={"ID":"1a9da7d4-021f-4706-b439-b2ddd6a0920f","Type":"ContainerStarted","Data":"6bde50a10482d116dc5b70b556983f9055adfc6414b0b145895eaf4fa56f5125"}
Jul 11 03:49:54.778713 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:54.778674    2576 generic.go:356] "Generic (PLEG): container finished" podID="a380d485-efa0-418b-8a17-5bb0005e29f1" containerID="2966df744de69063e79b9e76c59487149427cdf240b3c3014ebccd000a9687e9" exitCode=0
Jul 11 03:49:54.779035 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:54.778762    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a380d485-efa0-418b-8a17-5bb0005e29f1","Type":"ContainerDied","Data":"2966df744de69063e79b9e76c59487149427cdf240b3c3014ebccd000a9687e9"}
Jul 11 03:49:54.782845 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:54.782810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2t9l2" event={"ID":"5def14a0-34d5-4beb-8233-b98b08361599","Type":"ContainerStarted","Data":"08797151c8501b75e6b78c4df6285d3e84c9044b40654577d51c9fb8b86b72d6"}
Jul 11 03:49:54.782994 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:54.782873    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2t9l2" event={"ID":"5def14a0-34d5-4beb-8233-b98b08361599","Type":"ContainerStarted","Data":"75553031d8ffd39a675dcf71dc813d87b806eb093be372919b04e88a8fa087d9"}
Jul 11 03:49:54.785126 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:54.785101    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbj8w" event={"ID":"7e5d2e71-1f18-45d0-8c51-c427699635a2","Type":"ContainerStarted","Data":"d8c293ddc1e910d6903f1412afe6dc41da9fe4261018a6080d864e8f13cda075"}
Jul 11 03:49:54.785214 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:54.785153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbj8w" event={"ID":"7e5d2e71-1f18-45d0-8c51-c427699635a2","Type":"ContainerStarted","Data":"6056ada799e4c4e8da440b5082be35b6a77c7c46f81c15b51d97ccf898f09d5e"}
Jul 11 03:49:54.815887 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:54.815819    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mbj8w" podStartSLOduration=66.761567479 podStartE2EDuration="1m7.815789144s" totalImagesPullingTime="1.054221665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:54.815428155 +0000 UTC m=+68.000580611" watchObservedRunningTime="2026-07-11 03:49:54.815789144 +0000 UTC m=+68.000941600"
Jul 11 03:49:54.838303 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:54.838210    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2t9l2" podStartSLOduration=3.83864389 podStartE2EDuration="4.838192368s" totalImagesPullingTime="912.928115ms" totalInitContainerRuntime="86.620363ms" isStatefulPod=true podCreationTimestamp="2026-07-11 03:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:54.836160602 +0000 UTC m=+68.021313058" watchObservedRunningTime="2026-07-11 03:49:54.838192368 +0000 UTC m=+68.023344824"
Jul 11 03:49:55.340005 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.339966    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"]
Jul 11 03:49:55.359197 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.359168    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"]
Jul 11 03:49:55.359383 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.359288    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"
Jul 11 03:49:55.364318 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.364291    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-56wkb\""
Jul 11 03:49:55.364549 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.364531    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 11 03:49:55.476985 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.476957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djd7b\" (UniqueName: \"kubernetes.io/projected/958bde0d-2cb1-4b8b-b483-c328326e2a38-kube-api-access-djd7b\") pod \"monitoring-plugin-5f68df7f58-cpzrf\" (UID: \"958bde0d-2cb1-4b8b-b483-c328326e2a38\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"
Jul 11 03:49:55.477163 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.477014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/958bde0d-2cb1-4b8b-b483-c328326e2a38-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cpzrf\" (UID: \"958bde0d-2cb1-4b8b-b483-c328326e2a38\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"
Jul 11 03:49:55.577750 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.577713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djd7b\" (UniqueName: \"kubernetes.io/projected/958bde0d-2cb1-4b8b-b483-c328326e2a38-kube-api-access-djd7b\") pod \"monitoring-plugin-5f68df7f58-cpzrf\" (UID: \"958bde0d-2cb1-4b8b-b483-c328326e2a38\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"
Jul 11 03:49:55.577935 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.577785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/958bde0d-2cb1-4b8b-b483-c328326e2a38-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cpzrf\" (UID: \"958bde0d-2cb1-4b8b-b483-c328326e2a38\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"
Jul 11 03:49:55.585204 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.585176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/958bde0d-2cb1-4b8b-b483-c328326e2a38-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cpzrf\" (UID: \"958bde0d-2cb1-4b8b-b483-c328326e2a38\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"
Jul 11 03:49:55.586218 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.586173    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djd7b\" (UniqueName: \"kubernetes.io/projected/958bde0d-2cb1-4b8b-b483-c328326e2a38-kube-api-access-djd7b\") pod \"monitoring-plugin-5f68df7f58-cpzrf\" (UID: \"958bde0d-2cb1-4b8b-b483-c328326e2a38\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"
Jul 11 03:49:55.676171 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.676087    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"
Jul 11 03:49:55.725970 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.725938    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69b9595f8b-dm2qf"]
Jul 11 03:49:55.739782 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.739536    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b9595f8b-dm2qf"]
Jul 11 03:49:55.739782 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.739620    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.743798 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.743088    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 11 03:49:55.743798 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.743317    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 11 03:49:55.743798 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.743364    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 11 03:49:55.743798 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.743451    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g7cdl\""
Jul 11 03:49:55.743798 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.743629    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 11 03:49:55.743798 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.743676    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 11 03:49:55.743798 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.743678    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 11 03:49:55.744613 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.744359    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 11 03:49:55.760671 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.760641    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-cbc96697b-k7gxh"]
Jul 11 03:49:55.768799 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.768775    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 11 03:49:55.779585 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.779547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w84ng\" (UniqueName: \"kubernetes.io/projected/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-kube-api-access-w84ng\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.780639 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.779607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-trusted-ca-bundle\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.780639 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.779639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-service-ca\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.780639 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.779672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-serving-cert\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.780639 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.779704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-oauth-serving-cert\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.780639 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.779740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-oauth-config\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.780639 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.779765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-config\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.799396 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.798818    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-cbc96697b-k7gxh"]
Jul 11 03:49:55.799396 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.798944    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.808022 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.807998    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 11 03:49:55.808246 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.808229    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 11 03:49:55.808486 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.808469    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 11 03:49:55.808687 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.808671    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 11 03:49:55.810282 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.809662    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-whg52\""
Jul 11 03:49:55.810282 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.810088    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 11 03:49:55.817485 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.817464    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 11 03:49:55.856681 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.856624    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"]
Jul 11 03:49:55.880153 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-oauth-serving-cert\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.880277 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-oauth-config\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.880277 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-config\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.880448 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-federate-client-tls\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.880448 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf597d63-1480-4931-9bf9-e2bf06032538-serving-certs-ca-bundle\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.880448 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-secret-telemeter-client\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.880448 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf597d63-1480-4931-9bf9-e2bf06032538-metrics-client-ca\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.880643 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w84ng\" (UniqueName: \"kubernetes.io/projected/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-kube-api-access-w84ng\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.880643 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-telemeter-client-tls\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.880643 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf597d63-1480-4931-9bf9-e2bf06032538-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.880643 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-trusted-ca-bundle\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.880643 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-service-ca\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.880865 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880682    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-serving-cert\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.880865 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.880865 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.880753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gnk9\" (UniqueName: \"kubernetes.io/projected/cf597d63-1480-4931-9bf9-e2bf06032538-kube-api-access-2gnk9\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.881725 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.881302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-service-ca\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.881725 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.881431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-oauth-serving-cert\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.882077 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.882053    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-config\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.882397 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.882372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-trusted-ca-bundle\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.884028 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.883989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-serving-cert\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.885313 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.885267    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-oauth-config\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.889252 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.889215    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w84ng\" (UniqueName: \"kubernetes.io/projected/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-kube-api-access-w84ng\") pod \"console-69b9595f8b-dm2qf\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") " pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:55.981377 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.981277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-federate-client-tls\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.981377 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.981322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf597d63-1480-4931-9bf9-e2bf06032538-serving-certs-ca-bundle\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.981579 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.981375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-secret-telemeter-client\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.981579 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.981402    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf597d63-1480-4931-9bf9-e2bf06032538-metrics-client-ca\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.981579 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.981519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-telemeter-client-tls\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.981579 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.981559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf597d63-1480-4931-9bf9-e2bf06032538-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.981776 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.981617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.981776 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.981647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnk9\" (UniqueName: \"kubernetes.io/projected/cf597d63-1480-4931-9bf9-e2bf06032538-kube-api-access-2gnk9\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.982268 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.982217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf597d63-1480-4931-9bf9-e2bf06032538-serving-certs-ca-bundle\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.982268 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.982230    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf597d63-1480-4931-9bf9-e2bf06032538-metrics-client-ca\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.982542 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.982513    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf597d63-1480-4931-9bf9-e2bf06032538-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.984863 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.984838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-secret-telemeter-client\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.986650 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.986600    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-telemeter-client-tls\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.986903 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.986727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.987268 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.987227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cf597d63-1480-4931-9bf9-e2bf06032538-federate-client-tls\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:55.990250 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:55.990211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gnk9\" (UniqueName: \"kubernetes.io/projected/cf597d63-1480-4931-9bf9-e2bf06032538-kube-api-access-2gnk9\") pod \"telemeter-client-cbc96697b-k7gxh\" (UID: \"cf597d63-1480-4931-9bf9-e2bf06032538\") " pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:56.072227 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:56.072190    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:49:56.114707 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:56.114681    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh"
Jul 11 03:49:56.957053 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:49:56.957007    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958bde0d_2cb1_4b8b_b483_c328326e2a38.slice/crio-bd1aa405a2aa6a0e4f0f175741dfdf5ea5ca53dd0ed424d00f23e0706ba5933f WatchSource:0}: Error finding container bd1aa405a2aa6a0e4f0f175741dfdf5ea5ca53dd0ed424d00f23e0706ba5933f: Status 404 returned error can't find the container with id bd1aa405a2aa6a0e4f0f175741dfdf5ea5ca53dd0ed424d00f23e0706ba5933f
Jul 11 03:49:57.800567 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:57.800531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf" event={"ID":"958bde0d-2cb1-4b8b-b483-c328326e2a38","Type":"ContainerStarted","Data":"bd1aa405a2aa6a0e4f0f175741dfdf5ea5ca53dd0ed424d00f23e0706ba5933f"}
Jul 11 03:49:58.980356 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:58.979996    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-cbc96697b-k7gxh"]
Jul 11 03:49:58.982537 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:49:58.982492    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf597d63_1480_4931_9bf9_e2bf06032538.slice/crio-f2dcbe476317ca2b916744086e0d3dbd857b1e1fcbf200266718359ada3e355b WatchSource:0}: Error finding container f2dcbe476317ca2b916744086e0d3dbd857b1e1fcbf200266718359ada3e355b: Status 404 returned error can't find the container with id f2dcbe476317ca2b916744086e0d3dbd857b1e1fcbf200266718359ada3e355b
Jul 11 03:49:58.999938 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:58.999909    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b9595f8b-dm2qf"]
Jul 11 03:49:59.005078 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:49:59.005047    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b36d3a_dd7b_4e47_bb73_3a22daaab4df.slice/crio-6f0e0ead95d6f1f2dcf7a8094267953974f2ab82e35a4f7482081568e83c3984 WatchSource:0}: Error finding container 6f0e0ead95d6f1f2dcf7a8094267953974f2ab82e35a4f7482081568e83c3984: Status 404 returned error can't find the container with id 6f0e0ead95d6f1f2dcf7a8094267953974f2ab82e35a4f7482081568e83c3984
Jul 11 03:49:59.810316 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.810278    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh" event={"ID":"cf597d63-1480-4931-9bf9-e2bf06032538","Type":"ContainerStarted","Data":"f2dcbe476317ca2b916744086e0d3dbd857b1e1fcbf200266718359ada3e355b"}
Jul 11 03:49:59.813127 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.813094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b9595f8b-dm2qf" event={"ID":"65b36d3a-dd7b-4e47-bb73-3a22daaab4df","Type":"ContainerStarted","Data":"6f0e0ead95d6f1f2dcf7a8094267953974f2ab82e35a4f7482081568e83c3984"}
Jul 11 03:49:59.817373 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.817345    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a380d485-efa0-418b-8a17-5bb0005e29f1","Type":"ContainerStarted","Data":"a9851b2859a39b108a604e3e6e0c386a20ef7846c429d0d457930aa76ea4063c"}
Jul 11 03:49:59.817512 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.817422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a380d485-efa0-418b-8a17-5bb0005e29f1","Type":"ContainerStarted","Data":"0f221d11e2965b794ecbb4f34b97ddd84ce859dee5a94ecb29f8f5c9cd01d83b"}
Jul 11 03:49:59.817512 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.817467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a380d485-efa0-418b-8a17-5bb0005e29f1","Type":"ContainerStarted","Data":"2ebdd2e27a5e996c40c6f8dede29c6f2cadfbd9e7b70d12eadfff1fa3c3031e3"}
Jul 11 03:49:59.817512 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.817509    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a380d485-efa0-418b-8a17-5bb0005e29f1","Type":"ContainerStarted","Data":"5cfc0808df2990b44a0113cd7617e2068e3ca7f5cea4d5ca1a661a8db0678a6d"}
Jul 11 03:49:59.817671 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.817547    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a380d485-efa0-418b-8a17-5bb0005e29f1","Type":"ContainerStarted","Data":"085d4181df0bad33f1b0e9b550b3133188fb89f48bb9e15159489b0845f788c6"}
Jul 11 03:49:59.819754 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.819725    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9b4n4" event={"ID":"ef9cd125-a8d4-4fe4-9be1-afbe87875c1e","Type":"ContainerStarted","Data":"7cd196f2431f085fec732dd99b1d9d1336fb5de21068f363f9ba83e136180374"}
Jul 11 03:49:59.819867 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.819813    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:49:59.822161 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.821781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tf67l" event={"ID":"1a9da7d4-021f-4706-b439-b2ddd6a0920f","Type":"ContainerStarted","Data":"d086305524ac2d1d61aee72cf02fffcadd90de6f41f8b905d42c7a98ac9c17b9"}
Jul 11 03:49:59.834203 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.834003    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9b4n4" podStartSLOduration=67.43802763 podStartE2EDuration="1m12.833984492s" totalImagesPullingTime="5.395956862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:59.83312525 +0000 UTC m=+73.018277709" watchObservedRunningTime="2026-07-11 03:49:59.833984492 +0000 UTC m=+73.019136948"
Jul 11 03:49:59.846357 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:49:59.846233    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tf67l" podStartSLOduration=67.468552953 podStartE2EDuration="1m12.846215812s" totalImagesPullingTime="5.377662859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:59.845994583 +0000 UTC m=+73.031147039" watchObservedRunningTime="2026-07-11 03:49:59.846215812 +0000 UTC m=+73.031368268"
Jul 11 03:50:00.831066 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:00.831018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a380d485-efa0-418b-8a17-5bb0005e29f1","Type":"ContainerStarted","Data":"dcb903edb01a31c72cbcbd30a84ef86f9c42124d591be992e6c47b61a4273530"}
Jul 11 03:50:00.833343 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:00.833268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf" event={"ID":"958bde0d-2cb1-4b8b-b483-c328326e2a38","Type":"ContainerStarted","Data":"c1d57e16b3f212652afc4784a9f5e9df593a29483b8bc249e8982d660e03cb96"}
Jul 11 03:50:00.833629 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:00.833583    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"
Jul 11 03:50:00.840304 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:00.840283    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf"
Jul 11 03:50:00.855849 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:00.855578    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.678341894 podStartE2EDuration="9.855559418s" totalImagesPullingTime="6.153317072s" totalInitContainerRuntime="23.900452ms" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:50:00.853680242 +0000 UTC m=+74.038832724" watchObservedRunningTime="2026-07-11 03:50:00.855559418 +0000 UTC m=+74.040711874"
Jul 11 03:50:00.870663 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:00.870605    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cpzrf" podStartSLOduration=2.705001908 podStartE2EDuration="5.870583119s" totalImagesPullingTime="3.165581211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:50:00.86939564 +0000 UTC m=+74.054548100" watchObservedRunningTime="2026-07-11 03:50:00.870583119 +0000 UTC m=+74.055735575"
Jul 11 03:50:02.843963 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:02.843923    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh" event={"ID":"cf597d63-1480-4931-9bf9-e2bf06032538","Type":"ContainerStarted","Data":"9ff1a98567ff17092d20f630ea953fef1760176ff7c2291f5e72eea73cd56d50"}
Jul 11 03:50:02.844523 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:02.843986    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh" event={"ID":"cf597d63-1480-4931-9bf9-e2bf06032538","Type":"ContainerStarted","Data":"7ef7b77824a02715449fb20bce81608db553c32a58e08924b79b82be5e10248f"}
Jul 11 03:50:02.844523 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:02.844017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh" event={"ID":"cf597d63-1480-4931-9bf9-e2bf06032538","Type":"ContainerStarted","Data":"eb671c04c70904d4a38a7c5a804be77ce43c6c24fdf6ac8cbe79298fe1b12a7d"}
Jul 11 03:50:02.845674 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:02.845650    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b9595f8b-dm2qf" event={"ID":"65b36d3a-dd7b-4e47-bb73-3a22daaab4df","Type":"ContainerStarted","Data":"d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406"}
Jul 11 03:50:02.869688 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:02.869643    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-cbc96697b-k7gxh" podStartSLOduration=4.709022897 podStartE2EDuration="7.869629166s" totalImagesPullingTime="3.160606269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:50:02.868636031 +0000 UTC m=+76.053788500" watchObservedRunningTime="2026-07-11 03:50:02.869629166 +0000 UTC m=+76.054781621"
Jul 11 03:50:02.884838 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:02.884789    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69b9595f8b-dm2qf" podStartSLOduration=4.742784664 podStartE2EDuration="7.884776337s" totalImagesPullingTime="3.141991673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:50:02.884454751 +0000 UTC m=+76.069607226" watchObservedRunningTime="2026-07-11 03:50:02.884776337 +0000 UTC m=+76.069928789"
Jul 11 03:50:03.523659 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.523626    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69b9595f8b-dm2qf"]
Jul 11 03:50:03.550577 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.550549    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d5b8cffc-rxg64"]
Jul 11 03:50:03.553541 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.553526    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.562306 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.562282    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5b8cffc-rxg64"]
Jul 11 03:50:03.645347 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.645295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-oauth-config\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.645499 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.645351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-trusted-ca-bundle\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.645499 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.645410    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-oauth-serving-cert\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.645499 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.645475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-serving-cert\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.645669 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.645504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-service-ca\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.645669 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.645587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkgph\" (UniqueName: \"kubernetes.io/projected/672e5af8-3141-46c0-92a9-67d27f7dfd37-kube-api-access-dkgph\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.645669 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.645614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-config\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.746834 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.746799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkgph\" (UniqueName: \"kubernetes.io/projected/672e5af8-3141-46c0-92a9-67d27f7dfd37-kube-api-access-dkgph\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.746834 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.746840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-config\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.747045 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.747023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-oauth-config\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.747106 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.747053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-trusted-ca-bundle\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.747106 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.747085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-oauth-serving-cert\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.747212 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.747138    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-serving-cert\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.747212 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.747165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-service-ca\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.747734 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.747710    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-config\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.747862 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.747836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-oauth-serving-cert\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.747990 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.747889    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-service-ca\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.748106 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.748083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-trusted-ca-bundle\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.749644 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.749625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-oauth-config\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.749874 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.749851    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-serving-cert\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.755151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.755129    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkgph\" (UniqueName: \"kubernetes.io/projected/672e5af8-3141-46c0-92a9-67d27f7dfd37-kube-api-access-dkgph\") pod \"console-d5b8cffc-rxg64\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") " pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:03.862576 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:03.862492    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:04.008388 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:04.006619    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5b8cffc-rxg64"]
Jul 11 03:50:04.009701 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:50:04.009673    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672e5af8_3141_46c0_92a9_67d27f7dfd37.slice/crio-bab43e34ad91e5943eed426caad84cab191936bf5aff2c5b1d87b2fe1ac887aa WatchSource:0}: Error finding container bab43e34ad91e5943eed426caad84cab191936bf5aff2c5b1d87b2fe1ac887aa: Status 404 returned error can't find the container with id bab43e34ad91e5943eed426caad84cab191936bf5aff2c5b1d87b2fe1ac887aa
Jul 11 03:50:04.854765 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:04.854730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5b8cffc-rxg64" event={"ID":"672e5af8-3141-46c0-92a9-67d27f7dfd37","Type":"ContainerStarted","Data":"cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6"}
Jul 11 03:50:04.854970 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:04.854782    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5b8cffc-rxg64" event={"ID":"672e5af8-3141-46c0-92a9-67d27f7dfd37","Type":"ContainerStarted","Data":"bab43e34ad91e5943eed426caad84cab191936bf5aff2c5b1d87b2fe1ac887aa"}
Jul 11 03:50:04.890453 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:04.890393    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d5b8cffc-rxg64" podStartSLOduration=1.8903730090000002 podStartE2EDuration="1.890373009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:50:04.890308969 +0000 UTC m=+78.075461435" watchObservedRunningTime="2026-07-11 03:50:04.890373009 +0000 UTC m=+78.075525466"
Jul 11 03:50:06.073400 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:06.073358    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:50:13.862828 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:13.862720    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:13.862828 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:13.862776    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:13.867209 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:13.867191    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:13.892056 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:13.892033    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:50:29.879816 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:29.879764    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69b9595f8b-dm2qf" podUID="65b36d3a-dd7b-4e47-bb73-3a22daaab4df" containerName="console" containerID="cri-o://d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406" gracePeriod=15
Jul 11 03:50:30.643224 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.643201    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:50:30.745749 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.745727    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-oauth-serving-cert\") pod \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") "
Jul 11 03:50:30.745903 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.745763    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-config\") pod \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") "
Jul 11 03:50:30.745903 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.745793    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w84ng\" (UniqueName: \"kubernetes.io/projected/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-kube-api-access-w84ng\") pod \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") "
Jul 11 03:50:30.745903 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.745813    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-service-ca\") pod \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") "
Jul 11 03:50:30.745903 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.745894    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-oauth-config\") pod \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") "
Jul 11 03:50:30.746095 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.745925    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-trusted-ca-bundle\") pod \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") "
Jul 11 03:50:30.746095 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.745952    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-serving-cert\") pod \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\" (UID: \"65b36d3a-dd7b-4e47-bb73-3a22daaab4df\") "
Jul 11 03:50:30.746185 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.746118    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-config" (OuterVolumeSpecName: "console-config") pod "65b36d3a-dd7b-4e47-bb73-3a22daaab4df" (UID: "65b36d3a-dd7b-4e47-bb73-3a22daaab4df"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:30.746254 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.746158    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "65b36d3a-dd7b-4e47-bb73-3a22daaab4df" (UID: "65b36d3a-dd7b-4e47-bb73-3a22daaab4df"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:30.746369 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.746323    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-service-ca" (OuterVolumeSpecName: "service-ca") pod "65b36d3a-dd7b-4e47-bb73-3a22daaab4df" (UID: "65b36d3a-dd7b-4e47-bb73-3a22daaab4df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:30.746490 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.746454    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "65b36d3a-dd7b-4e47-bb73-3a22daaab4df" (UID: "65b36d3a-dd7b-4e47-bb73-3a22daaab4df"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:50:30.748110 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.748087    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "65b36d3a-dd7b-4e47-bb73-3a22daaab4df" (UID: "65b36d3a-dd7b-4e47-bb73-3a22daaab4df"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:50:30.748197 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.748124    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "65b36d3a-dd7b-4e47-bb73-3a22daaab4df" (UID: "65b36d3a-dd7b-4e47-bb73-3a22daaab4df"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:50:30.748197 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.748135    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-kube-api-access-w84ng" (OuterVolumeSpecName: "kube-api-access-w84ng") pod "65b36d3a-dd7b-4e47-bb73-3a22daaab4df" (UID: "65b36d3a-dd7b-4e47-bb73-3a22daaab4df"). InnerVolumeSpecName "kube-api-access-w84ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:50:30.835899 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.835878    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9b4n4"
Jul 11 03:50:30.846587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.846568    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-oauth-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:50:30.846587 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.846588    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-trusted-ca-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:50:30.846720 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.846596    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:50:30.846720 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.846604    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-oauth-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:50:30.846720 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.846612    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-console-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:50:30.846720 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.846620    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w84ng\" (UniqueName: \"kubernetes.io/projected/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-kube-api-access-w84ng\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:50:30.846720 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.846628    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65b36d3a-dd7b-4e47-bb73-3a22daaab4df-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:50:30.947277 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.947244    2576 generic.go:356] "Generic (PLEG): container finished" podID="65b36d3a-dd7b-4e47-bb73-3a22daaab4df" containerID="d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406" exitCode=0
Jul 11 03:50:30.947742 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.947286    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b9595f8b-dm2qf"
Jul 11 03:50:30.947742 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.947312    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b9595f8b-dm2qf" event={"ID":"65b36d3a-dd7b-4e47-bb73-3a22daaab4df","Type":"ContainerDied","Data":"d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406"}
Jul 11 03:50:30.947742 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.947367    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b9595f8b-dm2qf" event={"ID":"65b36d3a-dd7b-4e47-bb73-3a22daaab4df","Type":"ContainerDied","Data":"6f0e0ead95d6f1f2dcf7a8094267953974f2ab82e35a4f7482081568e83c3984"}
Jul 11 03:50:30.947742 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.947386    2576 scope.go:117] "RemoveContainer" containerID="d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406"
Jul 11 03:50:30.966259 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.966230    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69b9595f8b-dm2qf"]
Jul 11 03:50:30.967400 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.967385    2576 scope.go:117] "RemoveContainer" containerID="d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406"
Jul 11 03:50:30.967664 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:50:30.967644    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406\": container with ID starting with d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406 not found: ID does not exist" containerID="d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406"
Jul 11 03:50:30.967720 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.967673    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406"} err="failed to get container status \"d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406\": rpc error: code = NotFound desc = could not find container \"d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406\": container with ID starting with d9eb9d2f43c8ada21e4dfc9758b5cd2648f7bcdeb2338e8a9d91946bdab6b406 not found: ID does not exist"
Jul 11 03:50:30.970150 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:30.970128    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69b9595f8b-dm2qf"]
Jul 11 03:50:31.475465 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:50:31.475437    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b36d3a-dd7b-4e47-bb73-3a22daaab4df" path="/var/lib/kubelet/pods/65b36d3a-dd7b-4e47-bb73-3a22daaab4df/volumes"
Jul 11 03:51:17.831181 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.831150    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bb9894f69-gqpql"]
Jul 11 03:51:17.831625 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.831389    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b36d3a-dd7b-4e47-bb73-3a22daaab4df" containerName="console"
Jul 11 03:51:17.831625 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.831400    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b36d3a-dd7b-4e47-bb73-3a22daaab4df" containerName="console"
Jul 11 03:51:17.831625 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.831451    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="65b36d3a-dd7b-4e47-bb73-3a22daaab4df" containerName="console"
Jul 11 03:51:17.833417 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.833401    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.843641 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.843615    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb9894f69-gqpql"]
Jul 11 03:51:17.865993 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.865967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-oauth-serving-cert\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.866100 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.866000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-serving-cert\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.866100 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.866015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-config\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.866100 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.866036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-trusted-ca-bundle\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.866255 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.866150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-service-ca\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.866255 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.866202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-oauth-config\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.866365 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.866275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7pws\" (UniqueName: \"kubernetes.io/projected/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-kube-api-access-x7pws\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.967238 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.967215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-service-ca\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.967347 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.967246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-oauth-config\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.967347 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.967271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7pws\" (UniqueName: \"kubernetes.io/projected/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-kube-api-access-x7pws\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.967347 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.967289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-oauth-serving-cert\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.967505 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.967439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-serving-cert\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.967505 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.967483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-config\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.967505 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.967501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-trusted-ca-bundle\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.968047 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.968022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-service-ca\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.968124 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.968022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-oauth-serving-cert\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.968124 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.968032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-config\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.968194 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.968131    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-trusted-ca-bundle\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.969693 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.969664    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-oauth-config\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.969808 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.969787    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-serving-cert\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:17.974559 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:17.974536    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7pws\" (UniqueName: \"kubernetes.io/projected/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-kube-api-access-x7pws\") pod \"console-bb9894f69-gqpql\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") " pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:18.141824 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:18.141737    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:18.269821 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:18.269793    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb9894f69-gqpql"]
Jul 11 03:51:18.272631 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:51:18.272606    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7e8dd8_3ac8_45f1_ade4_5694e712e5d7.slice/crio-b9b039d376e9ed6030254601ca935bce225fce094de436d11836c70695b531eb WatchSource:0}: Error finding container b9b039d376e9ed6030254601ca935bce225fce094de436d11836c70695b531eb: Status 404 returned error can't find the container with id b9b039d376e9ed6030254601ca935bce225fce094de436d11836c70695b531eb
Jul 11 03:51:19.116244 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:19.116209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9894f69-gqpql" event={"ID":"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7","Type":"ContainerStarted","Data":"36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe"}
Jul 11 03:51:19.116657 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:19.116257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9894f69-gqpql" event={"ID":"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7","Type":"ContainerStarted","Data":"b9b039d376e9ed6030254601ca935bce225fce094de436d11836c70695b531eb"}
Jul 11 03:51:19.132049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:19.132007    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bb9894f69-gqpql" podStartSLOduration=2.13199445 podStartE2EDuration="2.13199445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:51:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:51:19.13077657 +0000 UTC m=+152.315929024" watchObservedRunningTime="2026-07-11 03:51:19.13199445 +0000 UTC m=+152.317146903"
Jul 11 03:51:28.142879 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:28.142844    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:28.143309 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:28.142903    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:28.147453 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:28.147428    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:28.153237 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:28.153217    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:51:28.200839 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:28.200812    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d5b8cffc-rxg64"]
Jul 11 03:51:41.165926 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.165852    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"]
Jul 11 03:51:41.168052 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.168037    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:41.170181 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.170149    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 11 03:51:41.170181 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.170162    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8zgd5\""
Jul 11 03:51:41.171040 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.171024    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 11 03:51:41.176076 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.176056    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"]
Jul 11 03:51:41.220783 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.220755    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd9hx\" (UniqueName: \"kubernetes.io/projected/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-kube-api-access-fd9hx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:41.220889 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.220792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:41.220889 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.220810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:41.321193 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.321168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd9hx\" (UniqueName: \"kubernetes.io/projected/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-kube-api-access-fd9hx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:41.321294 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.321205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:41.321294 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.321232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:41.321595 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.321575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:41.321595 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.321589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:41.328515 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.328497    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd9hx\" (UniqueName: \"kubernetes.io/projected/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-kube-api-access-fd9hx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:41.476937 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.476884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:41.591011 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:41.590938    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"]
Jul 11 03:51:41.593580 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:51:41.593548    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb8558c_2996_4ad8_a8e6_96d1ca30a151.slice/crio-bdb5e05b9e1f5f9c79f885e0ffd0fe057adcb0adb7776a4857d01dfaa644bc4f WatchSource:0}: Error finding container bdb5e05b9e1f5f9c79f885e0ffd0fe057adcb0adb7776a4857d01dfaa644bc4f: Status 404 returned error can't find the container with id bdb5e05b9e1f5f9c79f885e0ffd0fe057adcb0adb7776a4857d01dfaa644bc4f
Jul 11 03:51:42.196922 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:42.196876    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz" event={"ID":"1eb8558c-2996-4ad8-a8e6-96d1ca30a151","Type":"ContainerStarted","Data":"bdb5e05b9e1f5f9c79f885e0ffd0fe057adcb0adb7776a4857d01dfaa644bc4f"}
Jul 11 03:51:48.221114 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:48.221080    2576 generic.go:356] "Generic (PLEG): container finished" podID="1eb8558c-2996-4ad8-a8e6-96d1ca30a151" containerID="346e8cb6dee62536201a289aa913df9e44857f5f0d256886f495463cf95ba7e2" exitCode=0
Jul 11 03:51:48.221530 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:48.221165    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz" event={"ID":"1eb8558c-2996-4ad8-a8e6-96d1ca30a151","Type":"ContainerDied","Data":"346e8cb6dee62536201a289aa913df9e44857f5f0d256886f495463cf95ba7e2"}
Jul 11 03:51:50.230086 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:50.230053    2576 generic.go:356] "Generic (PLEG): container finished" podID="1eb8558c-2996-4ad8-a8e6-96d1ca30a151" containerID="1073c03beff608e801f45f069fe40c73ede481afe8f963226565488e92bb3146" exitCode=0
Jul 11 03:51:50.230392 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:50.230096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz" event={"ID":"1eb8558c-2996-4ad8-a8e6-96d1ca30a151","Type":"ContainerDied","Data":"1073c03beff608e801f45f069fe40c73ede481afe8f963226565488e92bb3146"}
Jul 11 03:51:53.219634 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.219571    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d5b8cffc-rxg64" podUID="672e5af8-3141-46c0-92a9-67d27f7dfd37" containerName="console" containerID="cri-o://cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6" gracePeriod=15
Jul 11 03:51:53.505215 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.505193    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:51:53.618008 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.617974    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-trusted-ca-bundle\") pod \"672e5af8-3141-46c0-92a9-67d27f7dfd37\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") "
Jul 11 03:51:53.618164 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.618043    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-oauth-config\") pod \"672e5af8-3141-46c0-92a9-67d27f7dfd37\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") "
Jul 11 03:51:53.618164 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.618085    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-serving-cert\") pod \"672e5af8-3141-46c0-92a9-67d27f7dfd37\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") "
Jul 11 03:51:53.618286 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.618185    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-service-ca\") pod \"672e5af8-3141-46c0-92a9-67d27f7dfd37\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") "
Jul 11 03:51:53.618286 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.618225    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-config\") pod \"672e5af8-3141-46c0-92a9-67d27f7dfd37\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") "
Jul 11 03:51:53.618426 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.618292    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkgph\" (UniqueName: \"kubernetes.io/projected/672e5af8-3141-46c0-92a9-67d27f7dfd37-kube-api-access-dkgph\") pod \"672e5af8-3141-46c0-92a9-67d27f7dfd37\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") "
Jul 11 03:51:53.618426 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.618323    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-oauth-serving-cert\") pod \"672e5af8-3141-46c0-92a9-67d27f7dfd37\" (UID: \"672e5af8-3141-46c0-92a9-67d27f7dfd37\") "
Jul 11 03:51:53.618528 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.618418    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "672e5af8-3141-46c0-92a9-67d27f7dfd37" (UID: "672e5af8-3141-46c0-92a9-67d27f7dfd37"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:51:53.618582 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.618567    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-trusted-ca-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:51:53.618910 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.618695    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-service-ca" (OuterVolumeSpecName: "service-ca") pod "672e5af8-3141-46c0-92a9-67d27f7dfd37" (UID: "672e5af8-3141-46c0-92a9-67d27f7dfd37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:51:53.618910 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.618877    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-config" (OuterVolumeSpecName: "console-config") pod "672e5af8-3141-46c0-92a9-67d27f7dfd37" (UID: "672e5af8-3141-46c0-92a9-67d27f7dfd37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:51:53.619111 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.618947    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "672e5af8-3141-46c0-92a9-67d27f7dfd37" (UID: "672e5af8-3141-46c0-92a9-67d27f7dfd37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:51:53.620611 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.620561    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "672e5af8-3141-46c0-92a9-67d27f7dfd37" (UID: "672e5af8-3141-46c0-92a9-67d27f7dfd37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:51:53.620709 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.620653    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "672e5af8-3141-46c0-92a9-67d27f7dfd37" (UID: "672e5af8-3141-46c0-92a9-67d27f7dfd37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:51:53.620709 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.620660    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672e5af8-3141-46c0-92a9-67d27f7dfd37-kube-api-access-dkgph" (OuterVolumeSpecName: "kube-api-access-dkgph") pod "672e5af8-3141-46c0-92a9-67d27f7dfd37" (UID: "672e5af8-3141-46c0-92a9-67d27f7dfd37"). InnerVolumeSpecName "kube-api-access-dkgph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:51:53.719267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.719244    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-oauth-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:51:53.719267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.719265    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:51:53.719412 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.719274    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:51:53.719412 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.719282    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-console-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:51:53.719412 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.719291    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkgph\" (UniqueName: \"kubernetes.io/projected/672e5af8-3141-46c0-92a9-67d27f7dfd37-kube-api-access-dkgph\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:51:53.719412 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:53.719300    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/672e5af8-3141-46c0-92a9-67d27f7dfd37-oauth-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:51:54.247774 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:54.247737    2576 generic.go:356] "Generic (PLEG): container finished" podID="672e5af8-3141-46c0-92a9-67d27f7dfd37" containerID="cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6" exitCode=0
Jul 11 03:51:54.248225 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:54.247790    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5b8cffc-rxg64"
Jul 11 03:51:54.248225 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:54.247808    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5b8cffc-rxg64" event={"ID":"672e5af8-3141-46c0-92a9-67d27f7dfd37","Type":"ContainerDied","Data":"cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6"}
Jul 11 03:51:54.248225 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:54.247870    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5b8cffc-rxg64" event={"ID":"672e5af8-3141-46c0-92a9-67d27f7dfd37","Type":"ContainerDied","Data":"bab43e34ad91e5943eed426caad84cab191936bf5aff2c5b1d87b2fe1ac887aa"}
Jul 11 03:51:54.248225 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:54.247898    2576 scope.go:117] "RemoveContainer" containerID="cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6"
Jul 11 03:51:54.262817 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:54.262792    2576 scope.go:117] "RemoveContainer" containerID="cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6"
Jul 11 03:51:54.263128 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:51:54.263101    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6\": container with ID starting with cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6 not found: ID does not exist" containerID="cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6"
Jul 11 03:51:54.263216 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:54.263139    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6"} err="failed to get container status \"cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6\": rpc error: code = NotFound desc = could not find container \"cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6\": container with ID starting with cff02661ba81f2c3046c5411ca9ba817dc62fc4d2beb58f19e993e1be65edbe6 not found: ID does not exist"
Jul 11 03:51:54.272583 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:54.272560    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d5b8cffc-rxg64"]
Jul 11 03:51:54.275453 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:54.275426    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d5b8cffc-rxg64"]
Jul 11 03:51:55.476157 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:55.476123    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="672e5af8-3141-46c0-92a9-67d27f7dfd37" path="/var/lib/kubelet/pods/672e5af8-3141-46c0-92a9-67d27f7dfd37/volumes"
Jul 11 03:51:57.261926 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:57.261895    2576 generic.go:356] "Generic (PLEG): container finished" podID="1eb8558c-2996-4ad8-a8e6-96d1ca30a151" containerID="771d190071c863832a58bd058fc3eaa4523261d638741da62cd6dc1b0437adcf" exitCode=0
Jul 11 03:51:57.262233 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:57.261945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz" event={"ID":"1eb8558c-2996-4ad8-a8e6-96d1ca30a151","Type":"ContainerDied","Data":"771d190071c863832a58bd058fc3eaa4523261d638741da62cd6dc1b0437adcf"}
Jul 11 03:51:58.377535 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:58.377509    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:58.457934 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:58.457910    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd9hx\" (UniqueName: \"kubernetes.io/projected/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-kube-api-access-fd9hx\") pod \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") "
Jul 11 03:51:58.458059 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:58.457958    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-util\") pod \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") "
Jul 11 03:51:58.458059 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:58.457978    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-bundle\") pod \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\" (UID: \"1eb8558c-2996-4ad8-a8e6-96d1ca30a151\") "
Jul 11 03:51:58.458640 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:58.458613    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-bundle" (OuterVolumeSpecName: "bundle") pod "1eb8558c-2996-4ad8-a8e6-96d1ca30a151" (UID: "1eb8558c-2996-4ad8-a8e6-96d1ca30a151"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:51:58.459886 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:58.459861    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-kube-api-access-fd9hx" (OuterVolumeSpecName: "kube-api-access-fd9hx") pod "1eb8558c-2996-4ad8-a8e6-96d1ca30a151" (UID: "1eb8558c-2996-4ad8-a8e6-96d1ca30a151"). InnerVolumeSpecName "kube-api-access-fd9hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:51:58.462887 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:58.462867    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-util" (OuterVolumeSpecName: "util") pod "1eb8558c-2996-4ad8-a8e6-96d1ca30a151" (UID: "1eb8558c-2996-4ad8-a8e6-96d1ca30a151"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:51:58.558418 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:58.558396    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd9hx\" (UniqueName: \"kubernetes.io/projected/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-kube-api-access-fd9hx\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:51:58.558418 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:58.558417    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:51:58.558521 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:58.558426    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1eb8558c-2996-4ad8-a8e6-96d1ca30a151-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:51:59.274652 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:59.274614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz" event={"ID":"1eb8558c-2996-4ad8-a8e6-96d1ca30a151","Type":"ContainerDied","Data":"bdb5e05b9e1f5f9c79f885e0ffd0fe057adcb0adb7776a4857d01dfaa644bc4f"}
Jul 11 03:51:59.274802 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:59.274683    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cm4pz"
Jul 11 03:51:59.274802 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:51:59.274699    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdb5e05b9e1f5f9c79f885e0ffd0fe057adcb0adb7776a4857d01dfaa644bc4f"
Jul 11 03:52:04.109339 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.109286    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk"]
Jul 11 03:52:04.109906 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.109887    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672e5af8-3141-46c0-92a9-67d27f7dfd37" containerName="console"
Jul 11 03:52:04.110043 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.109908    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="672e5af8-3141-46c0-92a9-67d27f7dfd37" containerName="console"
Jul 11 03:52:04.110043 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.109944    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb8558c-2996-4ad8-a8e6-96d1ca30a151" containerName="pull"
Jul 11 03:52:04.110043 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.109954    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb8558c-2996-4ad8-a8e6-96d1ca30a151" containerName="pull"
Jul 11 03:52:04.110043 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.109972    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb8558c-2996-4ad8-a8e6-96d1ca30a151" containerName="extract"
Jul 11 03:52:04.110043 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.109981    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb8558c-2996-4ad8-a8e6-96d1ca30a151" containerName="extract"
Jul 11 03:52:04.110043 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.110004    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb8558c-2996-4ad8-a8e6-96d1ca30a151" containerName="util"
Jul 11 03:52:04.110043 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.110013    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb8558c-2996-4ad8-a8e6-96d1ca30a151" containerName="util"
Jul 11 03:52:04.110481 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.110121    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="672e5af8-3141-46c0-92a9-67d27f7dfd37" containerName="console"
Jul 11 03:52:04.110481 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.110140    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eb8558c-2996-4ad8-a8e6-96d1ca30a151" containerName="extract"
Jul 11 03:52:04.112825 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.112796    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk"
Jul 11 03:52:04.115262 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.115244    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 11 03:52:04.115405 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.115386    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-h8qb2\""
Jul 11 03:52:04.115472 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.115426    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:52:04.124839 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.124813    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk"]
Jul 11 03:52:04.197314 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.197290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlgl6\" (UniqueName: \"kubernetes.io/projected/6821d711-64c8-4da3-87b3-b3d117f35552-kube-api-access-jlgl6\") pod \"cert-manager-operator-controller-manager-55c444bf86-s48kk\" (UID: \"6821d711-64c8-4da3-87b3-b3d117f35552\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk"
Jul 11 03:52:04.197422 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.197320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6821d711-64c8-4da3-87b3-b3d117f35552-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s48kk\" (UID: \"6821d711-64c8-4da3-87b3-b3d117f35552\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk"
Jul 11 03:52:04.297794 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.297769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlgl6\" (UniqueName: \"kubernetes.io/projected/6821d711-64c8-4da3-87b3-b3d117f35552-kube-api-access-jlgl6\") pod \"cert-manager-operator-controller-manager-55c444bf86-s48kk\" (UID: \"6821d711-64c8-4da3-87b3-b3d117f35552\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk"
Jul 11 03:52:04.297883 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.297798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6821d711-64c8-4da3-87b3-b3d117f35552-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s48kk\" (UID: \"6821d711-64c8-4da3-87b3-b3d117f35552\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk"
Jul 11 03:52:04.298141 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.298126    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6821d711-64c8-4da3-87b3-b3d117f35552-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s48kk\" (UID: \"6821d711-64c8-4da3-87b3-b3d117f35552\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk"
Jul 11 03:52:04.305389 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.305373    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlgl6\" (UniqueName: \"kubernetes.io/projected/6821d711-64c8-4da3-87b3-b3d117f35552-kube-api-access-jlgl6\") pod \"cert-manager-operator-controller-manager-55c444bf86-s48kk\" (UID: \"6821d711-64c8-4da3-87b3-b3d117f35552\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk"
Jul 11 03:52:04.421377 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.421309    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk"
Jul 11 03:52:04.543549 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:04.543518    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk"]
Jul 11 03:52:04.546339 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:52:04.546297    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6821d711_64c8_4da3_87b3_b3d117f35552.slice/crio-f79d124bb48f29ede29bd9e0a253f54038c74dc0c071c56695c77eac02fcf8c8 WatchSource:0}: Error finding container f79d124bb48f29ede29bd9e0a253f54038c74dc0c071c56695c77eac02fcf8c8: Status 404 returned error can't find the container with id f79d124bb48f29ede29bd9e0a253f54038c74dc0c071c56695c77eac02fcf8c8
Jul 11 03:52:05.295578 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:05.295540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk" event={"ID":"6821d711-64c8-4da3-87b3-b3d117f35552","Type":"ContainerStarted","Data":"f79d124bb48f29ede29bd9e0a253f54038c74dc0c071c56695c77eac02fcf8c8"}
Jul 11 03:52:06.301018 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:06.300975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk" event={"ID":"6821d711-64c8-4da3-87b3-b3d117f35552","Type":"ContainerStarted","Data":"a92e1ababfda5c36c7868296719464c542bd983cf55c2a6db8277026293ea492"}
Jul 11 03:52:06.324190 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:06.324144    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s48kk" podStartSLOduration=0.8667144 podStartE2EDuration="2.324129119s" totalImagesPullingTime="1.457414719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:06.322260088 +0000 UTC m=+199.507412543" watchObservedRunningTime="2026-07-11 03:52:06.324129119 +0000 UTC m=+199.509281571"
Jul 11 03:52:07.766916 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.766884    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qtxlw"]
Jul 11 03:52:07.769177 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.769154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw"
Jul 11 03:52:07.771573 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.771555    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 11 03:52:07.771573 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.771568    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 11 03:52:07.778556 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.778538    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qtxlw"]
Jul 11 03:52:07.781888 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.781870    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"]
Jul 11 03:52:07.783772 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.783758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:07.786078 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.786062    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8zgd5\""
Jul 11 03:52:07.786154 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.786094    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 11 03:52:07.786197 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.786163    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 11 03:52:07.799829 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.799795    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"]
Jul 11 03:52:07.821282 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.821257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v54cx\" (UniqueName: \"kubernetes.io/projected/afdaa596-dfc2-4acf-935d-aee7cfd129ad-kube-api-access-v54cx\") pod \"cert-manager-webhook-6486ffd997-qtxlw\" (UID: \"afdaa596-dfc2-4acf-935d-aee7cfd129ad\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw"
Jul 11 03:52:07.821385 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.821305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afdaa596-dfc2-4acf-935d-aee7cfd129ad-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qtxlw\" (UID: \"afdaa596-dfc2-4acf-935d-aee7cfd129ad\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw"
Jul 11 03:52:07.922505 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.922484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:07.922588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.922521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v54cx\" (UniqueName: \"kubernetes.io/projected/afdaa596-dfc2-4acf-935d-aee7cfd129ad-kube-api-access-v54cx\") pod \"cert-manager-webhook-6486ffd997-qtxlw\" (UID: \"afdaa596-dfc2-4acf-935d-aee7cfd129ad\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw"
Jul 11 03:52:07.922588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.922552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afdaa596-dfc2-4acf-935d-aee7cfd129ad-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qtxlw\" (UID: \"afdaa596-dfc2-4acf-935d-aee7cfd129ad\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw"
Jul 11 03:52:07.922588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.922581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnsnm\" (UniqueName: \"kubernetes.io/projected/d74a3959-c196-4fc8-8c7f-6fddfdb20100-kube-api-access-tnsnm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:07.922700 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.922607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:07.930108 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.930079    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afdaa596-dfc2-4acf-935d-aee7cfd129ad-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qtxlw\" (UID: \"afdaa596-dfc2-4acf-935d-aee7cfd129ad\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw"
Jul 11 03:52:07.930204 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:07.930190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v54cx\" (UniqueName: \"kubernetes.io/projected/afdaa596-dfc2-4acf-935d-aee7cfd129ad-kube-api-access-v54cx\") pod \"cert-manager-webhook-6486ffd997-qtxlw\" (UID: \"afdaa596-dfc2-4acf-935d-aee7cfd129ad\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw"
Jul 11 03:52:08.023307 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.023287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnsnm\" (UniqueName: \"kubernetes.io/projected/d74a3959-c196-4fc8-8c7f-6fddfdb20100-kube-api-access-tnsnm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:08.023434 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.023341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:08.023434 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.023361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:08.023674 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.023659    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:08.023714 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.023698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:08.030486 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.030466    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnsnm\" (UniqueName: \"kubernetes.io/projected/d74a3959-c196-4fc8-8c7f-6fddfdb20100-kube-api-access-tnsnm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:08.088441 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.088412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw"
Jul 11 03:52:08.099302 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.099270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:08.218819 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.218791    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qtxlw"]
Jul 11 03:52:08.221058 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:52:08.221032    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafdaa596_dfc2_4acf_935d_aee7cfd129ad.slice/crio-4799c7529c52e4f70223abd3a32f59f19c865b8f58a56177dbc8acbfb57c0edc WatchSource:0}: Error finding container 4799c7529c52e4f70223abd3a32f59f19c865b8f58a56177dbc8acbfb57c0edc: Status 404 returned error can't find the container with id 4799c7529c52e4f70223abd3a32f59f19c865b8f58a56177dbc8acbfb57c0edc
Jul 11 03:52:08.238606 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.238590    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"]
Jul 11 03:52:08.240612 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:52:08.240593    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74a3959_c196_4fc8_8c7f_6fddfdb20100.slice/crio-7e18efa4e5b0f829f49176df8d62beaa2fbdc7c25337a4d9f090e0f27ec8f4a5 WatchSource:0}: Error finding container 7e18efa4e5b0f829f49176df8d62beaa2fbdc7c25337a4d9f090e0f27ec8f4a5: Status 404 returned error can't find the container with id 7e18efa4e5b0f829f49176df8d62beaa2fbdc7c25337a4d9f090e0f27ec8f4a5
Jul 11 03:52:08.310500 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.310469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw" event={"ID":"afdaa596-dfc2-4acf-935d-aee7cfd129ad","Type":"ContainerStarted","Data":"4799c7529c52e4f70223abd3a32f59f19c865b8f58a56177dbc8acbfb57c0edc"}
Jul 11 03:52:08.311904 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.311866    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw" event={"ID":"d74a3959-c196-4fc8-8c7f-6fddfdb20100","Type":"ContainerStarted","Data":"c549910adaead869217074e5a6fb1ac8cb9d8e43b4b6e42eac0b452391236466"}
Jul 11 03:52:08.312009 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:08.311917    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw" event={"ID":"d74a3959-c196-4fc8-8c7f-6fddfdb20100","Type":"ContainerStarted","Data":"7e18efa4e5b0f829f49176df8d62beaa2fbdc7c25337a4d9f090e0f27ec8f4a5"}
Jul 11 03:52:09.318368 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:09.318307    2576 generic.go:356] "Generic (PLEG): container finished" podID="d74a3959-c196-4fc8-8c7f-6fddfdb20100" containerID="c549910adaead869217074e5a6fb1ac8cb9d8e43b4b6e42eac0b452391236466" exitCode=0
Jul 11 03:52:09.318762 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:09.318361    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw" event={"ID":"d74a3959-c196-4fc8-8c7f-6fddfdb20100","Type":"ContainerDied","Data":"c549910adaead869217074e5a6fb1ac8cb9d8e43b4b6e42eac0b452391236466"}
Jul 11 03:52:09.988432 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:09.988404    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb"]
Jul 11 03:52:09.990526 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:09.990505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb"
Jul 11 03:52:09.992717 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:09.992694    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nt5jk\""
Jul 11 03:52:10.000052 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:10.000030    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb"]
Jul 11 03:52:10.141216 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:10.141177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pl9nb\" (UID: \"ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb"
Jul 11 03:52:10.141419 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:10.141237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bl87\" (UniqueName: \"kubernetes.io/projected/ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c-kube-api-access-2bl87\") pod \"cert-manager-cainjector-559cdd8c87-pl9nb\" (UID: \"ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb"
Jul 11 03:52:10.242651 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:10.242559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pl9nb\" (UID: \"ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb"
Jul 11 03:52:10.242651 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:10.242616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bl87\" (UniqueName: \"kubernetes.io/projected/ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c-kube-api-access-2bl87\") pod \"cert-manager-cainjector-559cdd8c87-pl9nb\" (UID: \"ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb"
Jul 11 03:52:10.251536 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:10.251486    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pl9nb\" (UID: \"ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb"
Jul 11 03:52:10.251728 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:10.251707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bl87\" (UniqueName: \"kubernetes.io/projected/ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c-kube-api-access-2bl87\") pod \"cert-manager-cainjector-559cdd8c87-pl9nb\" (UID: \"ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb"
Jul 11 03:52:10.302542 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:10.302513    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb"
Jul 11 03:52:11.715546 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:11.715436    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb"]
Jul 11 03:52:11.717766 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:52:11.717741    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddca0a9c_b0a7_4b43_b8ba_9030184bdd2c.slice/crio-b102d716d092552e9719fdce493b68242578615789cefb8dca49799e1191f1ba WatchSource:0}: Error finding container b102d716d092552e9719fdce493b68242578615789cefb8dca49799e1191f1ba: Status 404 returned error can't find the container with id b102d716d092552e9719fdce493b68242578615789cefb8dca49799e1191f1ba
Jul 11 03:52:12.332362 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:12.332306    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw" event={"ID":"afdaa596-dfc2-4acf-935d-aee7cfd129ad","Type":"ContainerStarted","Data":"72d8888d373b8943b9817ca74a0740db7c903b890ae542d174d2bef7877827e2"}
Jul 11 03:52:12.332675 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:12.332502    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw"
Jul 11 03:52:12.334034 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:12.334011    2576 generic.go:356] "Generic (PLEG): container finished" podID="d74a3959-c196-4fc8-8c7f-6fddfdb20100" containerID="42c6e8d661ba3801cc307cb25ce6fc1a030d1899f61a5b83800bb9c0450a5c9f" exitCode=0
Jul 11 03:52:12.334153 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:12.334095    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw" event={"ID":"d74a3959-c196-4fc8-8c7f-6fddfdb20100","Type":"ContainerDied","Data":"42c6e8d661ba3801cc307cb25ce6fc1a030d1899f61a5b83800bb9c0450a5c9f"}
Jul 11 03:52:12.335584 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:12.335561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb" event={"ID":"ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c","Type":"ContainerStarted","Data":"8a8e59fbdb78902103493947851d8e2a99babe79c2b19bf858e98489e3f7eb88"}
Jul 11 03:52:12.335678 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:12.335595    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb" event={"ID":"ddca0a9c-b0a7-4b43-b8ba-9030184bdd2c","Type":"ContainerStarted","Data":"b102d716d092552e9719fdce493b68242578615789cefb8dca49799e1191f1ba"}
Jul 11 03:52:12.346061 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:12.346017    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw" podStartSLOduration=1.970844627 podStartE2EDuration="5.346000721s" totalImagesPullingTime="3.375156094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:12.345598906 +0000 UTC m=+205.530751383" watchObservedRunningTime="2026-07-11 03:52:12.346000721 +0000 UTC m=+205.531153178"
Jul 11 03:52:12.358248 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:12.358214    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pl9nb" podStartSLOduration=3.358201909 podStartE2EDuration="3.358201909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:12.357876993 +0000 UTC m=+205.543029471" watchObservedRunningTime="2026-07-11 03:52:12.358201909 +0000 UTC m=+205.543354363"
Jul 11 03:52:13.341158 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:13.341124    2576 generic.go:356] "Generic (PLEG): container finished" podID="d74a3959-c196-4fc8-8c7f-6fddfdb20100" containerID="85e5d310843fb6bc9978d9b183dcb40cf6c34f933c42d8713cb6ab6db1e2ae86" exitCode=0
Jul 11 03:52:13.341609 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:13.341203    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw" event={"ID":"d74a3959-c196-4fc8-8c7f-6fddfdb20100","Type":"ContainerDied","Data":"85e5d310843fb6bc9978d9b183dcb40cf6c34f933c42d8713cb6ab6db1e2ae86"}
Jul 11 03:52:14.462876 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:14.462853    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:14.574665 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:14.574638    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-bundle\") pod \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") "
Jul 11 03:52:14.574798 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:14.574737    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-util\") pod \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") "
Jul 11 03:52:14.574798 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:14.574773    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnsnm\" (UniqueName: \"kubernetes.io/projected/d74a3959-c196-4fc8-8c7f-6fddfdb20100-kube-api-access-tnsnm\") pod \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\" (UID: \"d74a3959-c196-4fc8-8c7f-6fddfdb20100\") "
Jul 11 03:52:14.575035 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:14.575012    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-bundle" (OuterVolumeSpecName: "bundle") pod "d74a3959-c196-4fc8-8c7f-6fddfdb20100" (UID: "d74a3959-c196-4fc8-8c7f-6fddfdb20100"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:52:14.576681 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:14.576657    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74a3959-c196-4fc8-8c7f-6fddfdb20100-kube-api-access-tnsnm" (OuterVolumeSpecName: "kube-api-access-tnsnm") pod "d74a3959-c196-4fc8-8c7f-6fddfdb20100" (UID: "d74a3959-c196-4fc8-8c7f-6fddfdb20100"). InnerVolumeSpecName "kube-api-access-tnsnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:52:14.579221 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:14.579202    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-util" (OuterVolumeSpecName: "util") pod "d74a3959-c196-4fc8-8c7f-6fddfdb20100" (UID: "d74a3959-c196-4fc8-8c7f-6fddfdb20100"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:52:14.676128 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:14.676078    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:52:14.676128 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:14.676097    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnsnm\" (UniqueName: \"kubernetes.io/projected/d74a3959-c196-4fc8-8c7f-6fddfdb20100-kube-api-access-tnsnm\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:52:14.676128 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:14.676107    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d74a3959-c196-4fc8-8c7f-6fddfdb20100-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:52:15.349782 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:15.349751    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw" event={"ID":"d74a3959-c196-4fc8-8c7f-6fddfdb20100","Type":"ContainerDied","Data":"7e18efa4e5b0f829f49176df8d62beaa2fbdc7c25337a4d9f090e0f27ec8f4a5"}
Jul 11 03:52:15.349782 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:15.349780    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fllgnw"
Jul 11 03:52:15.349998 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:15.349804    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e18efa4e5b0f829f49176df8d62beaa2fbdc7c25337a4d9f090e0f27ec8f4a5"
Jul 11 03:52:18.343198 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.343164    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qtxlw"
Jul 11 03:52:18.492222 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.492192    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tvbdz"]
Jul 11 03:52:18.492460 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.492449    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74a3959-c196-4fc8-8c7f-6fddfdb20100" containerName="util"
Jul 11 03:52:18.492513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.492462    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74a3959-c196-4fc8-8c7f-6fddfdb20100" containerName="util"
Jul 11 03:52:18.492513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.492483    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74a3959-c196-4fc8-8c7f-6fddfdb20100" containerName="extract"
Jul 11 03:52:18.492513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.492488    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74a3959-c196-4fc8-8c7f-6fddfdb20100" containerName="extract"
Jul 11 03:52:18.492513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.492495    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74a3959-c196-4fc8-8c7f-6fddfdb20100" containerName="pull"
Jul 11 03:52:18.492513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.492500    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74a3959-c196-4fc8-8c7f-6fddfdb20100" containerName="pull"
Jul 11 03:52:18.492646 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.492540    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74a3959-c196-4fc8-8c7f-6fddfdb20100" containerName="extract"
Jul 11 03:52:18.496952 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.496936    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tvbdz"
Jul 11 03:52:18.498893 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.498873    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-p8pmn\""
Jul 11 03:52:18.501828 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.501804    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tvbdz"]
Jul 11 03:52:18.602121 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.602062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdrxm\" (UniqueName: \"kubernetes.io/projected/8fbbf5df-bf32-489b-91d3-07c2d40097f7-kube-api-access-sdrxm\") pod \"cert-manager-55b4d954d5-tvbdz\" (UID: \"8fbbf5df-bf32-489b-91d3-07c2d40097f7\") " pod="cert-manager/cert-manager-55b4d954d5-tvbdz"
Jul 11 03:52:18.602230 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.602122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fbbf5df-bf32-489b-91d3-07c2d40097f7-bound-sa-token\") pod \"cert-manager-55b4d954d5-tvbdz\" (UID: \"8fbbf5df-bf32-489b-91d3-07c2d40097f7\") " pod="cert-manager/cert-manager-55b4d954d5-tvbdz"
Jul 11 03:52:18.703343 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.703299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdrxm\" (UniqueName: \"kubernetes.io/projected/8fbbf5df-bf32-489b-91d3-07c2d40097f7-kube-api-access-sdrxm\") pod \"cert-manager-55b4d954d5-tvbdz\" (UID: \"8fbbf5df-bf32-489b-91d3-07c2d40097f7\") " pod="cert-manager/cert-manager-55b4d954d5-tvbdz"
Jul 11 03:52:18.703456 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.703361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fbbf5df-bf32-489b-91d3-07c2d40097f7-bound-sa-token\") pod \"cert-manager-55b4d954d5-tvbdz\" (UID: \"8fbbf5df-bf32-489b-91d3-07c2d40097f7\") " pod="cert-manager/cert-manager-55b4d954d5-tvbdz"
Jul 11 03:52:18.711857 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.711833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8fbbf5df-bf32-489b-91d3-07c2d40097f7-bound-sa-token\") pod \"cert-manager-55b4d954d5-tvbdz\" (UID: \"8fbbf5df-bf32-489b-91d3-07c2d40097f7\") " pod="cert-manager/cert-manager-55b4d954d5-tvbdz"
Jul 11 03:52:18.711950 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.711919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdrxm\" (UniqueName: \"kubernetes.io/projected/8fbbf5df-bf32-489b-91d3-07c2d40097f7-kube-api-access-sdrxm\") pod \"cert-manager-55b4d954d5-tvbdz\" (UID: \"8fbbf5df-bf32-489b-91d3-07c2d40097f7\") " pod="cert-manager/cert-manager-55b4d954d5-tvbdz"
Jul 11 03:52:18.806583 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.806560    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tvbdz"
Jul 11 03:52:18.923430 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:18.923394    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tvbdz"]
Jul 11 03:52:18.925718 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:52:18.925694    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fbbf5df_bf32_489b_91d3_07c2d40097f7.slice/crio-92ab4dbef79e28f040d11214be60878f5e1f76d966e5d06fc6b913577c86a11a WatchSource:0}: Error finding container 92ab4dbef79e28f040d11214be60878f5e1f76d966e5d06fc6b913577c86a11a: Status 404 returned error can't find the container with id 92ab4dbef79e28f040d11214be60878f5e1f76d966e5d06fc6b913577c86a11a
Jul 11 03:52:19.365305 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:19.365276    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tvbdz" event={"ID":"8fbbf5df-bf32-489b-91d3-07c2d40097f7","Type":"ContainerStarted","Data":"640f3ac6bdf9e7e8f0ddcdc21d00dd59284ce8e8eb5120f481db27e96b71e714"}
Jul 11 03:52:19.365669 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:19.365313    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tvbdz" event={"ID":"8fbbf5df-bf32-489b-91d3-07c2d40097f7","Type":"ContainerStarted","Data":"92ab4dbef79e28f040d11214be60878f5e1f76d966e5d06fc6b913577c86a11a"}
Jul 11 03:52:19.379679 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:19.379630    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-tvbdz" podStartSLOduration=1.3796130070000001 podStartE2EDuration="1.379613007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:19.379131476 +0000 UTC m=+212.564283930" watchObservedRunningTime="2026-07-11 03:52:19.379613007 +0000 UTC m=+212.564765460"
Jul 11 03:52:21.734973 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:21.734938    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d"]
Jul 11 03:52:21.769759 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:21.769734    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d"]
Jul 11 03:52:21.769889 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:21.769815    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d"
Jul 11 03:52:21.772295 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:21.772273    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 11 03:52:21.772422 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:21.772410    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 11 03:52:21.773144 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:21.773125    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-csdkf\""
Jul 11 03:52:21.925732 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:21.925702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15f40927-7f56-47f0-bf10-85a834df2ca8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cwj6d\" (UID: \"15f40927-7f56-47f0-bf10-85a834df2ca8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d"
Jul 11 03:52:21.925867 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:21.925742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjlrn\" (UniqueName: \"kubernetes.io/projected/15f40927-7f56-47f0-bf10-85a834df2ca8-kube-api-access-bjlrn\") pod \"openshift-lws-operator-fd8ccff4c-cwj6d\" (UID: \"15f40927-7f56-47f0-bf10-85a834df2ca8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d"
Jul 11 03:52:22.026342 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:22.026300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjlrn\" (UniqueName: \"kubernetes.io/projected/15f40927-7f56-47f0-bf10-85a834df2ca8-kube-api-access-bjlrn\") pod \"openshift-lws-operator-fd8ccff4c-cwj6d\" (UID: \"15f40927-7f56-47f0-bf10-85a834df2ca8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d"
Jul 11 03:52:22.026484 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:22.026383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15f40927-7f56-47f0-bf10-85a834df2ca8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cwj6d\" (UID: \"15f40927-7f56-47f0-bf10-85a834df2ca8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d"
Jul 11 03:52:22.026686 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:22.026671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15f40927-7f56-47f0-bf10-85a834df2ca8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cwj6d\" (UID: \"15f40927-7f56-47f0-bf10-85a834df2ca8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d"
Jul 11 03:52:22.033942 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:22.033918    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjlrn\" (UniqueName: \"kubernetes.io/projected/15f40927-7f56-47f0-bf10-85a834df2ca8-kube-api-access-bjlrn\") pod \"openshift-lws-operator-fd8ccff4c-cwj6d\" (UID: \"15f40927-7f56-47f0-bf10-85a834df2ca8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d"
Jul 11 03:52:22.078849 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:22.078826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d"
Jul 11 03:52:22.227450 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:22.227427    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d"]
Jul 11 03:52:22.229750 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:52:22.229719    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15f40927_7f56_47f0_bf10_85a834df2ca8.slice/crio-3d3376e0855046060c1ad229c4e92205a717cf7fe2617ba9bfb24f5ee65c02e4 WatchSource:0}: Error finding container 3d3376e0855046060c1ad229c4e92205a717cf7fe2617ba9bfb24f5ee65c02e4: Status 404 returned error can't find the container with id 3d3376e0855046060c1ad229c4e92205a717cf7fe2617ba9bfb24f5ee65c02e4
Jul 11 03:52:22.377062 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:22.377002    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d" event={"ID":"15f40927-7f56-47f0-bf10-85a834df2ca8","Type":"ContainerStarted","Data":"3d3376e0855046060c1ad229c4e92205a717cf7fe2617ba9bfb24f5ee65c02e4"}
Jul 11 03:52:25.390745 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:25.390709    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d" event={"ID":"15f40927-7f56-47f0-bf10-85a834df2ca8","Type":"ContainerStarted","Data":"2d8919b183624113643c75a65a98492c4228a2fdf7534ee680b50affa192c326"}
Jul 11 03:52:25.405813 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:25.405769    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cwj6d" podStartSLOduration=2.052682616 podStartE2EDuration="4.405753769s" totalImagesPullingTime="2.353071153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:25.404565962 +0000 UTC m=+218.589718416" watchObservedRunningTime="2026-07-11 03:52:25.405753769 +0000 UTC m=+218.590906222"
Jul 11 03:52:27.808695 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:27.808664    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"]
Jul 11 03:52:27.834342 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:27.834306    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"]
Jul 11 03:52:27.834465 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:27.834412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:27.836515 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:27.836495    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 11 03:52:27.836515 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:27.836509    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8zgd5\""
Jul 11 03:52:27.837267 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:27.837253    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 11 03:52:27.973579 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:27.973549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:27.973715 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:27.973586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgs4l\" (UniqueName: \"kubernetes.io/projected/d7a9b18c-be86-4347-8591-584a08f367e7-kube-api-access-kgs4l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:27.973715 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:27.973660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:28.074879 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:28.074810    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:28.074879 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:28.074862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:28.075020 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:28.074888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgs4l\" (UniqueName: \"kubernetes.io/projected/d7a9b18c-be86-4347-8591-584a08f367e7-kube-api-access-kgs4l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:28.075175 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:28.075155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:28.075229 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:28.075212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:28.082402 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:28.082375    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgs4l\" (UniqueName: \"kubernetes.io/projected/d7a9b18c-be86-4347-8591-584a08f367e7-kube-api-access-kgs4l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:28.142543 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:28.142522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:28.283585 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:28.283561    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"]
Jul 11 03:52:28.285948 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:52:28.285923    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a9b18c_be86_4347_8591_584a08f367e7.slice/crio-631365e954c38ca55a3c6ccc4a25c975421c7f44c3ab743d29ab96da699a4461 WatchSource:0}: Error finding container 631365e954c38ca55a3c6ccc4a25c975421c7f44c3ab743d29ab96da699a4461: Status 404 returned error can't find the container with id 631365e954c38ca55a3c6ccc4a25c975421c7f44c3ab743d29ab96da699a4461
Jul 11 03:52:28.408344 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:28.408299    2576 generic.go:356] "Generic (PLEG): container finished" podID="d7a9b18c-be86-4347-8591-584a08f367e7" containerID="7e7c8cc4bb5dc095528dc8551bbc9b39a53241e7e8bf269cc44e07354b87724c" exitCode=0
Jul 11 03:52:28.408439 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:28.408355    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml" event={"ID":"d7a9b18c-be86-4347-8591-584a08f367e7","Type":"ContainerDied","Data":"7e7c8cc4bb5dc095528dc8551bbc9b39a53241e7e8bf269cc44e07354b87724c"}
Jul 11 03:52:28.408439 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:28.408395    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml" event={"ID":"d7a9b18c-be86-4347-8591-584a08f367e7","Type":"ContainerStarted","Data":"631365e954c38ca55a3c6ccc4a25c975421c7f44c3ab743d29ab96da699a4461"}
Jul 11 03:52:29.413846 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:29.413814    2576 generic.go:356] "Generic (PLEG): container finished" podID="d7a9b18c-be86-4347-8591-584a08f367e7" containerID="645ae6d01acc40c13c014c1c780bedd166b59e0356bfdcf0d9780a9dcaa3ca7d" exitCode=0
Jul 11 03:52:29.414152 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:29.413858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml" event={"ID":"d7a9b18c-be86-4347-8591-584a08f367e7","Type":"ContainerDied","Data":"645ae6d01acc40c13c014c1c780bedd166b59e0356bfdcf0d9780a9dcaa3ca7d"}
Jul 11 03:52:30.420140 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:30.420112    2576 generic.go:356] "Generic (PLEG): container finished" podID="d7a9b18c-be86-4347-8591-584a08f367e7" containerID="f1594b0abac55bdfb3637ed1f9372f43d4d88eb79e12763272d9c1fba77cb7d8" exitCode=0
Jul 11 03:52:30.420520 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:30.420163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml" event={"ID":"d7a9b18c-be86-4347-8591-584a08f367e7","Type":"ContainerDied","Data":"f1594b0abac55bdfb3637ed1f9372f43d4d88eb79e12763272d9c1fba77cb7d8"}
Jul 11 03:52:31.544540 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:31.544517    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:31.702943 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:31.702881    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-util\") pod \"d7a9b18c-be86-4347-8591-584a08f367e7\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") "
Jul 11 03:52:31.702943 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:31.702920    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-bundle\") pod \"d7a9b18c-be86-4347-8591-584a08f367e7\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") "
Jul 11 03:52:31.703132 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:31.702947    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgs4l\" (UniqueName: \"kubernetes.io/projected/d7a9b18c-be86-4347-8591-584a08f367e7-kube-api-access-kgs4l\") pod \"d7a9b18c-be86-4347-8591-584a08f367e7\" (UID: \"d7a9b18c-be86-4347-8591-584a08f367e7\") "
Jul 11 03:52:31.703741 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:31.703708    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-bundle" (OuterVolumeSpecName: "bundle") pod "d7a9b18c-be86-4347-8591-584a08f367e7" (UID: "d7a9b18c-be86-4347-8591-584a08f367e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:52:31.704911 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:31.704888    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7a9b18c-be86-4347-8591-584a08f367e7-kube-api-access-kgs4l" (OuterVolumeSpecName: "kube-api-access-kgs4l") pod "d7a9b18c-be86-4347-8591-584a08f367e7" (UID: "d7a9b18c-be86-4347-8591-584a08f367e7"). InnerVolumeSpecName "kube-api-access-kgs4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:52:31.708643 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:31.708621    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-util" (OuterVolumeSpecName: "util") pod "d7a9b18c-be86-4347-8591-584a08f367e7" (UID: "d7a9b18c-be86-4347-8591-584a08f367e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:52:31.803696 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:31.803669    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:52:31.803892 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:31.803867    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7a9b18c-be86-4347-8591-584a08f367e7-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:52:31.803892 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:31.803893    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgs4l\" (UniqueName: \"kubernetes.io/projected/d7a9b18c-be86-4347-8591-584a08f367e7-kube-api-access-kgs4l\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:52:32.430993 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:32.430947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml" event={"ID":"d7a9b18c-be86-4347-8591-584a08f367e7","Type":"ContainerDied","Data":"631365e954c38ca55a3c6ccc4a25c975421c7f44c3ab743d29ab96da699a4461"}
Jul 11 03:52:32.431262 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:32.431244    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="631365e954c38ca55a3c6ccc4a25c975421c7f44c3ab743d29ab96da699a4461"
Jul 11 03:52:32.431480 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:32.431467    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb74ml"
Jul 11 03:52:42.182986 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.182953    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"]
Jul 11 03:52:42.183367 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.183222    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a9b18c-be86-4347-8591-584a08f367e7" containerName="extract"
Jul 11 03:52:42.183367 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.183232    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a9b18c-be86-4347-8591-584a08f367e7" containerName="extract"
Jul 11 03:52:42.183367 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.183243    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a9b18c-be86-4347-8591-584a08f367e7" containerName="pull"
Jul 11 03:52:42.183367 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.183248    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a9b18c-be86-4347-8591-584a08f367e7" containerName="pull"
Jul 11 03:52:42.183367 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.183256    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a9b18c-be86-4347-8591-584a08f367e7" containerName="util"
Jul 11 03:52:42.183367 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.183261    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a9b18c-be86-4347-8591-584a08f367e7" containerName="util"
Jul 11 03:52:42.183367 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.183318    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a9b18c-be86-4347-8591-584a08f367e7" containerName="extract"
Jul 11 03:52:42.185470 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.185447    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.187967 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.187947    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 11 03:52:42.188247 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.188230    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fmr67\""
Jul 11 03:52:42.188310 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.188273    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 11 03:52:42.188310 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.188288    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 11 03:52:42.194258 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.194238    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"]
Jul 11 03:52:42.272526 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.272497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/11598c68-a1f1-486b-8cd6-0912f95b2377-manager-config\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.272656 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.272541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/11598c68-a1f1-486b-8cd6-0912f95b2377-metrics-cert\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.272656 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.272577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77z5l\" (UniqueName: \"kubernetes.io/projected/11598c68-a1f1-486b-8cd6-0912f95b2377-kube-api-access-77z5l\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.272760 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.272660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11598c68-a1f1-486b-8cd6-0912f95b2377-cert\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.373190 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.373130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11598c68-a1f1-486b-8cd6-0912f95b2377-cert\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.373190 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.373170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/11598c68-a1f1-486b-8cd6-0912f95b2377-manager-config\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.373379 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.373192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/11598c68-a1f1-486b-8cd6-0912f95b2377-metrics-cert\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.373379 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.373315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77z5l\" (UniqueName: \"kubernetes.io/projected/11598c68-a1f1-486b-8cd6-0912f95b2377-kube-api-access-77z5l\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.373893 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.373874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/11598c68-a1f1-486b-8cd6-0912f95b2377-manager-config\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.375566 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.375547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11598c68-a1f1-486b-8cd6-0912f95b2377-cert\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.375658 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.375640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/11598c68-a1f1-486b-8cd6-0912f95b2377-metrics-cert\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.381732 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.381710    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77z5l\" (UniqueName: \"kubernetes.io/projected/11598c68-a1f1-486b-8cd6-0912f95b2377-kube-api-access-77z5l\") pod \"lws-controller-manager-84fcd84596-kn892\" (UID: \"11598c68-a1f1-486b-8cd6-0912f95b2377\") " pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.494255 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.494229    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:42.620478 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.620453    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"]
Jul 11 03:52:42.621572 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:52:42.621548    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11598c68_a1f1_486b_8cd6_0912f95b2377.slice/crio-0f13e80bed449e30f786d22a9d37d8341ea39b75471e43e5057524635e8d347a WatchSource:0}: Error finding container 0f13e80bed449e30f786d22a9d37d8341ea39b75471e43e5057524635e8d347a: Status 404 returned error can't find the container with id 0f13e80bed449e30f786d22a9d37d8341ea39b75471e43e5057524635e8d347a
Jul 11 03:52:42.637348 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.636718    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"]
Jul 11 03:52:42.641027 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.641002    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.642944 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.642925    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 11 03:52:42.643060 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.643043    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 11 03:52:42.643554 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.643540    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 11 03:52:42.643627 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.643579    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-frqbb\""
Jul 11 03:52:42.643689 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.643626    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 11 03:52:42.654248 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.654228    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"]
Jul 11 03:52:42.776513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.776488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt47f\" (UniqueName: \"kubernetes.io/projected/a0014c32-4b60-4675-881c-d44bf580a406-kube-api-access-nt47f\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.776610 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.776521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0014c32-4b60-4675-881c-d44bf580a406-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.776660 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.776627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0014c32-4b60-4675-881c-d44bf580a406-manifests\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.776660 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.776655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0014c32-4b60-4675-881c-d44bf580a406-tmp\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.776742 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.776669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0014c32-4b60-4675-881c-d44bf580a406-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.877399 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.877323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0014c32-4b60-4675-881c-d44bf580a406-manifests\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.877399 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.877377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0014c32-4b60-4675-881c-d44bf580a406-tmp\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.877553 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.877403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0014c32-4b60-4675-881c-d44bf580a406-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.877553 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.877435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt47f\" (UniqueName: \"kubernetes.io/projected/a0014c32-4b60-4675-881c-d44bf580a406-kube-api-access-nt47f\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.877553 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.877459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0014c32-4b60-4675-881c-d44bf580a406-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.877706 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.877689    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a0014c32-4b60-4675-881c-d44bf580a406-manifests\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.879458 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.879436    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0014c32-4b60-4675-881c-d44bf580a406-tmp\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.879644 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.879629    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0014c32-4b60-4675-881c-d44bf580a406-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.879683 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.879666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a0014c32-4b60-4675-881c-d44bf580a406-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.885039 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.885017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt47f\" (UniqueName: \"kubernetes.io/projected/a0014c32-4b60-4675-881c-d44bf580a406-kube-api-access-nt47f\") pod \"opendatahub-operator-controller-manager-84f9769f6c-9bcvn\" (UID: \"a0014c32-4b60-4675-881c-d44bf580a406\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:42.950690 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:42.950660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:43.080108 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:43.080001    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"]
Jul 11 03:52:43.082165 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:52:43.082140    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0014c32_4b60_4675_881c_d44bf580a406.slice/crio-e0966d2975f671941d2285bd4ef353163dfc6fbd16b535f28331697fb608f136 WatchSource:0}: Error finding container e0966d2975f671941d2285bd4ef353163dfc6fbd16b535f28331697fb608f136: Status 404 returned error can't find the container with id e0966d2975f671941d2285bd4ef353163dfc6fbd16b535f28331697fb608f136
Jul 11 03:52:43.477981 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:43.477943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892" event={"ID":"11598c68-a1f1-486b-8cd6-0912f95b2377","Type":"ContainerStarted","Data":"0f13e80bed449e30f786d22a9d37d8341ea39b75471e43e5057524635e8d347a"}
Jul 11 03:52:43.478943 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:43.478913    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn" event={"ID":"a0014c32-4b60-4675-881c-d44bf580a406","Type":"ContainerStarted","Data":"e0966d2975f671941d2285bd4ef353163dfc6fbd16b535f28331697fb608f136"}
Jul 11 03:52:44.487392 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:44.487310    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892" event={"ID":"11598c68-a1f1-486b-8cd6-0912f95b2377","Type":"ContainerStarted","Data":"155c5b4ed6af9f0d39fe48cd6ccf72425914d4b857b4fb473873f4641b2fd3a5"}
Jul 11 03:52:44.487823 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:44.487475    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:44.504705 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:44.504655    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892" podStartSLOduration=0.830669521 podStartE2EDuration="2.504640231s" totalImagesPullingTime="1.67397071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:44.502683719 +0000 UTC m=+237.687836202" watchObservedRunningTime="2026-07-11 03:52:44.504640231 +0000 UTC m=+237.689792685"
Jul 11 03:52:46.497433 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:46.497404    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn" event={"ID":"a0014c32-4b60-4675-881c-d44bf580a406","Type":"ContainerStarted","Data":"a64c5ad50a32e4f9982f164d1b090396479e371dccd09374dcf4920b5f1e9488"}
Jul 11 03:52:47.502779 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:47.502709    2576 generic.go:356] "Generic (PLEG): container finished" podID="a0014c32-4b60-4675-881c-d44bf580a406" containerID="a64c5ad50a32e4f9982f164d1b090396479e371dccd09374dcf4920b5f1e9488" exitCode=0
Jul 11 03:52:47.503166 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:47.502780    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn" event={"ID":"a0014c32-4b60-4675-881c-d44bf580a406","Type":"ContainerDied","Data":"a64c5ad50a32e4f9982f164d1b090396479e371dccd09374dcf4920b5f1e9488"}
Jul 11 03:52:48.509016 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:48.508977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn" event={"ID":"a0014c32-4b60-4675-881c-d44bf580a406","Type":"ContainerStarted","Data":"f9ca57899f141fffb13f5ff55a93007d258a1d6a0b47162864d87f362b01c72e"}
Jul 11 03:52:48.509424 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:48.509074    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:52:48.528492 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:48.528447    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn" podStartSLOduration=2.206012995 podStartE2EDuration="6.528434253s" totalImagesPullingTime="3.321282574s" totalInitContainerRuntime="1.001138684s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:48.526056797 +0000 UTC m=+241.711209261" watchObservedRunningTime="2026-07-11 03:52:48.528434253 +0000 UTC m=+241.713586706"
Jul 11 03:52:55.493462 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:55.493431    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84fcd84596-kn892"
Jul 11 03:52:59.519336 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:52:59.519307    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84f9769f6c-9bcvn"
Jul 11 03:53:14.817488 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.817414    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"]
Jul 11 03:53:14.820758 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.820741    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:14.823447 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.823425    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 11 03:53:14.823559 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.823445    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 11 03:53:14.823559 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.823429    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 11 03:53:14.823559 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.823449    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kdvwm\""
Jul 11 03:53:14.823789 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.823774    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 11 03:53:14.823869 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.823812    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 11 03:53:14.825664 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.825649    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 11 03:53:14.841680 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.841655    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"]
Jul 11 03:53:14.922506 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.922478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d234f45-7b1c-49e5-aa5c-c87f255ce492-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:14.922652 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.922511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:14.922652 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.922564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d234f45-7b1c-49e5-aa5c-c87f255ce492-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:14.922652 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.922578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:14.922652 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.922597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:14.922652 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.922621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:14.922827 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:14.922698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75w6z\" (UniqueName: \"kubernetes.io/projected/3d234f45-7b1c-49e5-aa5c-c87f255ce492-kube-api-access-75w6z\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.023187 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.023155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d234f45-7b1c-49e5-aa5c-c87f255ce492-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.023187 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.023187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.023363 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.023209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.023363 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.023231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.023363 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.023258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75w6z\" (UniqueName: \"kubernetes.io/projected/3d234f45-7b1c-49e5-aa5c-c87f255ce492-kube-api-access-75w6z\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.023363 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.023294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d234f45-7b1c-49e5-aa5c-c87f255ce492-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.023363 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.023318    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.023980 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.023954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.025529 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.025498    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d234f45-7b1c-49e5-aa5c-c87f255ce492-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.025662 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.025642    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.025702 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.025646    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d234f45-7b1c-49e5-aa5c-c87f255ce492-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.025735 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.025721    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.031894 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.031866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d234f45-7b1c-49e5-aa5c-c87f255ce492-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.032168 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.032152    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75w6z\" (UniqueName: \"kubernetes.io/projected/3d234f45-7b1c-49e5-aa5c-c87f255ce492-kube-api-access-75w6z\") pod \"istiod-openshift-gateway-94bb8fbfd-lwdz5\" (UID: \"3d234f45-7b1c-49e5-aa5c-c87f255ce492\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.130032 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.129964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:15.262855 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.262807    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"]
Jul 11 03:53:15.265640 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:53:15.265614    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d234f45_7b1c_49e5_aa5c_c87f255ce492.slice/crio-4722793e47433e30770db2bdb6cabb805da69c41d07dfdf1c563ff8a0f673c3f WatchSource:0}: Error finding container 4722793e47433e30770db2bdb6cabb805da69c41d07dfdf1c563ff8a0f673c3f: Status 404 returned error can't find the container with id 4722793e47433e30770db2bdb6cabb805da69c41d07dfdf1c563ff8a0f673c3f
Jul 11 03:53:15.633170 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:15.633123    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5" event={"ID":"3d234f45-7b1c-49e5-aa5c-c87f255ce492","Type":"ContainerStarted","Data":"4722793e47433e30770db2bdb6cabb805da69c41d07dfdf1c563ff8a0f673c3f"}
Jul 11 03:53:17.538240 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:17.538196    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 03:53:17.538529 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:17.538275    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 03:53:17.646636 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:17.646586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5" event={"ID":"3d234f45-7b1c-49e5-aa5c-c87f255ce492","Type":"ContainerStarted","Data":"91e2144b932fba4cc942e55ef1418059b1ad9f83240f17856eebe1e063c00fa8"}
Jul 11 03:53:17.646837 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:17.646737    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:17.677769 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:17.677712    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5" podStartSLOduration=1.407304375 podStartE2EDuration="3.677690171s" totalImagesPullingTime="2.270385796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:53:17.675210731 +0000 UTC m=+270.860363186" watchObservedRunningTime="2026-07-11 03:53:17.677690171 +0000 UTC m=+270.862842625"
Jul 11 03:53:18.652606 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:18.652580    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwdz5"
Jul 11 03:53:47.279248 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:53:47.279218    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 11 03:54:18.946087 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:18.946053    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"]
Jul 11 03:54:18.948899 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:18.948883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:18.951006 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:18.950986    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 11 03:54:18.951724 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:18.951706    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ccxv2\""
Jul 11 03:54:18.951848 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:18.951724    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 11 03:54:18.956565 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:18.956543    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"]
Jul 11 03:54:19.022921 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.022897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:19.023017 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.022953    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvll4\" (UniqueName: \"kubernetes.io/projected/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-kube-api-access-gvll4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:19.023062 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.023010    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:19.045030 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.045005    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"]
Jul 11 03:54:19.047942 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.047927    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:19.055485 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.055466    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"]
Jul 11 03:54:19.124115 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.124084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:19.124248 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.124134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:19.124248 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.124155    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:19.124248 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.124191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:19.124248 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.124222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lxq9\" (UniqueName: \"kubernetes.io/projected/c5fce2db-6bce-4167-aae0-0df6506dd5b4-kube-api-access-2lxq9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:19.124477 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.124258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvll4\" (UniqueName: \"kubernetes.io/projected/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-kube-api-access-gvll4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:19.124527 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.124481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:19.124574 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.124536    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:19.131950 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.131924    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvll4\" (UniqueName: \"kubernetes.io/projected/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-kube-api-access-gvll4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:19.181090 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.181062    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"]
Jul 11 03:54:19.184153 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.184138    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:19.192458 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.192433    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"]
Jul 11 03:54:19.225109 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.225051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:19.225211 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.225107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:19.225211 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.225147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz8m6\" (UniqueName: \"kubernetes.io/projected/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-kube-api-access-zz8m6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:19.225211 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.225180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lxq9\" (UniqueName: \"kubernetes.io/projected/c5fce2db-6bce-4167-aae0-0df6506dd5b4-kube-api-access-2lxq9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:19.225391 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.225214    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:19.225391 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.225259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:19.225486 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.225470    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:19.225525 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.225507    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:19.232854 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.232822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lxq9\" (UniqueName: \"kubernetes.io/projected/c5fce2db-6bce-4167-aae0-0df6506dd5b4-kube-api-access-2lxq9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:19.259285 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.259266    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:19.326159 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.325943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz8m6\" (UniqueName: \"kubernetes.io/projected/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-kube-api-access-zz8m6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:19.326159 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.325989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:19.326159 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.326028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:19.326490 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.326469    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:19.326621 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.326596    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:19.333463 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.333440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz8m6\" (UniqueName: \"kubernetes.io/projected/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-kube-api-access-zz8m6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:19.357609 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.357587    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:19.392726 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.392700    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"]
Jul 11 03:54:19.492728 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.492660    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"]
Jul 11 03:54:19.494557 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.494535    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:19.495623 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:54:19.495599    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5fce2db_6bce_4167_aae0_0df6506dd5b4.slice/crio-c88fee5980ace2174f6e9a749d61e40141759d9593e49b4798fffd2d9c744806 WatchSource:0}: Error finding container c88fee5980ace2174f6e9a749d61e40141759d9593e49b4798fffd2d9c744806: Status 404 returned error can't find the container with id c88fee5980ace2174f6e9a749d61e40141759d9593e49b4798fffd2d9c744806
Jul 11 03:54:19.657404 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.657379    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"]
Jul 11 03:54:19.699241 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:54:19.699200    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30ceba2_6e8f_477c_a7dc_86dcdf0ffc53.slice/crio-31269628168fdba8fc66cd90d1bd535a904b32831955de40a5d17b86d8ae3587 WatchSource:0}: Error finding container 31269628168fdba8fc66cd90d1bd535a904b32831955de40a5d17b86d8ae3587: Status 404 returned error can't find the container with id 31269628168fdba8fc66cd90d1bd535a904b32831955de40a5d17b86d8ae3587
Jul 11 03:54:19.782704 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.782668    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"]
Jul 11 03:54:19.785990 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.785967    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:19.793797 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.793771    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"]
Jul 11 03:54:19.829134 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.829103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:19.829251 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.829140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r68lw\" (UniqueName: \"kubernetes.io/projected/bb0c5b92-7838-4840-9f31-d6245caf88c6-kube-api-access-r68lw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:19.829251 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.829203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:19.909506 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.909475    2576 generic.go:356] "Generic (PLEG): container finished" podID="f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" containerID="07ed8fc0f5c6c8b1c3c5fb9aa2595d26517c8ffa77d84fe6e7e8f2caff54c0b4" exitCode=0
Jul 11 03:54:19.909637 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.909561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27" event={"ID":"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53","Type":"ContainerDied","Data":"07ed8fc0f5c6c8b1c3c5fb9aa2595d26517c8ffa77d84fe6e7e8f2caff54c0b4"}
Jul 11 03:54:19.909637 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.909615    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27" event={"ID":"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53","Type":"ContainerStarted","Data":"31269628168fdba8fc66cd90d1bd535a904b32831955de40a5d17b86d8ae3587"}
Jul 11 03:54:19.910024 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.910007    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 03:54:19.910959 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.910939    2576 generic.go:356] "Generic (PLEG): container finished" podID="4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" containerID="6f7d5593b087f2a7c8f489a77083f0c2dff4280ffbbe07a476de8fa0c11b70da" exitCode=0
Jul 11 03:54:19.911032 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.911014    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq" event={"ID":"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d","Type":"ContainerDied","Data":"6f7d5593b087f2a7c8f489a77083f0c2dff4280ffbbe07a476de8fa0c11b70da"}
Jul 11 03:54:19.911074 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.911040    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq" event={"ID":"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d","Type":"ContainerStarted","Data":"907bfda46995014ae36bfe3344a676817bc186682056e7aaca31c13e95f09618"}
Jul 11 03:54:19.912662 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.912639    2576 generic.go:356] "Generic (PLEG): container finished" podID="c5fce2db-6bce-4167-aae0-0df6506dd5b4" containerID="5d395ebea092f034cb30cd83d163084845e19b34b81bd5809ae9857a5fda8ad8" exitCode=0
Jul 11 03:54:19.912736 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.912671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88" event={"ID":"c5fce2db-6bce-4167-aae0-0df6506dd5b4","Type":"ContainerDied","Data":"5d395ebea092f034cb30cd83d163084845e19b34b81bd5809ae9857a5fda8ad8"}
Jul 11 03:54:19.912736 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.912703    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88" event={"ID":"c5fce2db-6bce-4167-aae0-0df6506dd5b4","Type":"ContainerStarted","Data":"c88fee5980ace2174f6e9a749d61e40141759d9593e49b4798fffd2d9c744806"}
Jul 11 03:54:19.930317 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.930295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:19.930451 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.930439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:19.930501 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.930461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68lw\" (UniqueName: \"kubernetes.io/projected/bb0c5b92-7838-4840-9f31-d6245caf88c6-kube-api-access-r68lw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:19.930632 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.930615    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:19.930818 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.930800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:19.940684 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:19.940666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r68lw\" (UniqueName: \"kubernetes.io/projected/bb0c5b92-7838-4840-9f31-d6245caf88c6-kube-api-access-r68lw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:20.139793 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:20.139758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:20.263844 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:20.263821    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"]
Jul 11 03:54:20.265591 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:54:20.265562    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb0c5b92_7838_4840_9f31_d6245caf88c6.slice/crio-ad3ff221cf05399b5e530698ae809f0889b1fd2433ca0318e31c8c51c83d84e2 WatchSource:0}: Error finding container ad3ff221cf05399b5e530698ae809f0889b1fd2433ca0318e31c8c51c83d84e2: Status 404 returned error can't find the container with id ad3ff221cf05399b5e530698ae809f0889b1fd2433ca0318e31c8c51c83d84e2
Jul 11 03:54:20.920476 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:20.920446    2576 generic.go:356] "Generic (PLEG): container finished" podID="bb0c5b92-7838-4840-9f31-d6245caf88c6" containerID="52590b52c1b7b7fbc43745e5402fb6fabceaa6948f60cff22b07435c52c9eebc" exitCode=0
Jul 11 03:54:20.920582 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:20.920539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx" event={"ID":"bb0c5b92-7838-4840-9f31-d6245caf88c6","Type":"ContainerDied","Data":"52590b52c1b7b7fbc43745e5402fb6fabceaa6948f60cff22b07435c52c9eebc"}
Jul 11 03:54:20.920649 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:20.920640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx" event={"ID":"bb0c5b92-7838-4840-9f31-d6245caf88c6","Type":"ContainerStarted","Data":"ad3ff221cf05399b5e530698ae809f0889b1fd2433ca0318e31c8c51c83d84e2"}
Jul 11 03:54:20.922621 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:20.922595    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27" event={"ID":"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53","Type":"ContainerStarted","Data":"83d0e0d619e82a138d1ce7a66e5b6cf07cde52748bfb28879c27de56f91cc6a4"}
Jul 11 03:54:20.924520 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:20.924498    2576 generic.go:356] "Generic (PLEG): container finished" podID="4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" containerID="de7319e90326d1572ebf786cd97049c2d352d3e8e5304e458c0fff223661b577" exitCode=0
Jul 11 03:54:20.924617 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:20.924547    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq" event={"ID":"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d","Type":"ContainerDied","Data":"de7319e90326d1572ebf786cd97049c2d352d3e8e5304e458c0fff223661b577"}
Jul 11 03:54:21.931139 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:21.931107    2576 generic.go:356] "Generic (PLEG): container finished" podID="4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" containerID="a4dd80543e3bace431524ca1cccb0f34caa6e7cf1352b1183027f1c6da0b3b7d" exitCode=0
Jul 11 03:54:21.931478 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:21.931186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq" event={"ID":"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d","Type":"ContainerDied","Data":"a4dd80543e3bace431524ca1cccb0f34caa6e7cf1352b1183027f1c6da0b3b7d"}
Jul 11 03:54:21.932886 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:21.932866    2576 generic.go:356] "Generic (PLEG): container finished" podID="c5fce2db-6bce-4167-aae0-0df6506dd5b4" containerID="c78b80b3a16a8dcb2e88b39f67b9648c814f49fc0ee675059d25bdcd068dd761" exitCode=0
Jul 11 03:54:21.932967 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:21.932939    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88" event={"ID":"c5fce2db-6bce-4167-aae0-0df6506dd5b4","Type":"ContainerDied","Data":"c78b80b3a16a8dcb2e88b39f67b9648c814f49fc0ee675059d25bdcd068dd761"}
Jul 11 03:54:21.934872 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:21.934849    2576 generic.go:356] "Generic (PLEG): container finished" podID="bb0c5b92-7838-4840-9f31-d6245caf88c6" containerID="e02f5c09a1cabaea50909208e7e3a9e19ad3b9ab3a3b7484b61c2143ab53d755" exitCode=0
Jul 11 03:54:21.934957 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:21.934913    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx" event={"ID":"bb0c5b92-7838-4840-9f31-d6245caf88c6","Type":"ContainerDied","Data":"e02f5c09a1cabaea50909208e7e3a9e19ad3b9ab3a3b7484b61c2143ab53d755"}
Jul 11 03:54:21.937946 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:21.937635    2576 generic.go:356] "Generic (PLEG): container finished" podID="f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" containerID="83d0e0d619e82a138d1ce7a66e5b6cf07cde52748bfb28879c27de56f91cc6a4" exitCode=0
Jul 11 03:54:21.937946 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:21.937666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27" event={"ID":"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53","Type":"ContainerDied","Data":"83d0e0d619e82a138d1ce7a66e5b6cf07cde52748bfb28879c27de56f91cc6a4"}
Jul 11 03:54:22.944290 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:22.944259    2576 generic.go:356] "Generic (PLEG): container finished" podID="c5fce2db-6bce-4167-aae0-0df6506dd5b4" containerID="2ffcde6a7709259e2d238ece63266b7138753709d3cf1427fb7c788e301852e9" exitCode=0
Jul 11 03:54:22.944666 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:22.944354    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88" event={"ID":"c5fce2db-6bce-4167-aae0-0df6506dd5b4","Type":"ContainerDied","Data":"2ffcde6a7709259e2d238ece63266b7138753709d3cf1427fb7c788e301852e9"}
Jul 11 03:54:22.946257 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:22.946237    2576 generic.go:356] "Generic (PLEG): container finished" podID="bb0c5b92-7838-4840-9f31-d6245caf88c6" containerID="4ec6c105fb08b0cca4f34dd58aaf4a4809de4cf5758f85f6338e85387196338b" exitCode=0
Jul 11 03:54:22.946377 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:22.946317    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx" event={"ID":"bb0c5b92-7838-4840-9f31-d6245caf88c6","Type":"ContainerDied","Data":"4ec6c105fb08b0cca4f34dd58aaf4a4809de4cf5758f85f6338e85387196338b"}
Jul 11 03:54:22.948172 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:22.948152    2576 generic.go:356] "Generic (PLEG): container finished" podID="f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" containerID="84a2c1b3701312cbd0cf0c330f45d3e4300cbb31493ef3cd8a9f3a2f2da20c30" exitCode=0
Jul 11 03:54:22.948269 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:22.948219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27" event={"ID":"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53","Type":"ContainerDied","Data":"84a2c1b3701312cbd0cf0c330f45d3e4300cbb31493ef3cd8a9f3a2f2da20c30"}
Jul 11 03:54:23.075462 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.075441    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:23.156193 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.156164    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-util\") pod \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") "
Jul 11 03:54:23.156358 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.156256    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvll4\" (UniqueName: \"kubernetes.io/projected/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-kube-api-access-gvll4\") pod \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") "
Jul 11 03:54:23.156358 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.156289    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-bundle\") pod \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\" (UID: \"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d\") "
Jul 11 03:54:23.156795 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.156764    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-bundle" (OuterVolumeSpecName: "bundle") pod "4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" (UID: "4f1b6b6f-f2cf-497f-9dd6-cdc51548059d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:54:23.158382 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.158357    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-kube-api-access-gvll4" (OuterVolumeSpecName: "kube-api-access-gvll4") pod "4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" (UID: "4f1b6b6f-f2cf-497f-9dd6-cdc51548059d"). InnerVolumeSpecName "kube-api-access-gvll4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:54:23.160971 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.160942    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-util" (OuterVolumeSpecName: "util") pod "4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" (UID: "4f1b6b6f-f2cf-497f-9dd6-cdc51548059d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:54:23.257107 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.257058    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:23.257107 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.257078    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvll4\" (UniqueName: \"kubernetes.io/projected/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-kube-api-access-gvll4\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:23.257107 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.257087    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f1b6b6f-f2cf-497f-9dd6-cdc51548059d-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:23.954455 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.954422    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq"
Jul 11 03:54:23.954851 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.954477    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq" event={"ID":"4f1b6b6f-f2cf-497f-9dd6-cdc51548059d","Type":"ContainerDied","Data":"907bfda46995014ae36bfe3344a676817bc186682056e7aaca31c13e95f09618"}
Jul 11 03:54:23.954851 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:23.954538    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="907bfda46995014ae36bfe3344a676817bc186682056e7aaca31c13e95f09618"
Jul 11 03:54:24.103437 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.103417    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:54:24.145295 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.145271    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:24.148593 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.148575    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:24.163260 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.163201    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-util\") pod \"bb0c5b92-7838-4840-9f31-d6245caf88c6\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") "
Jul 11 03:54:24.163370 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.163311    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-bundle\") pod \"bb0c5b92-7838-4840-9f31-d6245caf88c6\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") "
Jul 11 03:54:24.163777 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.163754    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r68lw\" (UniqueName: \"kubernetes.io/projected/bb0c5b92-7838-4840-9f31-d6245caf88c6-kube-api-access-r68lw\") pod \"bb0c5b92-7838-4840-9f31-d6245caf88c6\" (UID: \"bb0c5b92-7838-4840-9f31-d6245caf88c6\") "
Jul 11 03:54:24.164151 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.164104    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-bundle" (OuterVolumeSpecName: "bundle") pod "bb0c5b92-7838-4840-9f31-d6245caf88c6" (UID: "bb0c5b92-7838-4840-9f31-d6245caf88c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:54:24.166142 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.166121    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb0c5b92-7838-4840-9f31-d6245caf88c6-kube-api-access-r68lw" (OuterVolumeSpecName: "kube-api-access-r68lw") pod "bb0c5b92-7838-4840-9f31-d6245caf88c6" (UID: "bb0c5b92-7838-4840-9f31-d6245caf88c6"). InnerVolumeSpecName "kube-api-access-r68lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:54:24.169654 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.169631    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-util" (OuterVolumeSpecName: "util") pod "bb0c5b92-7838-4840-9f31-d6245caf88c6" (UID: "bb0c5b92-7838-4840-9f31-d6245caf88c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:54:24.265258 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.265192    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz8m6\" (UniqueName: \"kubernetes.io/projected/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-kube-api-access-zz8m6\") pod \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") "
Jul 11 03:54:24.265258 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.265247    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-util\") pod \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") "
Jul 11 03:54:24.265454 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.265273    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-util\") pod \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") "
Jul 11 03:54:24.265454 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.265396    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-bundle\") pod \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\" (UID: \"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53\") "
Jul 11 03:54:24.265563 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.265457    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lxq9\" (UniqueName: \"kubernetes.io/projected/c5fce2db-6bce-4167-aae0-0df6506dd5b4-kube-api-access-2lxq9\") pod \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") "
Jul 11 03:54:24.265563 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.265487    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-bundle\") pod \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\" (UID: \"c5fce2db-6bce-4167-aae0-0df6506dd5b4\") "
Jul 11 03:54:24.265780 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.265741    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:24.265780 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.265763    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r68lw\" (UniqueName: \"kubernetes.io/projected/bb0c5b92-7838-4840-9f31-d6245caf88c6-kube-api-access-r68lw\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:24.265780 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.265777    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb0c5b92-7838-4840-9f31-d6245caf88c6-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:24.266132 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.266040    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-bundle" (OuterVolumeSpecName: "bundle") pod "f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" (UID: "f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:54:24.266132 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.266095    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-bundle" (OuterVolumeSpecName: "bundle") pod "c5fce2db-6bce-4167-aae0-0df6506dd5b4" (UID: "c5fce2db-6bce-4167-aae0-0df6506dd5b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:54:24.267441 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.267421    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5fce2db-6bce-4167-aae0-0df6506dd5b4-kube-api-access-2lxq9" (OuterVolumeSpecName: "kube-api-access-2lxq9") pod "c5fce2db-6bce-4167-aae0-0df6506dd5b4" (UID: "c5fce2db-6bce-4167-aae0-0df6506dd5b4"). InnerVolumeSpecName "kube-api-access-2lxq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:54:24.267615 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.267592    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-kube-api-access-zz8m6" (OuterVolumeSpecName: "kube-api-access-zz8m6") pod "f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" (UID: "f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53"). InnerVolumeSpecName "kube-api-access-zz8m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:54:24.271049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.271019    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-util" (OuterVolumeSpecName: "util") pod "f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" (UID: "f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:54:24.271338 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.271312    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-util" (OuterVolumeSpecName: "util") pod "c5fce2db-6bce-4167-aae0-0df6506dd5b4" (UID: "c5fce2db-6bce-4167-aae0-0df6506dd5b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 03:54:24.366611 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.366593    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:24.366611 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.366611    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-util\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:24.366727 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.366619    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:24.366727 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.366627    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lxq9\" (UniqueName: \"kubernetes.io/projected/c5fce2db-6bce-4167-aae0-0df6506dd5b4-kube-api-access-2lxq9\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:24.366727 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.366636    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5fce2db-6bce-4167-aae0-0df6506dd5b4-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:24.366727 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.366646    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz8m6\" (UniqueName: \"kubernetes.io/projected/f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53-kube-api-access-zz8m6\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:54:24.960749 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.960724    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27"
Jul 11 03:54:24.961083 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.960745    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27" event={"ID":"f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53","Type":"ContainerDied","Data":"31269628168fdba8fc66cd90d1bd535a904b32831955de40a5d17b86d8ae3587"}
Jul 11 03:54:24.961083 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.960784    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31269628168fdba8fc66cd90d1bd535a904b32831955de40a5d17b86d8ae3587"
Jul 11 03:54:24.962576 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.962549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88" event={"ID":"c5fce2db-6bce-4167-aae0-0df6506dd5b4","Type":"ContainerDied","Data":"c88fee5980ace2174f6e9a749d61e40141759d9593e49b4798fffd2d9c744806"}
Jul 11 03:54:24.962576 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.962567    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88"
Jul 11 03:54:24.962734 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.962585    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c88fee5980ace2174f6e9a749d61e40141759d9593e49b4798fffd2d9c744806"
Jul 11 03:54:24.964391 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.964372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx" event={"ID":"bb0c5b92-7838-4840-9f31-d6245caf88c6","Type":"ContainerDied","Data":"ad3ff221cf05399b5e530698ae809f0889b1fd2433ca0318e31c8c51c83d84e2"}
Jul 11 03:54:24.964514 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.964400    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad3ff221cf05399b5e530698ae809f0889b1fd2433ca0318e31c8c51c83d84e2"
Jul 11 03:54:24.964514 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:54:24.964409    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx"
Jul 11 03:55:18.346910 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.346884    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68c66c9577-vk2mk"]
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347173    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" containerName="extract"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347183    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" containerName="extract"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347195    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5fce2db-6bce-4167-aae0-0df6506dd5b4" containerName="util"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347201    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5fce2db-6bce-4167-aae0-0df6506dd5b4" containerName="util"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347209    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" containerName="pull"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347214    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" containerName="pull"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347220    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5fce2db-6bce-4167-aae0-0df6506dd5b4" containerName="pull"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347225    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5fce2db-6bce-4167-aae0-0df6506dd5b4" containerName="pull"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347231    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0c5b92-7838-4840-9f31-d6245caf88c6" containerName="extract"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347236    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0c5b92-7838-4840-9f31-d6245caf88c6" containerName="extract"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347243    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0c5b92-7838-4840-9f31-d6245caf88c6" containerName="util"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347248    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0c5b92-7838-4840-9f31-d6245caf88c6" containerName="util"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347254    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" containerName="extract"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347258    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" containerName="extract"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347266    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" containerName="util"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347272    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" containerName="util"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347278    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0c5b92-7838-4840-9f31-d6245caf88c6" containerName="pull"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347283    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0c5b92-7838-4840-9f31-d6245caf88c6" containerName="pull"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347292    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" containerName="pull"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347297    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" containerName="pull"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347304    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5fce2db-6bce-4167-aae0-0df6506dd5b4" containerName="extract"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347308    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5fce2db-6bce-4167-aae0-0df6506dd5b4" containerName="extract"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347314    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" containerName="util"
Jul 11 03:55:18.347349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347319    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" containerName="util"
Jul 11 03:55:18.348031 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347387    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53" containerName="extract"
Jul 11 03:55:18.348031 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347394    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f1b6b6f-f2cf-497f-9dd6-cdc51548059d" containerName="extract"
Jul 11 03:55:18.348031 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347400    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb0c5b92-7838-4840-9f31-d6245caf88c6" containerName="extract"
Jul 11 03:55:18.348031 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.347406    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5fce2db-6bce-4167-aae0-0df6506dd5b4" containerName="extract"
Jul 11 03:55:18.349800 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.349784    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.360011 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.359989    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c66c9577-vk2mk"]
Jul 11 03:55:18.471111 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.471080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-oauth-serving-cert\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.471237 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.471124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2940a473-8b75-4cb2-b89b-4422a22e5565-console-oauth-config\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.471237 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.471165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-service-ca\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.471237 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.471226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-console-config\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.471418 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.471279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwz75\" (UniqueName: \"kubernetes.io/projected/2940a473-8b75-4cb2-b89b-4422a22e5565-kube-api-access-dwz75\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.471418 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.471315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2940a473-8b75-4cb2-b89b-4422a22e5565-console-serving-cert\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.471418 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.471348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-trusted-ca-bundle\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.572049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.572019    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwz75\" (UniqueName: \"kubernetes.io/projected/2940a473-8b75-4cb2-b89b-4422a22e5565-kube-api-access-dwz75\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.572144 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.572080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2940a473-8b75-4cb2-b89b-4422a22e5565-console-serving-cert\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.572144 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.572104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-trusted-ca-bundle\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.572249 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.572193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-oauth-serving-cert\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.572249 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.572246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2940a473-8b75-4cb2-b89b-4422a22e5565-console-oauth-config\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.572383 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.572282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-service-ca\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.572541 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.572522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-console-config\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.573025 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.573001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-oauth-serving-cert\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.573137 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.573043    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-service-ca\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.573205 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.573175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-trusted-ca-bundle\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.573258 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.573184    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2940a473-8b75-4cb2-b89b-4422a22e5565-console-config\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.574643 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.574620    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2940a473-8b75-4cb2-b89b-4422a22e5565-console-serving-cert\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.574731 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.574639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2940a473-8b75-4cb2-b89b-4422a22e5565-console-oauth-config\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.582297 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.582274    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwz75\" (UniqueName: \"kubernetes.io/projected/2940a473-8b75-4cb2-b89b-4422a22e5565-kube-api-access-dwz75\") pod \"console-68c66c9577-vk2mk\" (UID: \"2940a473-8b75-4cb2-b89b-4422a22e5565\") " pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.658706 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.658657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:18.791894 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:18.791870    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c66c9577-vk2mk"]
Jul 11 03:55:18.792995 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:55:18.792968    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2940a473_8b75_4cb2_b89b_4422a22e5565.slice/crio-a096bffec359a5efb799e4042a0bfde88ac0ba5b9503143f629a1ffa8840199b WatchSource:0}: Error finding container a096bffec359a5efb799e4042a0bfde88ac0ba5b9503143f629a1ffa8840199b: Status 404 returned error can't find the container with id a096bffec359a5efb799e4042a0bfde88ac0ba5b9503143f629a1ffa8840199b
Jul 11 03:55:19.217124 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:19.217087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c66c9577-vk2mk" event={"ID":"2940a473-8b75-4cb2-b89b-4422a22e5565","Type":"ContainerStarted","Data":"69e1e7da5e6a7afcc6fae5e16af9891ba16a9aa4940dfaa3ed61c5ad60fd9e14"}
Jul 11 03:55:19.217303 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:19.217138    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c66c9577-vk2mk" event={"ID":"2940a473-8b75-4cb2-b89b-4422a22e5565","Type":"ContainerStarted","Data":"a096bffec359a5efb799e4042a0bfde88ac0ba5b9503143f629a1ffa8840199b"}
Jul 11 03:55:19.235928 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:19.235883    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68c66c9577-vk2mk" podStartSLOduration=1.235869411 podStartE2EDuration="1.235869411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:55:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:55:19.234230455 +0000 UTC m=+392.419382909" watchObservedRunningTime="2026-07-11 03:55:19.235869411 +0000 UTC m=+392.421021864"
Jul 11 03:55:28.659734 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:28.659699    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:28.660110 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:28.659784    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:28.664052 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:28.664031    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:29.263996 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:29.263964    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68c66c9577-vk2mk"
Jul 11 03:55:29.348524 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:29.348491    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb9894f69-gqpql"]
Jul 11 03:55:51.351379 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.351343    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"]
Jul 11 03:55:51.355218 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.355195    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:55:51.357491 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.357323    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 11 03:55:51.357491 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.357349    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ccxv2\""
Jul 11 03:55:51.357491 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.357387    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 11 03:55:51.357491 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.357438    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 11 03:55:51.361607 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.361584    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"]
Jul 11 03:55:51.409863 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.409829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/136b0aa6-7fe8-4856-abea-886499161d55-config-file\") pod \"limitador-limitador-64c94fd64f-bfw2z\" (UID: \"136b0aa6-7fe8-4856-abea-886499161d55\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:55:51.409974 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.409895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4stj\" (UniqueName: \"kubernetes.io/projected/136b0aa6-7fe8-4856-abea-886499161d55-kube-api-access-t4stj\") pod \"limitador-limitador-64c94fd64f-bfw2z\" (UID: \"136b0aa6-7fe8-4856-abea-886499161d55\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:55:51.447543 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.447519    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"]
Jul 11 03:55:51.510771 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.510746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4stj\" (UniqueName: \"kubernetes.io/projected/136b0aa6-7fe8-4856-abea-886499161d55-kube-api-access-t4stj\") pod \"limitador-limitador-64c94fd64f-bfw2z\" (UID: \"136b0aa6-7fe8-4856-abea-886499161d55\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:55:51.510896 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.510815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/136b0aa6-7fe8-4856-abea-886499161d55-config-file\") pod \"limitador-limitador-64c94fd64f-bfw2z\" (UID: \"136b0aa6-7fe8-4856-abea-886499161d55\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:55:51.511370 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.511353    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/136b0aa6-7fe8-4856-abea-886499161d55-config-file\") pod \"limitador-limitador-64c94fd64f-bfw2z\" (UID: \"136b0aa6-7fe8-4856-abea-886499161d55\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:55:51.517547 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.517529    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4stj\" (UniqueName: \"kubernetes.io/projected/136b0aa6-7fe8-4856-abea-886499161d55-kube-api-access-t4stj\") pod \"limitador-limitador-64c94fd64f-bfw2z\" (UID: \"136b0aa6-7fe8-4856-abea-886499161d55\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:55:51.666131 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.666078    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:55:51.790202 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:51.790179    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"]
Jul 11 03:55:51.791931 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:55:51.791896    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136b0aa6_7fe8_4856_abea_886499161d55.slice/crio-7ed2c631275e5e82e29b6bdbf7b80cfa886e55c744687d1a17fa5f9bed4a465d WatchSource:0}: Error finding container 7ed2c631275e5e82e29b6bdbf7b80cfa886e55c744687d1a17fa5f9bed4a465d: Status 404 returned error can't find the container with id 7ed2c631275e5e82e29b6bdbf7b80cfa886e55c744687d1a17fa5f9bed4a465d
Jul 11 03:55:52.367991 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:52.367957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z" event={"ID":"136b0aa6-7fe8-4856-abea-886499161d55","Type":"ContainerStarted","Data":"7ed2c631275e5e82e29b6bdbf7b80cfa886e55c744687d1a17fa5f9bed4a465d"}
Jul 11 03:55:54.367715 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.367683    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bb9894f69-gqpql" podUID="6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" containerName="console" containerID="cri-o://36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe" gracePeriod=15
Jul 11 03:55:54.612819 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.612796    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:55:54.736352 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.736301    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-config\") pod \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") "
Jul 11 03:55:54.736513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.736370    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-trusted-ca-bundle\") pod \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") "
Jul 11 03:55:54.736513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.736399    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-oauth-serving-cert\") pod \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") "
Jul 11 03:55:54.736513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.736425    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-serving-cert\") pod \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") "
Jul 11 03:55:54.736513 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.736463    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-oauth-config\") pod \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") "
Jul 11 03:55:54.736660 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.736582    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7pws\" (UniqueName: \"kubernetes.io/projected/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-kube-api-access-x7pws\") pod \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") "
Jul 11 03:55:54.736660 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.736627    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-service-ca\") pod \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\" (UID: \"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7\") "
Jul 11 03:55:54.736823 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.736776    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-config" (OuterVolumeSpecName: "console-config") pod "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" (UID: "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:55:54.736902 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.736892    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" (UID: "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:55:54.736960 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.736888    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" (UID: "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:55:54.737015 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.736989    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:55:54.737015 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.737008    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-trusted-ca-bundle\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:55:54.737112 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.737020    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-oauth-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:55:54.737167 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.737140    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" (UID: "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:55:54.738661 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.738641    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" (UID: "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:55:54.738725 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.738686    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" (UID: "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:55:54.738760 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.738744    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-kube-api-access-x7pws" (OuterVolumeSpecName: "kube-api-access-x7pws") pod "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" (UID: "6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7"). InnerVolumeSpecName "kube-api-access-x7pws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:55:54.838012 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.837977    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-serving-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:55:54.838012 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.838007    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-console-oauth-config\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:55:54.838012 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.838020    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7pws\" (UniqueName: \"kubernetes.io/projected/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-kube-api-access-x7pws\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:55:54.838258 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:54.838033    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:55:55.385382 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.385348    2576 generic.go:356] "Generic (PLEG): container finished" podID="6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" containerID="36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe" exitCode=0
Jul 11 03:55:55.385805 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.385386    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9894f69-gqpql"
Jul 11 03:55:55.385805 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.385446    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9894f69-gqpql" event={"ID":"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7","Type":"ContainerDied","Data":"36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe"}
Jul 11 03:55:55.385805 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.385504    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9894f69-gqpql" event={"ID":"6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7","Type":"ContainerDied","Data":"b9b039d376e9ed6030254601ca935bce225fce094de436d11836c70695b531eb"}
Jul 11 03:55:55.385805 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.385535    2576 scope.go:117] "RemoveContainer" containerID="36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe"
Jul 11 03:55:55.387062 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.387040    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z" event={"ID":"136b0aa6-7fe8-4856-abea-886499161d55","Type":"ContainerStarted","Data":"2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a"}
Jul 11 03:55:55.387139 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.387098    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:55:55.394095 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.394080    2576 scope.go:117] "RemoveContainer" containerID="36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe"
Jul 11 03:55:55.394348 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:55:55.394307    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe\": container with ID starting with 36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe not found: ID does not exist" containerID="36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe"
Jul 11 03:55:55.394412 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.394345    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe"} err="failed to get container status \"36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe\": rpc error: code = NotFound desc = could not find container \"36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe\": container with ID starting with 36755e5e97cf5300926fd79c6af05d15882e90e8a5473dc42b01ac5651879abe not found: ID does not exist"
Jul 11 03:55:55.404262 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.404224    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z" podStartSLOduration=1.849991369 podStartE2EDuration="4.404213404s" totalImagesPullingTime="2.554222035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:55:55.402099791 +0000 UTC m=+428.587252250" watchObservedRunningTime="2026-07-11 03:55:55.404213404 +0000 UTC m=+428.589365857"
Jul 11 03:55:55.414651 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.414623    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb9894f69-gqpql"]
Jul 11 03:55:55.417840 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.417820    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bb9894f69-gqpql"]
Jul 11 03:55:55.476968 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:55:55.476945    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" path="/var/lib/kubelet/pods/6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7/volumes"
Jul 11 03:56:05.761416 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:05.761379    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"]
Jul 11 03:56:05.761851 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:05.761565    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z" podUID="136b0aa6-7fe8-4856-abea-886499161d55" containerName="limitador" containerID="cri-o://2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a" gracePeriod=30
Jul 11 03:56:05.762313 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:05.762288    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:56:06.304472 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.304445    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:56:06.428993 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.428909    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/136b0aa6-7fe8-4856-abea-886499161d55-config-file\") pod \"136b0aa6-7fe8-4856-abea-886499161d55\" (UID: \"136b0aa6-7fe8-4856-abea-886499161d55\") "
Jul 11 03:56:06.428993 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.428955    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4stj\" (UniqueName: \"kubernetes.io/projected/136b0aa6-7fe8-4856-abea-886499161d55-kube-api-access-t4stj\") pod \"136b0aa6-7fe8-4856-abea-886499161d55\" (UID: \"136b0aa6-7fe8-4856-abea-886499161d55\") "
Jul 11 03:56:06.429307 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.429283    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136b0aa6-7fe8-4856-abea-886499161d55-config-file" (OuterVolumeSpecName: "config-file") pod "136b0aa6-7fe8-4856-abea-886499161d55" (UID: "136b0aa6-7fe8-4856-abea-886499161d55"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 03:56:06.430880 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.430858    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136b0aa6-7fe8-4856-abea-886499161d55-kube-api-access-t4stj" (OuterVolumeSpecName: "kube-api-access-t4stj") pod "136b0aa6-7fe8-4856-abea-886499161d55" (UID: "136b0aa6-7fe8-4856-abea-886499161d55"). InnerVolumeSpecName "kube-api-access-t4stj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:56:06.443144 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.443105    2576 generic.go:356] "Generic (PLEG): container finished" podID="136b0aa6-7fe8-4856-abea-886499161d55" containerID="2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a" exitCode=0
Jul 11 03:56:06.443246 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.443149    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"
Jul 11 03:56:06.443246 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.443147    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z" event={"ID":"136b0aa6-7fe8-4856-abea-886499161d55","Type":"ContainerDied","Data":"2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a"}
Jul 11 03:56:06.443383 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.443276    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bfw2z" event={"ID":"136b0aa6-7fe8-4856-abea-886499161d55","Type":"ContainerDied","Data":"7ed2c631275e5e82e29b6bdbf7b80cfa886e55c744687d1a17fa5f9bed4a465d"}
Jul 11 03:56:06.443383 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.443312    2576 scope.go:117] "RemoveContainer" containerID="2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a"
Jul 11 03:56:06.452323 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.452309    2576 scope.go:117] "RemoveContainer" containerID="2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a"
Jul 11 03:56:06.452576 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:56:06.452556    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a\": container with ID starting with 2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a not found: ID does not exist" containerID="2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a"
Jul 11 03:56:06.452633 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.452584    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a"} err="failed to get container status \"2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a\": rpc error: code = NotFound desc = could not find container \"2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a\": container with ID starting with 2942ade0f4320a96b700a25823fb47e454ea9cbe0fcea3c098785bd66d38ba7a not found: ID does not exist"
Jul 11 03:56:06.463568 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.463546    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"]
Jul 11 03:56:06.466879 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.466855    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bfw2z"]
Jul 11 03:56:06.530139 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.530105    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/136b0aa6-7fe8-4856-abea-886499161d55-config-file\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:56:06.530139 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:06.530131    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4stj\" (UniqueName: \"kubernetes.io/projected/136b0aa6-7fe8-4856-abea-886499161d55-kube-api-access-t4stj\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:56:07.476476 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:07.476445    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136b0aa6-7fe8-4856-abea-886499161d55" path="/var/lib/kubelet/pods/136b0aa6-7fe8-4856-abea-886499161d55/volumes"
Jul 11 03:56:09.773719 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.773645    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"]
Jul 11 03:56:09.774082 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.774068    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136b0aa6-7fe8-4856-abea-886499161d55" containerName="limitador"
Jul 11 03:56:09.774121 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.774086    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="136b0aa6-7fe8-4856-abea-886499161d55" containerName="limitador"
Jul 11 03:56:09.774121 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.774102    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" containerName="console"
Jul 11 03:56:09.774121 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.774110    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" containerName="console"
Jul 11 03:56:09.780045 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.774697    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="136b0aa6-7fe8-4856-abea-886499161d55" containerName="limitador"
Jul 11 03:56:09.780045 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.774743    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a7e8dd8-3ac8-45f1-ade4-5694e712e5d7" containerName="console"
Jul 11 03:56:09.783420 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.783391    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"]
Jul 11 03:56:09.783521 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.783424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"
Jul 11 03:56:09.785702 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.785677    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 03:56:09.785702 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.785700    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 03:56:09.785884 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.785735    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 11 03:56:09.786533 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.786515    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7fgxk\""
Jul 11 03:56:09.856624 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.856589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5cqr\" (UniqueName: \"kubernetes.io/projected/a7e6b73e-bad0-4938-b5a1-dc24fa524935-kube-api-access-g5cqr\") pod \"postgres-69fb4594cf-vnbqk\" (UID: \"a7e6b73e-bad0-4938-b5a1-dc24fa524935\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"
Jul 11 03:56:09.856624 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.856626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a7e6b73e-bad0-4938-b5a1-dc24fa524935-data\") pod \"postgres-69fb4594cf-vnbqk\" (UID: \"a7e6b73e-bad0-4938-b5a1-dc24fa524935\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"
Jul 11 03:56:09.958088 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.958050    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a7e6b73e-bad0-4938-b5a1-dc24fa524935-data\") pod \"postgres-69fb4594cf-vnbqk\" (UID: \"a7e6b73e-bad0-4938-b5a1-dc24fa524935\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"
Jul 11 03:56:09.958248 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.958229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5cqr\" (UniqueName: \"kubernetes.io/projected/a7e6b73e-bad0-4938-b5a1-dc24fa524935-kube-api-access-g5cqr\") pod \"postgres-69fb4594cf-vnbqk\" (UID: \"a7e6b73e-bad0-4938-b5a1-dc24fa524935\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"
Jul 11 03:56:09.958447 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.958429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a7e6b73e-bad0-4938-b5a1-dc24fa524935-data\") pod \"postgres-69fb4594cf-vnbqk\" (UID: \"a7e6b73e-bad0-4938-b5a1-dc24fa524935\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"
Jul 11 03:56:09.965577 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:09.965554    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5cqr\" (UniqueName: \"kubernetes.io/projected/a7e6b73e-bad0-4938-b5a1-dc24fa524935-kube-api-access-g5cqr\") pod \"postgres-69fb4594cf-vnbqk\" (UID: \"a7e6b73e-bad0-4938-b5a1-dc24fa524935\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"
Jul 11 03:56:10.096583 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:10.096500    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"
Jul 11 03:56:10.242615 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:10.242588    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"]
Jul 11 03:56:10.244715 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:56:10.244689    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e6b73e_bad0_4938_b5a1_dc24fa524935.slice/crio-c5b26c5edef28da4419e243aa6ab51d0ca24edbf764075099acbc213531227f6 WatchSource:0}: Error finding container c5b26c5edef28da4419e243aa6ab51d0ca24edbf764075099acbc213531227f6: Status 404 returned error can't find the container with id c5b26c5edef28da4419e243aa6ab51d0ca24edbf764075099acbc213531227f6
Jul 11 03:56:10.463553 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:10.463472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk" event={"ID":"a7e6b73e-bad0-4938-b5a1-dc24fa524935","Type":"ContainerStarted","Data":"c5b26c5edef28da4419e243aa6ab51d0ca24edbf764075099acbc213531227f6"}
Jul 11 03:56:15.498252 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:15.498166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk" event={"ID":"a7e6b73e-bad0-4938-b5a1-dc24fa524935","Type":"ContainerStarted","Data":"f56cc08583b3bc51754d5e97433df1527790c19218b4a0f15c463a68807a1dad"}
Jul 11 03:56:15.498694 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:15.498283    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"
Jul 11 03:56:15.514659 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:15.514606    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk" podStartSLOduration=1.5867926780000001 podStartE2EDuration="6.514590557s" totalImagesPullingTime="4.927797879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:56:15.512136585 +0000 UTC m=+448.697289041" watchObservedRunningTime="2026-07-11 03:56:15.514590557 +0000 UTC m=+448.699743010"
Jul 11 03:56:21.532720 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:21.532684    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vnbqk"
Jul 11 03:56:22.431538 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.431507    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5984ddb44b-dj8kw"]
Jul 11 03:56:22.439039 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.439009    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5984ddb44b-dj8kw"
Jul 11 03:56:22.440508 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.440487    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5984ddb44b-dj8kw"]
Jul 11 03:56:22.442127 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.442104    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 11 03:56:22.442230 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.442162    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9nlfg\""
Jul 11 03:56:22.442230 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.442206    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 11 03:56:22.442230 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.442219    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 11 03:56:22.568851 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.568817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-tls-cert\") pod \"authorino-5984ddb44b-dj8kw\" (UID: \"0a9831e1-4767-4648-b4fb-d86e6c2a6d19\") " pod="kuadrant-system/authorino-5984ddb44b-dj8kw"
Jul 11 03:56:22.569274 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.568903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxtj4\" (UniqueName: \"kubernetes.io/projected/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-kube-api-access-rxtj4\") pod \"authorino-5984ddb44b-dj8kw\" (UID: \"0a9831e1-4767-4648-b4fb-d86e6c2a6d19\") " pod="kuadrant-system/authorino-5984ddb44b-dj8kw"
Jul 11 03:56:22.669953 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.669898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-tls-cert\") pod \"authorino-5984ddb44b-dj8kw\" (UID: \"0a9831e1-4767-4648-b4fb-d86e6c2a6d19\") " pod="kuadrant-system/authorino-5984ddb44b-dj8kw"
Jul 11 03:56:22.670106 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.670006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxtj4\" (UniqueName: \"kubernetes.io/projected/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-kube-api-access-rxtj4\") pod \"authorino-5984ddb44b-dj8kw\" (UID: \"0a9831e1-4767-4648-b4fb-d86e6c2a6d19\") " pod="kuadrant-system/authorino-5984ddb44b-dj8kw"
Jul 11 03:56:22.672411 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.672390    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-tls-cert\") pod \"authorino-5984ddb44b-dj8kw\" (UID: \"0a9831e1-4767-4648-b4fb-d86e6c2a6d19\") " pod="kuadrant-system/authorino-5984ddb44b-dj8kw"
Jul 11 03:56:22.677203 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.677180    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxtj4\" (UniqueName: \"kubernetes.io/projected/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-kube-api-access-rxtj4\") pod \"authorino-5984ddb44b-dj8kw\" (UID: \"0a9831e1-4767-4648-b4fb-d86e6c2a6d19\") " pod="kuadrant-system/authorino-5984ddb44b-dj8kw"
Jul 11 03:56:22.748625 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.748554    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5984ddb44b-dj8kw"
Jul 11 03:56:22.877158 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:22.877133    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5984ddb44b-dj8kw"]
Jul 11 03:56:22.878465 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:56:22.878434    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a9831e1_4767_4648_b4fb_d86e6c2a6d19.slice/crio-9cc16da6e4b914d7cd5d5bb20674e990c052db65e4145ef4f676c2e2a6c782db WatchSource:0}: Error finding container 9cc16da6e4b914d7cd5d5bb20674e990c052db65e4145ef4f676c2e2a6c782db: Status 404 returned error can't find the container with id 9cc16da6e4b914d7cd5d5bb20674e990c052db65e4145ef4f676c2e2a6c782db
Jul 11 03:56:23.538197 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:23.538159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5984ddb44b-dj8kw" event={"ID":"0a9831e1-4767-4648-b4fb-d86e6c2a6d19","Type":"ContainerStarted","Data":"9cc16da6e4b914d7cd5d5bb20674e990c052db65e4145ef4f676c2e2a6c782db"}
Jul 11 03:56:26.554317 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:26.554284    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5984ddb44b-dj8kw" event={"ID":"0a9831e1-4767-4648-b4fb-d86e6c2a6d19","Type":"ContainerStarted","Data":"e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e"}
Jul 11 03:56:26.570239 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:56:26.570194    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5984ddb44b-dj8kw" podStartSLOduration=1.126058166 podStartE2EDuration="4.570178999s" totalImagesPullingTime="3.444120833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:56:26.567772307 +0000 UTC m=+459.752924772" watchObservedRunningTime="2026-07-11 03:56:26.570178999 +0000 UTC m=+459.755331468"
Jul 11 03:57:06.903444 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:06.903407    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"]
Jul 11 03:57:06.908046 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:06.908030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:06.911038 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:06.911019    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 11 03:57:06.926837 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:06.926818    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"]
Jul 11 03:57:07.011766 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.011740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78cdf9af-617c-4dd1-9a4e-e3d22df44634-openshift-service-ca\") pod \"maas-api-647c4f4597-w4l7w\" (UID: \"78cdf9af-617c-4dd1-9a4e-e3d22df44634\") " pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:07.011896 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.011776    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78cdf9af-617c-4dd1-9a4e-e3d22df44634-maas-api-tls\") pod \"maas-api-647c4f4597-w4l7w\" (UID: \"78cdf9af-617c-4dd1-9a4e-e3d22df44634\") " pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:07.011896 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.011836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5jm5\" (UniqueName: \"kubernetes.io/projected/78cdf9af-617c-4dd1-9a4e-e3d22df44634-kube-api-access-z5jm5\") pod \"maas-api-647c4f4597-w4l7w\" (UID: \"78cdf9af-617c-4dd1-9a4e-e3d22df44634\") " pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:07.112517 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.112491    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78cdf9af-617c-4dd1-9a4e-e3d22df44634-openshift-service-ca\") pod \"maas-api-647c4f4597-w4l7w\" (UID: \"78cdf9af-617c-4dd1-9a4e-e3d22df44634\") " pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:07.112636 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.112527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78cdf9af-617c-4dd1-9a4e-e3d22df44634-maas-api-tls\") pod \"maas-api-647c4f4597-w4l7w\" (UID: \"78cdf9af-617c-4dd1-9a4e-e3d22df44634\") " pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:07.112636 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.112565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5jm5\" (UniqueName: \"kubernetes.io/projected/78cdf9af-617c-4dd1-9a4e-e3d22df44634-kube-api-access-z5jm5\") pod \"maas-api-647c4f4597-w4l7w\" (UID: \"78cdf9af-617c-4dd1-9a4e-e3d22df44634\") " pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:07.113132 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.113111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78cdf9af-617c-4dd1-9a4e-e3d22df44634-openshift-service-ca\") pod \"maas-api-647c4f4597-w4l7w\" (UID: \"78cdf9af-617c-4dd1-9a4e-e3d22df44634\") " pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:07.114803 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.114784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78cdf9af-617c-4dd1-9a4e-e3d22df44634-maas-api-tls\") pod \"maas-api-647c4f4597-w4l7w\" (UID: \"78cdf9af-617c-4dd1-9a4e-e3d22df44634\") " pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:07.119530 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.119513    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5jm5\" (UniqueName: \"kubernetes.io/projected/78cdf9af-617c-4dd1-9a4e-e3d22df44634-kube-api-access-z5jm5\") pod \"maas-api-647c4f4597-w4l7w\" (UID: \"78cdf9af-617c-4dd1-9a4e-e3d22df44634\") " pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:07.217651 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.217590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:07.350843 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.350822    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"]
Jul 11 03:57:07.352429 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:57:07.352402    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78cdf9af_617c_4dd1_9a4e_e3d22df44634.slice/crio-50b2de36c7e97fe34085e1a02b5f1ace3ea3e80e035255dfae015c6e7b0fb08d WatchSource:0}: Error finding container 50b2de36c7e97fe34085e1a02b5f1ace3ea3e80e035255dfae015c6e7b0fb08d: Status 404 returned error can't find the container with id 50b2de36c7e97fe34085e1a02b5f1ace3ea3e80e035255dfae015c6e7b0fb08d
Jul 11 03:57:07.750086 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:07.750041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w" event={"ID":"78cdf9af-617c-4dd1-9a4e-e3d22df44634","Type":"ContainerStarted","Data":"50b2de36c7e97fe34085e1a02b5f1ace3ea3e80e035255dfae015c6e7b0fb08d"}
Jul 11 03:57:09.761394 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:09.761357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w" event={"ID":"78cdf9af-617c-4dd1-9a4e-e3d22df44634","Type":"ContainerStarted","Data":"d7b262c61b67389a963ce0b92b703b59fa50575fc96acbd5e93724d054aa8f18"}
Jul 11 03:57:09.761794 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:09.761497    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:09.776447 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:09.776407    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w" podStartSLOduration=2.276733439 podStartE2EDuration="3.776394678s" totalImagesPullingTime="1.499661239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:57:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:57:09.775180745 +0000 UTC m=+502.960333392" watchObservedRunningTime="2026-07-11 03:57:09.776394678 +0000 UTC m=+502.961547160"
Jul 11 03:57:15.772349 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:15.772306    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-647c4f4597-w4l7w"
Jul 11 03:57:38.479063 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.479027    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"]
Jul 11 03:57:38.482511 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.482491    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.484838 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.484812    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 11 03:57:38.485789 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.485632    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 11 03:57:38.485789 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.485680    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lnw2c\""
Jul 11 03:57:38.485789 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.485688    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 11 03:57:38.491779 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.491689    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"]
Jul 11 03:57:38.575475 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.575434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.575475 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.575480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6szbc\" (UniqueName: \"kubernetes.io/projected/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-kube-api-access-6szbc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.575748 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.575506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.575748 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.575607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.575748 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.575657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.575748 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.575691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.677075 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.677041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.677075 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.677075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.677312 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.677101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.677312 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.677148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.677312 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.677177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6szbc\" (UniqueName: \"kubernetes.io/projected/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-kube-api-access-6szbc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.677312 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.677208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.677547 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.677530    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.677622 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.677578    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.677622 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.677598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.679436 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.679416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.679607 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.679589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.684279 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.684255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6szbc\" (UniqueName: \"kubernetes.io/projected/963fa323-6e7a-4861-a6a2-dde4bc2e7b3b-kube-api-access-6szbc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhwcn\" (UID: \"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.795588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.795555    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:38.926174 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:38.926134    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"]
Jul 11 03:57:38.927274 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:57:38.927250    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963fa323_6e7a_4861_a6a2_dde4bc2e7b3b.slice/crio-a8a7cbe0f698d6f7fca90f5e75067b25c0a1be0d57dc3f471cb497c98c50d8a1 WatchSource:0}: Error finding container a8a7cbe0f698d6f7fca90f5e75067b25c0a1be0d57dc3f471cb497c98c50d8a1: Status 404 returned error can't find the container with id a8a7cbe0f698d6f7fca90f5e75067b25c0a1be0d57dc3f471cb497c98c50d8a1
Jul 11 03:57:39.917630 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:39.917530    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn" event={"ID":"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b","Type":"ContainerStarted","Data":"a8a7cbe0f698d6f7fca90f5e75067b25c0a1be0d57dc3f471cb497c98c50d8a1"}
Jul 11 03:57:40.924084 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:40.924046    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn" event={"ID":"963fa323-6e7a-4861-a6a2-dde4bc2e7b3b","Type":"ContainerStarted","Data":"5db0b8d38240537cb867848e7c0ba5c5c930790362b55621ef3120b5a61d0534"}
Jul 11 03:57:40.940958 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:40.940907    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn" podStartSLOduration=1.839141205 podStartE2EDuration="2.940892568s" totalImagesPullingTime="1.101751363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:57:40.938580001 +0000 UTC m=+534.123732457" watchObservedRunningTime="2026-07-11 03:57:40.940892568 +0000 UTC m=+534.126045024"
Jul 11 03:57:48.796531 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:48.796488    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:48.797011 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:48.796641    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:48.809034 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:48.809014    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:48.974496 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:48.974469    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhwcn"
Jul 11 03:57:54.576663 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.576630    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"]
Jul 11 03:57:54.580828 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.580806    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.582911 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.582892    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 11 03:57:54.587899 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.587863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"]
Jul 11 03:57:54.716528 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.716490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.716688 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.716556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj6cn\" (UniqueName: \"kubernetes.io/projected/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-kube-api-access-dj6cn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.716688 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.716611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.716688 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.716650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.716688 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.716669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.716823 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.716730    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.817540 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.817502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.817733 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.817562    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.817733 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.817608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj6cn\" (UniqueName: \"kubernetes.io/projected/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-kube-api-access-dj6cn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.817733 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.817639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.817900 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.817817    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.817900 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.817852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.817900 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.817881    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.818049 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.817929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.818129 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.818112    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.819928 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.819906    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.820120 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.820102    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.824496 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.824475    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj6cn\" (UniqueName: \"kubernetes.io/projected/2bd3b1a7-668a-4a1f-b739-54bdde3772fd-kube-api-access-dj6cn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn\" (UID: \"2bd3b1a7-668a-4a1f-b739-54bdde3772fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:54.893617 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:54.893525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:57:55.020503 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:55.020480    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"]
Jul 11 03:57:55.022680 ip-10-0-135-235 kubenswrapper[2576]: W0711 03:57:55.022653    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd3b1a7_668a_4a1f_b739_54bdde3772fd.slice/crio-dddaaf47739e61a5bb9d213a4ca39c519b3d886a03892df75c20e84993e5f27d WatchSource:0}: Error finding container dddaaf47739e61a5bb9d213a4ca39c519b3d886a03892df75c20e84993e5f27d: Status 404 returned error can't find the container with id dddaaf47739e61a5bb9d213a4ca39c519b3d886a03892df75c20e84993e5f27d
Jul 11 03:57:55.999582 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:55.999549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn" event={"ID":"2bd3b1a7-668a-4a1f-b739-54bdde3772fd","Type":"ContainerStarted","Data":"de758360f15be8e0276423e5a74a6eedb489ba61ab0d44621302165a4a73f2c7"}
Jul 11 03:57:55.999942 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:55.999605    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn" event={"ID":"2bd3b1a7-668a-4a1f-b739-54bdde3772fd","Type":"ContainerStarted","Data":"dddaaf47739e61a5bb9d213a4ca39c519b3d886a03892df75c20e84993e5f27d"}
Jul 11 03:57:56.016029 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:57:56.015977    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn" podStartSLOduration=1.861877959 podStartE2EDuration="2.015955979s" totalImagesPullingTime="154.07802ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:57:56.014035702 +0000 UTC m=+549.199188159" watchObservedRunningTime="2026-07-11 03:57:56.015955979 +0000 UTC m=+549.201108440"
Jul 11 03:58:04.893873 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:58:04.893830    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:58:04.894292 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:58:04.893932    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:58:04.906437 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:58:04.906397    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:58:05.057209 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:58:05.057181    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn"
Jul 11 03:59:40.149850 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.149815    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5984ddb44b-dj8kw"]
Jul 11 03:59:40.152137 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.150008    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5984ddb44b-dj8kw" podUID="0a9831e1-4767-4648-b4fb-d86e6c2a6d19" containerName="authorino" containerID="cri-o://e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e" gracePeriod=30
Jul 11 03:59:40.394621 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.394594    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5984ddb44b-dj8kw"
Jul 11 03:59:40.489907 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.489831    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxtj4\" (UniqueName: \"kubernetes.io/projected/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-kube-api-access-rxtj4\") pod \"0a9831e1-4767-4648-b4fb-d86e6c2a6d19\" (UID: \"0a9831e1-4767-4648-b4fb-d86e6c2a6d19\") "
Jul 11 03:59:40.490048 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.489925    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-tls-cert\") pod \"0a9831e1-4767-4648-b4fb-d86e6c2a6d19\" (UID: \"0a9831e1-4767-4648-b4fb-d86e6c2a6d19\") "
Jul 11 03:59:40.491905 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.491884    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-kube-api-access-rxtj4" (OuterVolumeSpecName: "kube-api-access-rxtj4") pod "0a9831e1-4767-4648-b4fb-d86e6c2a6d19" (UID: "0a9831e1-4767-4648-b4fb-d86e6c2a6d19"). InnerVolumeSpecName "kube-api-access-rxtj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 03:59:40.499433 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.499412    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0a9831e1-4767-4648-b4fb-d86e6c2a6d19" (UID: "0a9831e1-4767-4648-b4fb-d86e6c2a6d19"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 03:59:40.511405 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.511384    2576 generic.go:356] "Generic (PLEG): container finished" podID="0a9831e1-4767-4648-b4fb-d86e6c2a6d19" containerID="e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e" exitCode=0
Jul 11 03:59:40.511498 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.511443    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5984ddb44b-dj8kw"
Jul 11 03:59:40.511498 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.511464    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5984ddb44b-dj8kw" event={"ID":"0a9831e1-4767-4648-b4fb-d86e6c2a6d19","Type":"ContainerDied","Data":"e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e"}
Jul 11 03:59:40.511588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.511506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5984ddb44b-dj8kw" event={"ID":"0a9831e1-4767-4648-b4fb-d86e6c2a6d19","Type":"ContainerDied","Data":"9cc16da6e4b914d7cd5d5bb20674e990c052db65e4145ef4f676c2e2a6c782db"}
Jul 11 03:59:40.511588 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.511527    2576 scope.go:117] "RemoveContainer" containerID="e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e"
Jul 11 03:59:40.520539 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.520515    2576 scope.go:117] "RemoveContainer" containerID="e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e"
Jul 11 03:59:40.520814 ip-10-0-135-235 kubenswrapper[2576]: E0711 03:59:40.520794    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e\": container with ID starting with e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e not found: ID does not exist" containerID="e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e"
Jul 11 03:59:40.520907 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.520822    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e"} err="failed to get container status \"e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e\": rpc error: code = NotFound desc = could not find container \"e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e\": container with ID starting with e8cfda78c82f3221029d36ffa48ec26a5a6139cd891106a5e776142d481f212e not found: ID does not exist"
Jul 11 03:59:40.534602 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.534580    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5984ddb44b-dj8kw"]
Jul 11 03:59:40.540695 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.540672    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5984ddb44b-dj8kw"]
Jul 11 03:59:40.591021 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.591000    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-tls-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:59:40.591021 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:40.591020    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxtj4\" (UniqueName: \"kubernetes.io/projected/0a9831e1-4767-4648-b4fb-d86e6c2a6d19-kube-api-access-rxtj4\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 03:59:41.477671 ip-10-0-135-235 kubenswrapper[2576]: I0711 03:59:41.477595    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a9831e1-4767-4648-b4fb-d86e6c2a6d19" path="/var/lib/kubelet/pods/0a9831e1-4767-4648-b4fb-d86e6c2a6d19/volumes"
Jul 11 04:00:00.139499 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:00.139449    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29729040-lw8b9"]
Jul 11 04:00:00.139900 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:00.139810    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9831e1-4767-4648-b4fb-d86e6c2a6d19" containerName="authorino"
Jul 11 04:00:00.139900 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:00.139821    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9831e1-4767-4648-b4fb-d86e6c2a6d19" containerName="authorino"
Jul 11 04:00:00.139900 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:00.139888    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9831e1-4767-4648-b4fb-d86e6c2a6d19" containerName="authorino"
Jul 11 04:00:00.144103 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:00.144077    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729040-lw8b9"
Jul 11 04:00:00.146585 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:00.146564    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:00:00.148463 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:00.148436    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29729040-lw8b9"]
Jul 11 04:00:00.156913 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:00.156891    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729040-lw8b9"
Jul 11 04:00:00.285002 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:00.284943    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29729040-lw8b9"]
Jul 11 04:00:00.287358 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:00:00.287318    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd7d1b6b_a3fe_4d95_a8a5_1d1c0cf078fb.slice/crio-138d57bc30dc282aadc149938120a1a31b5be03c4b2788fee8cf92c93abaf1f3 WatchSource:0}: Error finding container 138d57bc30dc282aadc149938120a1a31b5be03c4b2788fee8cf92c93abaf1f3: Status 404 returned error can't find the container with id 138d57bc30dc282aadc149938120a1a31b5be03c4b2788fee8cf92c93abaf1f3
Jul 11 04:00:00.289564 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:00.289547    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 04:00:00.610142 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:00.610103    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729040-lw8b9" event={"ID":"dd7d1b6b-a3fe-4d95-a8a5-1d1c0cf078fb","Type":"ContainerStarted","Data":"138d57bc30dc282aadc149938120a1a31b5be03c4b2788fee8cf92c93abaf1f3"}
Jul 11 04:00:05.636667 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:05.636630    2576 generic.go:356] "Generic (PLEG): container finished" podID="dd7d1b6b-a3fe-4d95-a8a5-1d1c0cf078fb" containerID="e321fcc39fba132600301943fb60c433697285e8f267b3edbcaa09556b395ade" exitCode=0
Jul 11 04:00:05.637118 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:05.636727    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729040-lw8b9" event={"ID":"dd7d1b6b-a3fe-4d95-a8a5-1d1c0cf078fb","Type":"ContainerDied","Data":"e321fcc39fba132600301943fb60c433697285e8f267b3edbcaa09556b395ade"}
Jul 11 04:00:06.763609 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:06.763586    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729040-lw8b9"
Jul 11 04:00:07.648058 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:07.648028    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729040-lw8b9" event={"ID":"dd7d1b6b-a3fe-4d95-a8a5-1d1c0cf078fb","Type":"ContainerDied","Data":"138d57bc30dc282aadc149938120a1a31b5be03c4b2788fee8cf92c93abaf1f3"}
Jul 11 04:00:07.648058 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:07.648050    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729040-lw8b9"
Jul 11 04:00:07.648259 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:00:07.648073    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="138d57bc30dc282aadc149938120a1a31b5be03c4b2788fee8cf92c93abaf1f3"
Jul 11 04:13:21.528090 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.528060    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"]
Jul 11 04:13:21.528621 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.528390    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd7d1b6b-a3fe-4d95-a8a5-1d1c0cf078fb" containerName="cleanup"
Jul 11 04:13:21.528621 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.528402    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd7d1b6b-a3fe-4d95-a8a5-1d1c0cf078fb" containerName="cleanup"
Jul 11 04:13:21.528621 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.528468    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd7d1b6b-a3fe-4d95-a8a5-1d1c0cf078fb" containerName="cleanup"
Jul 11 04:13:21.531148 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.531130    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:21.533313 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.533287    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9ed97a74-serving-cert\""
Jul 11 04:13:21.533453 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.533418    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-drsms\""
Jul 11 04:13:21.540721 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.540697    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"]
Jul 11 04:13:21.649587 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.649555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls\") pod \"maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:21.649750 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.649600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-openshift-service-ca\") pod \"maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:21.649750 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.649661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdrfw\" (UniqueName: \"kubernetes.io/projected/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-kube-api-access-zdrfw\") pod \"maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:21.750843 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.750808    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls\") pod \"maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:21.751010 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.750857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-openshift-service-ca\") pod \"maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:21.751010 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:13:21.750961    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-serving-cert: secret "maas-api-e2e-ait-9ed97a74-serving-cert" not found
Jul 11 04:13:21.751010 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.750978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdrfw\" (UniqueName: \"kubernetes.io/projected/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-kube-api-access-zdrfw\") pod \"maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:21.751118 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:13:21.751031    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls podName:50186ce0-f9c1-4f1e-9bc9-2672a4b643b4 nodeName:}" failed. No retries permitted until 2026-07-11 04:13:22.251013966 +0000 UTC m=+1475.436166399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls") pod "maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248" (UID: "50186ce0-f9c1-4f1e-9bc9-2672a4b643b4") : secret "maas-api-e2e-ait-9ed97a74-serving-cert" not found
Jul 11 04:13:21.751454 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.751438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-openshift-service-ca\") pod \"maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:21.758727 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:21.758703    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdrfw\" (UniqueName: \"kubernetes.io/projected/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-kube-api-access-zdrfw\") pod \"maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:22.256598 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:22.256561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls\") pod \"maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:22.256768 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:13:22.256704    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-serving-cert: secret "maas-api-e2e-ait-9ed97a74-serving-cert" not found
Jul 11 04:13:22.256815 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:13:22.256777    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls podName:50186ce0-f9c1-4f1e-9bc9-2672a4b643b4 nodeName:}" failed. No retries permitted until 2026-07-11 04:13:23.256760292 +0000 UTC m=+1476.441912737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls") pod "maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248" (UID: "50186ce0-f9c1-4f1e-9bc9-2672a4b643b4") : secret "maas-api-e2e-ait-9ed97a74-serving-cert" not found
Jul 11 04:13:23.264903 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:23.264861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls\") pod \"maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:23.267272 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:23.267248    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls\") pod \"maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:23.341826 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:23.341789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:23.469960 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:23.469934    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"]
Jul 11 04:13:23.472494 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:13:23.472467    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50186ce0_f9c1_4f1e_9bc9_2672a4b643b4.slice/crio-3319f33ce760510dc49eae72b22026a8d0040723e34324cdf5e05b13633f8d99 WatchSource:0}: Error finding container 3319f33ce760510dc49eae72b22026a8d0040723e34324cdf5e05b13633f8d99: Status 404 returned error can't find the container with id 3319f33ce760510dc49eae72b22026a8d0040723e34324cdf5e05b13633f8d99
Jul 11 04:13:23.474203 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:23.474180    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 04:13:23.538260 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:23.538229    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248" event={"ID":"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4","Type":"ContainerStarted","Data":"3319f33ce760510dc49eae72b22026a8d0040723e34324cdf5e05b13633f8d99"}
Jul 11 04:13:24.545013 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:24.544979    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248" event={"ID":"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4","Type":"ContainerStarted","Data":"88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90"}
Jul 11 04:13:24.545400 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:24.545070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:24.560516 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:24.560471    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248" podStartSLOduration=2.950610529 podStartE2EDuration="3.560456503s" totalImagesPullingTime="609.845974ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:13:24.558750105 +0000 UTC m=+1477.743902560" watchObservedRunningTime="2026-07-11 04:13:24.560456503 +0000 UTC m=+1477.745609012"
Jul 11 04:13:26.493365 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:26.493316    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"]
Jul 11 04:13:26.496576 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:26.496554    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"
Jul 11 04:13:26.498721 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:26.498702    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:13:26.502725 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:26.502702    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"]
Jul 11 04:13:26.598018 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:26.597978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/946b29de-fa21-4af6-aeb3-b76c3e201712-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w\" (UID: \"946b29de-fa21-4af6-aeb3-b76c3e201712\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"
Jul 11 04:13:26.699476 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:26.699438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/946b29de-fa21-4af6-aeb3-b76c3e201712-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w\" (UID: \"946b29de-fa21-4af6-aeb3-b76c3e201712\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"
Jul 11 04:13:26.700030 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:26.700010    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/946b29de-fa21-4af6-aeb3-b76c3e201712-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w\" (UID: \"946b29de-fa21-4af6-aeb3-b76c3e201712\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"
Jul 11 04:13:26.807441 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:26.807402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"
Jul 11 04:13:26.937552 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:26.937527    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"]
Jul 11 04:13:26.939503 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:13:26.939474    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod946b29de_fa21_4af6_aeb3_b76c3e201712.slice/crio-a6277f8194f9ac5ecb7d7c6ad6c31e326de7a5d8482b0b6d698c3651a4e5a21b WatchSource:0}: Error finding container a6277f8194f9ac5ecb7d7c6ad6c31e326de7a5d8482b0b6d698c3651a4e5a21b: Status 404 returned error can't find the container with id a6277f8194f9ac5ecb7d7c6ad6c31e326de7a5d8482b0b6d698c3651a4e5a21b
Jul 11 04:13:27.561399 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:27.561362    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w" event={"ID":"946b29de-fa21-4af6-aeb3-b76c3e201712","Type":"ContainerStarted","Data":"fe93d7dfc4c9b9839c17176c491a871c51e5126440dd072f305da450be0de8ab"}
Jul 11 04:13:27.561765 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:27.561422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w" event={"ID":"946b29de-fa21-4af6-aeb3-b76c3e201712","Type":"ContainerStarted","Data":"a6277f8194f9ac5ecb7d7c6ad6c31e326de7a5d8482b0b6d698c3651a4e5a21b"}
Jul 11 04:13:27.575954 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:27.575910    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w" podStartSLOduration=1.575895168 podStartE2EDuration="1.575895168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:13:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:13:27.574164774 +0000 UTC m=+1480.759317229" watchObservedRunningTime="2026-07-11 04:13:27.575895168 +0000 UTC m=+1480.761047623"
Jul 11 04:13:28.567812 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:28.567775    2576 generic.go:356] "Generic (PLEG): container finished" podID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerID="fe93d7dfc4c9b9839c17176c491a871c51e5126440dd072f305da450be0de8ab" exitCode=7
Jul 11 04:13:28.568195 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:28.567810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w" event={"ID":"946b29de-fa21-4af6-aeb3-b76c3e201712","Type":"ContainerDied","Data":"fe93d7dfc4c9b9839c17176c491a871c51e5126440dd072f305da450be0de8ab"}
Jul 11 04:13:28.568195 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:28.568044    2576 scope.go:117] "RemoveContainer" containerID="fe93d7dfc4c9b9839c17176c491a871c51e5126440dd072f305da450be0de8ab"
Jul 11 04:13:29.574902 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:29.574867    2576 generic.go:356] "Generic (PLEG): container finished" podID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerID="080c7881480c5e7d7a9f3e6295c14b0de2d7eeb738b2a7efea0c0f308115880f" exitCode=7
Jul 11 04:13:29.575416 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:29.574931    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w" event={"ID":"946b29de-fa21-4af6-aeb3-b76c3e201712","Type":"ContainerDied","Data":"080c7881480c5e7d7a9f3e6295c14b0de2d7eeb738b2a7efea0c0f308115880f"}
Jul 11 04:13:29.575416 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:29.574977    2576 scope.go:117] "RemoveContainer" containerID="fe93d7dfc4c9b9839c17176c491a871c51e5126440dd072f305da450be0de8ab"
Jul 11 04:13:29.575416 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:29.575155    2576 scope.go:117] "RemoveContainer" containerID="080c7881480c5e7d7a9f3e6295c14b0de2d7eeb738b2a7efea0c0f308115880f"
Jul 11 04:13:29.575416 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:13:29.575394    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w_odh-ai-gateway-infra(946b29de-fa21-4af6-aeb3-b76c3e201712)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712"
Jul 11 04:13:30.555337 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:30.555249    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:13:30.582549 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:30.582520    2576 scope.go:117] "RemoveContainer" containerID="080c7881480c5e7d7a9f3e6295c14b0de2d7eeb738b2a7efea0c0f308115880f"
Jul 11 04:13:30.583001 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:13:30.582695    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w_odh-ai-gateway-infra(946b29de-fa21-4af6-aeb3-b76c3e201712)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712"
Jul 11 04:13:42.471968 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:42.471935    2576 scope.go:117] "RemoveContainer" containerID="080c7881480c5e7d7a9f3e6295c14b0de2d7eeb738b2a7efea0c0f308115880f"
Jul 11 04:13:43.646235 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:43.646200    2576 generic.go:356] "Generic (PLEG): container finished" podID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerID="d784238f0047a58f74f415f9cac31353d240020aec23318032658430f5fa6342" exitCode=0
Jul 11 04:13:43.646627 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:43.646272    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w" event={"ID":"946b29de-fa21-4af6-aeb3-b76c3e201712","Type":"ContainerDied","Data":"d784238f0047a58f74f415f9cac31353d240020aec23318032658430f5fa6342"}
Jul 11 04:13:43.646627 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:43.646354    2576 scope.go:117] "RemoveContainer" containerID="080c7881480c5e7d7a9f3e6295c14b0de2d7eeb738b2a7efea0c0f308115880f"
Jul 11 04:13:44.672170 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:44.672135    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"]
Jul 11 04:13:44.787395 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:44.787371    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"
Jul 11 04:13:44.967724 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:44.967626    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/946b29de-fa21-4af6-aeb3-b76c3e201712-maas-api-service-ca\") pod \"946b29de-fa21-4af6-aeb3-b76c3e201712\" (UID: \"946b29de-fa21-4af6-aeb3-b76c3e201712\") "
Jul 11 04:13:44.968045 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:44.968019    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/946b29de-fa21-4af6-aeb3-b76c3e201712-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "946b29de-fa21-4af6-aeb3-b76c3e201712" (UID: "946b29de-fa21-4af6-aeb3-b76c3e201712"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:13:45.069203 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:45.069170    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/946b29de-fa21-4af6-aeb3-b76c3e201712-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:13:45.662108 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:45.662055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w" event={"ID":"946b29de-fa21-4af6-aeb3-b76c3e201712","Type":"ContainerDied","Data":"a6277f8194f9ac5ecb7d7c6ad6c31e326de7a5d8482b0b6d698c3651a4e5a21b"}
Jul 11 04:13:45.662291 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:45.662076    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"
Jul 11 04:13:45.662291 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:45.662222    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6277f8194f9ac5ecb7d7c6ad6c31e326de7a5d8482b0b6d698c3651a4e5a21b"
Jul 11 04:13:45.693154 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:45.693121    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"]
Jul 11 04:13:45.697185 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:45.697160    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-lnl4w"]
Jul 11 04:13:47.476731 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:13:47.476701    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712" path="/var/lib/kubelet/pods/946b29de-fa21-4af6-aeb3-b76c3e201712/volumes"
Jul 11 04:14:16.531764 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.531694    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v"]
Jul 11 04:14:16.532181 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.532016    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerName="revoke-keys"
Jul 11 04:14:16.532181 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.532027    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerName="revoke-keys"
Jul 11 04:14:16.532181 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.532043    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerName="revoke-keys"
Jul 11 04:14:16.532181 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.532049    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerName="revoke-keys"
Jul 11 04:14:16.532181 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.532120    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerName="revoke-keys"
Jul 11 04:14:16.532181 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.532129    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerName="revoke-keys"
Jul 11 04:14:16.535406 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.535391    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v"
Jul 11 04:14:16.537751 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.537730    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:14:16.543367 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.543319    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v"]
Jul 11 04:14:16.651178 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.651137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4ef541-b00b-455e-ab1a-ba867033c84d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v\" (UID: \"ef4ef541-b00b-455e-ab1a-ba867033c84d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v"
Jul 11 04:14:16.752173 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.752139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4ef541-b00b-455e-ab1a-ba867033c84d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v\" (UID: \"ef4ef541-b00b-455e-ab1a-ba867033c84d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v"
Jul 11 04:14:16.752809 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.752786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4ef541-b00b-455e-ab1a-ba867033c84d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v\" (UID: \"ef4ef541-b00b-455e-ab1a-ba867033c84d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v"
Jul 11 04:14:16.846700 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.846622    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v"
Jul 11 04:14:16.974360 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:16.974317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v"]
Jul 11 04:14:16.975918 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:14:16.975889    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4ef541_b00b_455e_ab1a_ba867033c84d.slice/crio-4944c34c5a0adf2dc4ee67e145fb6fd3911d4a58daad51941c6f7f1952743b36 WatchSource:0}: Error finding container 4944c34c5a0adf2dc4ee67e145fb6fd3911d4a58daad51941c6f7f1952743b36: Status 404 returned error can't find the container with id 4944c34c5a0adf2dc4ee67e145fb6fd3911d4a58daad51941c6f7f1952743b36
Jul 11 04:14:17.826119 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:17.826089    2576 generic.go:356] "Generic (PLEG): container finished" podID="ef4ef541-b00b-455e-ab1a-ba867033c84d" containerID="3c50a8c1301d07442cdaeea4a215b1f68050bd5037a780481ae6b72952d2f0a3" exitCode=0
Jul 11 04:14:17.826535 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:17.826131    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v" event={"ID":"ef4ef541-b00b-455e-ab1a-ba867033c84d","Type":"ContainerDied","Data":"3c50a8c1301d07442cdaeea4a215b1f68050bd5037a780481ae6b72952d2f0a3"}
Jul 11 04:14:17.826535 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:17.826173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v" event={"ID":"ef4ef541-b00b-455e-ab1a-ba867033c84d","Type":"ContainerStarted","Data":"4944c34c5a0adf2dc4ee67e145fb6fd3911d4a58daad51941c6f7f1952743b36"}
Jul 11 04:14:18.957877 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:18.957851    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v"
Jul 11 04:14:19.073207 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:19.073168    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4ef541-b00b-455e-ab1a-ba867033c84d-maas-api-service-ca\") pod \"ef4ef541-b00b-455e-ab1a-ba867033c84d\" (UID: \"ef4ef541-b00b-455e-ab1a-ba867033c84d\") "
Jul 11 04:14:19.073540 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:19.073517    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef4ef541-b00b-455e-ab1a-ba867033c84d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef4ef541-b00b-455e-ab1a-ba867033c84d" (UID: "ef4ef541-b00b-455e-ab1a-ba867033c84d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:14:19.174221 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:19.174133    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4ef541-b00b-455e-ab1a-ba867033c84d-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:14:19.836915 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:19.836886    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v"
Jul 11 04:14:19.837106 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:19.836888    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v" event={"ID":"ef4ef541-b00b-455e-ab1a-ba867033c84d","Type":"ContainerDied","Data":"4944c34c5a0adf2dc4ee67e145fb6fd3911d4a58daad51941c6f7f1952743b36"}
Jul 11 04:14:19.837106 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:19.837027    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4944c34c5a0adf2dc4ee67e145fb6fd3911d4a58daad51941c6f7f1952743b36"
Jul 11 04:14:26.889869 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:26.889778    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"]
Jul 11 04:14:26.890457 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:26.890069    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248" podUID="50186ce0-f9c1-4f1e-9bc9-2672a4b643b4" containerName="maas-api" containerID="cri-o://88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90" gracePeriod=30
Jul 11 04:14:27.139123 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.139096    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:14:27.245193 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.245100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls\") pod \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") "
Jul 11 04:14:27.245397 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.245227    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-openshift-service-ca\") pod \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") "
Jul 11 04:14:27.245397 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.245244    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdrfw\" (UniqueName: \"kubernetes.io/projected/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-kube-api-access-zdrfw\") pod \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\" (UID: \"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4\") "
Jul 11 04:14:27.245606 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.245581    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "50186ce0-f9c1-4f1e-9bc9-2672a4b643b4" (UID: "50186ce0-f9c1-4f1e-9bc9-2672a4b643b4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:14:27.247457 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.247432    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "50186ce0-f9c1-4f1e-9bc9-2672a4b643b4" (UID: "50186ce0-f9c1-4f1e-9bc9-2672a4b643b4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:14:27.247564 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.247457    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-kube-api-access-zdrfw" (OuterVolumeSpecName: "kube-api-access-zdrfw") pod "50186ce0-f9c1-4f1e-9bc9-2672a4b643b4" (UID: "50186ce0-f9c1-4f1e-9bc9-2672a4b643b4"). InnerVolumeSpecName "kube-api-access-zdrfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:14:27.346642 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.346608    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:14:27.346642 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.346635    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:14:27.346642 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.346645    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdrfw\" (UniqueName: \"kubernetes.io/projected/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4-kube-api-access-zdrfw\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:14:27.878102 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.878062    2576 generic.go:356] "Generic (PLEG): container finished" podID="50186ce0-f9c1-4f1e-9bc9-2672a4b643b4" containerID="88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90" exitCode=0
Jul 11 04:14:27.878271 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.878116    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"
Jul 11 04:14:27.878271 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.878144    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248" event={"ID":"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4","Type":"ContainerDied","Data":"88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90"}
Jul 11 04:14:27.878271 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.878201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248" event={"ID":"50186ce0-f9c1-4f1e-9bc9-2672a4b643b4","Type":"ContainerDied","Data":"3319f33ce760510dc49eae72b22026a8d0040723e34324cdf5e05b13633f8d99"}
Jul 11 04:14:27.878271 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.878223    2576 scope.go:117] "RemoveContainer" containerID="88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90"
Jul 11 04:14:27.886895 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.886878    2576 scope.go:117] "RemoveContainer" containerID="88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90"
Jul 11 04:14:27.887121 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:14:27.887102    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90\": container with ID starting with 88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90 not found: ID does not exist" containerID="88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90"
Jul 11 04:14:27.887167 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.887129    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90"} err="failed to get container status \"88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90\": rpc error: code = NotFound desc = could not find container \"88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90\": container with ID starting with 88782b08ed1a8971d91650a415cbc501555c09a7eb1ec978457b278f269e6d90 not found: ID does not exist"
Jul 11 04:14:27.892650 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.892615    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"]
Jul 11 04:14:27.894960 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:27.894940    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9ed97a74-6cf8477ffb-mr248"]
Jul 11 04:14:29.481651 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:29.481602    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50186ce0-f9c1-4f1e-9bc9-2672a4b643b4" path="/var/lib/kubelet/pods/50186ce0-f9c1-4f1e-9bc9-2672a4b643b4/volumes"
Jul 11 04:14:42.323493 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.323459    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"]
Jul 11 04:14:42.323879 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.323783    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef4ef541-b00b-455e-ab1a-ba867033c84d" containerName="revoke-keys"
Jul 11 04:14:42.323879 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.323794    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef4ef541-b00b-455e-ab1a-ba867033c84d" containerName="revoke-keys"
Jul 11 04:14:42.323879 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.323807    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50186ce0-f9c1-4f1e-9bc9-2672a4b643b4" containerName="maas-api"
Jul 11 04:14:42.323879 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.323812    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="50186ce0-f9c1-4f1e-9bc9-2672a4b643b4" containerName="maas-api"
Jul 11 04:14:42.323879 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.323823    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerName="revoke-keys"
Jul 11 04:14:42.323879 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.323829    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerName="revoke-keys"
Jul 11 04:14:42.324076 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.323884    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="946b29de-fa21-4af6-aeb3-b76c3e201712" containerName="revoke-keys"
Jul 11 04:14:42.324076 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.323891    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef4ef541-b00b-455e-ab1a-ba867033c84d" containerName="revoke-keys"
Jul 11 04:14:42.324076 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.323898    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="50186ce0-f9c1-4f1e-9bc9-2672a4b643b4" containerName="maas-api"
Jul 11 04:14:42.328242 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.328221    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.331234 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.331206    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-64b9bd32-gw-openshift-default-dockercfg-6x78s\""
Jul 11 04:14:42.339632 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.339605    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"]
Jul 11 04:14:42.371353 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.371296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-socket\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.371518 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.371360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8971291d-9100-4b48-91bd-45e469e81192-istio-podinfo\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.371518 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.371380    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-istio-token\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.371518 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.371408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9cdh\" (UniqueName: \"kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-kube-api-access-w9cdh\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.371518 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.371426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-data\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.371518 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.371501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-credential-socket\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.371689 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.371534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8971291d-9100-4b48-91bd-45e469e81192-istiod-ca-cert\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.371689 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.371562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-envoy\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.371689 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.371613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-certs\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472076 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-socket\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472076 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8971291d-9100-4b48-91bd-45e469e81192-istio-podinfo\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472361 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-istio-token\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472361 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9cdh\" (UniqueName: \"kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-kube-api-access-w9cdh\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472361 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-data\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472361 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-credential-socket\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472361 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8971291d-9100-4b48-91bd-45e469e81192-istiod-ca-cert\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472624 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-envoy\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472624 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-certs\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472624 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-socket\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472724 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472623    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-data\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472786 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-certs\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.472786 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.472734    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-credential-socket\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.473145 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.473120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8971291d-9100-4b48-91bd-45e469e81192-istiod-ca-cert\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.474598 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.474566    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-envoy\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.474784 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.474767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8971291d-9100-4b48-91bd-45e469e81192-istio-podinfo\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.486893 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.486867    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-istio-token\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.487855 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.487832    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9cdh\" (UniqueName: \"kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-kube-api-access-w9cdh\") pod \"e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") " pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.640200 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.640098    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:42.773237 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.773210    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"]
Jul 11 04:14:42.775769 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:14:42.775746    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8971291d_9100_4b48_91bd_45e469e81192.slice/crio-384aa1ef09f9cf5a0d42a8ea05662362570aba448555c46f95c367f0b5238183 WatchSource:0}: Error finding container 384aa1ef09f9cf5a0d42a8ea05662362570aba448555c46f95c367f0b5238183: Status 404 returned error can't find the container with id 384aa1ef09f9cf5a0d42a8ea05662362570aba448555c46f95c367f0b5238183
Jul 11 04:14:42.954554 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:42.954466    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" event={"ID":"8971291d-9100-4b48-91bd-45e469e81192","Type":"ContainerStarted","Data":"384aa1ef09f9cf5a0d42a8ea05662362570aba448555c46f95c367f0b5238183"}
Jul 11 04:14:43.861406 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.861364    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"]
Jul 11 04:14:43.865372 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.865348    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:43.867511 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.867474    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-64b9bd32-serving-cert\""
Jul 11 04:14:43.867641 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.867511    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-drsms\""
Jul 11 04:14:43.875873 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.875635    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"]
Jul 11 04:14:43.885615 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.885577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15a83d5-c2ca-4e4e-87ca-193641bc339c-maas-api-tls\") pod \"maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:43.885784 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.885616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15a83d5-c2ca-4e4e-87ca-193641bc339c-openshift-service-ca\") pod \"maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:43.885784 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.885676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m95bd\" (UniqueName: \"kubernetes.io/projected/c15a83d5-c2ca-4e4e-87ca-193641bc339c-kube-api-access-m95bd\") pod \"maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:43.986846 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.986806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15a83d5-c2ca-4e4e-87ca-193641bc339c-maas-api-tls\") pod \"maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:43.987041 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.986928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15a83d5-c2ca-4e4e-87ca-193641bc339c-openshift-service-ca\") pod \"maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:43.987041 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.986977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m95bd\" (UniqueName: \"kubernetes.io/projected/c15a83d5-c2ca-4e4e-87ca-193641bc339c-kube-api-access-m95bd\") pod \"maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:43.987041 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:14:43.987011    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-serving-cert: secret "maas-api-e2e-migrate-64b9bd32-serving-cert" not found
Jul 11 04:14:43.987205 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:14:43.987134    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c15a83d5-c2ca-4e4e-87ca-193641bc339c-maas-api-tls podName:c15a83d5-c2ca-4e4e-87ca-193641bc339c nodeName:}" failed. No retries permitted until 2026-07-11 04:14:44.48710624 +0000 UTC m=+1557.672258681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c15a83d5-c2ca-4e4e-87ca-193641bc339c-maas-api-tls") pod "maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn" (UID: "c15a83d5-c2ca-4e4e-87ca-193641bc339c") : secret "maas-api-e2e-migrate-64b9bd32-serving-cert" not found
Jul 11 04:14:43.987757 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.987737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15a83d5-c2ca-4e4e-87ca-193641bc339c-openshift-service-ca\") pod \"maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:43.997876 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:43.997850    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m95bd\" (UniqueName: \"kubernetes.io/projected/c15a83d5-c2ca-4e4e-87ca-193641bc339c-kube-api-access-m95bd\") pod \"maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:44.495375 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:44.493356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15a83d5-c2ca-4e4e-87ca-193641bc339c-maas-api-tls\") pod \"maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:44.500032 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:44.499998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15a83d5-c2ca-4e4e-87ca-193641bc339c-maas-api-tls\") pod \"maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:44.781167 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:44.781124    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:45.324927 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:45.324888    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:14:45.325221 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:45.324970    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:14:45.325221 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:45.325000    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:14:45.389072 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:45.388955    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"]
Jul 11 04:14:45.391504 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:14:45.391476    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc15a83d5_c2ca_4e4e_87ca_193641bc339c.slice/crio-16dd0a5a175bf23db612ab0fa6124848e9ef3e7b792b7045d4c177b35d3aa627 WatchSource:0}: Error finding container 16dd0a5a175bf23db612ab0fa6124848e9ef3e7b792b7045d4c177b35d3aa627: Status 404 returned error can't find the container with id 16dd0a5a175bf23db612ab0fa6124848e9ef3e7b792b7045d4c177b35d3aa627
Jul 11 04:14:45.976499 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:45.976458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" event={"ID":"8971291d-9100-4b48-91bd-45e469e81192","Type":"ContainerStarted","Data":"dd32719d6bc94bd6625538ea3cc376fce8a23619ec895a29fcaa8ba380704b58"}
Jul 11 04:14:45.978127 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:45.978101    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn" event={"ID":"c15a83d5-c2ca-4e4e-87ca-193641bc339c","Type":"ContainerStarted","Data":"2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5"}
Jul 11 04:14:45.978235 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:45.978141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn" event={"ID":"c15a83d5-c2ca-4e4e-87ca-193641bc339c","Type":"ContainerStarted","Data":"16dd0a5a175bf23db612ab0fa6124848e9ef3e7b792b7045d4c177b35d3aa627"}
Jul 11 04:14:45.978235 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:45.978161    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:45.995377 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:45.995302    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" podStartSLOduration=1.448419601 podStartE2EDuration="3.995285578s" totalImagesPullingTime="2.546865977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:14:45.993302908 +0000 UTC m=+1559.178455385" watchObservedRunningTime="2026-07-11 04:14:45.995285578 +0000 UTC m=+1559.180438033"
Jul 11 04:14:46.010145 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:46.010089    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn" podStartSLOduration=2.602051634 podStartE2EDuration="3.010074602s" totalImagesPullingTime="408.022968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:14:46.008263638 +0000 UTC m=+1559.193416093" watchObservedRunningTime="2026-07-11 04:14:46.010074602 +0000 UTC m=+1559.195227056"
Jul 11 04:14:46.640923 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:46.640880    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:46.645759 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:46.645733    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:46.984143 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:46.984055    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:46.985153 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:46.985132    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:48.101818 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:48.101784    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"]
Jul 11 04:14:48.104932 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:48.104912    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"
Jul 11 04:14:48.107047 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:48.107025    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:14:48.111193 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:48.111164    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"]
Jul 11 04:14:48.125101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:48.125071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8447d21-27c0-48e0-99e3-fd146e7251dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t\" (UID: \"f8447d21-27c0-48e0-99e3-fd146e7251dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"
Jul 11 04:14:48.225695 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:48.225654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8447d21-27c0-48e0-99e3-fd146e7251dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t\" (UID: \"f8447d21-27c0-48e0-99e3-fd146e7251dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"
Jul 11 04:14:48.226288 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:48.226269    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8447d21-27c0-48e0-99e3-fd146e7251dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t\" (UID: \"f8447d21-27c0-48e0-99e3-fd146e7251dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"
Jul 11 04:14:48.418104 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:48.418065    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"
Jul 11 04:14:48.554104 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:48.553842    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"]
Jul 11 04:14:48.556722 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:14:48.556697    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8447d21_27c0_48e0_99e3_fd146e7251dd.slice/crio-161253f18e39f4ee84c3c2cf7d69e71fdd7d0c4c58777456a23ae5c850a68ccc WatchSource:0}: Error finding container 161253f18e39f4ee84c3c2cf7d69e71fdd7d0c4c58777456a23ae5c850a68ccc: Status 404 returned error can't find the container with id 161253f18e39f4ee84c3c2cf7d69e71fdd7d0c4c58777456a23ae5c850a68ccc
Jul 11 04:14:48.996093 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:48.996051    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t" event={"ID":"f8447d21-27c0-48e0-99e3-fd146e7251dd","Type":"ContainerStarted","Data":"0b06ad9aa07c225988e98c18a9378e0064d343bd732ab2f6567ef98ffc3f8e59"}
Jul 11 04:14:48.996261 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:48.996112    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t" event={"ID":"f8447d21-27c0-48e0-99e3-fd146e7251dd","Type":"ContainerStarted","Data":"161253f18e39f4ee84c3c2cf7d69e71fdd7d0c4c58777456a23ae5c850a68ccc"}
Jul 11 04:14:49.010565 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:49.010511    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t" podStartSLOduration=1.010490952 podStartE2EDuration="1.010490952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:14:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:14:49.009415112 +0000 UTC m=+1562.194567567" watchObservedRunningTime="2026-07-11 04:14:49.010490952 +0000 UTC m=+1562.195643411"
Jul 11 04:14:50.003970 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:50.003931    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerID="0b06ad9aa07c225988e98c18a9378e0064d343bd732ab2f6567ef98ffc3f8e59" exitCode=7
Jul 11 04:14:50.004625 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:50.004601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t" event={"ID":"f8447d21-27c0-48e0-99e3-fd146e7251dd","Type":"ContainerDied","Data":"0b06ad9aa07c225988e98c18a9378e0064d343bd732ab2f6567ef98ffc3f8e59"}
Jul 11 04:14:50.005079 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:50.005060    2576 scope.go:117] "RemoveContainer" containerID="0b06ad9aa07c225988e98c18a9378e0064d343bd732ab2f6567ef98ffc3f8e59"
Jul 11 04:14:51.011847 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:51.011814    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerID="5771430ffab5576609bd36c8b148573ae0dd5c8f1c7a70b90f9fa187e0a3f917" exitCode=7
Jul 11 04:14:51.012212 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:51.011900    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t" event={"ID":"f8447d21-27c0-48e0-99e3-fd146e7251dd","Type":"ContainerDied","Data":"5771430ffab5576609bd36c8b148573ae0dd5c8f1c7a70b90f9fa187e0a3f917"}
Jul 11 04:14:51.012212 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:51.011967    2576 scope.go:117] "RemoveContainer" containerID="0b06ad9aa07c225988e98c18a9378e0064d343bd732ab2f6567ef98ffc3f8e59"
Jul 11 04:14:51.012212 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:51.012192    2576 scope.go:117] "RemoveContainer" containerID="5771430ffab5576609bd36c8b148573ae0dd5c8f1c7a70b90f9fa187e0a3f917"
Jul 11 04:14:51.012410 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:14:51.012383    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t_odh-ai-gateway-infra(f8447d21-27c0-48e0-99e3-fd146e7251dd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd"
Jul 11 04:14:51.990128 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:51.990100    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:14:52.021693 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:52.021665    2576 scope.go:117] "RemoveContainer" containerID="5771430ffab5576609bd36c8b148573ae0dd5c8f1c7a70b90f9fa187e0a3f917"
Jul 11 04:14:52.022039 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:14:52.021905    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t_odh-ai-gateway-infra(f8447d21-27c0-48e0-99e3-fd146e7251dd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd"
Jul 11 04:14:57.050176 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:57.050138    2576 generic.go:356] "Generic (PLEG): container finished" podID="8971291d-9100-4b48-91bd-45e469e81192" containerID="dd32719d6bc94bd6625538ea3cc376fce8a23619ec895a29fcaa8ba380704b58" exitCode=0
Jul 11 04:14:57.050584 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:57.050209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" event={"ID":"8971291d-9100-4b48-91bd-45e469e81192","Type":"ContainerDied","Data":"dd32719d6bc94bd6625538ea3cc376fce8a23619ec895a29fcaa8ba380704b58"}
Jul 11 04:14:57.050584 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:57.050577    2576 scope.go:117] "RemoveContainer" containerID="dd32719d6bc94bd6625538ea3cc376fce8a23619ec895a29fcaa8ba380704b58"
Jul 11 04:14:57.051551 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:57.051518    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:14:57.051674 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:57.051587    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:14:57.051674 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:57.051619    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:14:58.070617 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:58.070570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" event={"ID":"8971291d-9100-4b48-91bd-45e469e81192","Type":"ContainerStarted","Data":"dcb3485d0b4a83ed89b64c1ea01ea6ea4850a37767eef224b2509b5b9951423f"}
Jul 11 04:14:58.640954 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:58.640913    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:14:58.641851 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:58.641825    2576 patch_prober.go:28] interesting pod/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 11 04:14:58.641910 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:58.641887    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" podUID="8971291d-9100-4b48-91bd-45e469e81192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 11 04:14:59.640965 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:59.640919    2576 patch_prober.go:28] interesting pod/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 11 04:14:59.641347 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:14:59.640986    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" podUID="8971291d-9100-4b48-91bd-45e469e81192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 11 04:15:00.128830 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.128781    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6"]
Jul 11 04:15:00.134765 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.134733    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch"]
Jul 11 04:15:00.135068 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.135033    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6"
Jul 11 04:15:00.140749 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.140721    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6"]
Jul 11 04:15:00.140994 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.140970    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch"]
Jul 11 04:15:00.141091 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.140843    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch"
Jul 11 04:15:00.149372 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.149349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6"
Jul 11 04:15:00.181981 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.181948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch"
Jul 11 04:15:00.336821 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.336782    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6"]
Jul 11 04:15:00.381906 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.381818    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch"]
Jul 11 04:15:00.386092 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:15:00.386058    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1fb585_e353_46e2_98ed_672d5b4525a7.slice/crio-d44aaab9b09e0531db34c5cbb55eba0cb902eedfc52b5a417f9f457e9d1aa1e6 WatchSource:0}: Error finding container d44aaab9b09e0531db34c5cbb55eba0cb902eedfc52b5a417f9f457e9d1aa1e6: Status 404 returned error can't find the container with id d44aaab9b09e0531db34c5cbb55eba0cb902eedfc52b5a417f9f457e9d1aa1e6
Jul 11 04:15:00.641768 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.641671    2576 patch_prober.go:28] interesting pod/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 11 04:15:00.641768 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:00.641737    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" podUID="8971291d-9100-4b48-91bd-45e469e81192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 11 04:15:01.090778 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:01.090739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch" event={"ID":"ef1fb585-e353-46e2-98ed-672d5b4525a7","Type":"ContainerStarted","Data":"9d5f7537d68f45c466e117a1e26676f7b9e651ab2f6f5d0cbe0bc6c26d346ff8"}
Jul 11 04:15:01.090985 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:01.090797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch" event={"ID":"ef1fb585-e353-46e2-98ed-672d5b4525a7","Type":"ContainerStarted","Data":"d44aaab9b09e0531db34c5cbb55eba0cb902eedfc52b5a417f9f457e9d1aa1e6"}
Jul 11 04:15:01.092139 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:01.092112    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6" event={"ID":"5cb6a92c-862e-41ab-a7d1-af6d8f516055","Type":"ContainerStarted","Data":"a9a6941a4c6d5de213d435af729395b4d88c9b7ce9bc118cdd2ba6652039a4d0"}
Jul 11 04:15:01.092235 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:01.092159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6" event={"ID":"5cb6a92c-862e-41ab-a7d1-af6d8f516055","Type":"ContainerStarted","Data":"6d86812dff4efbd62de53d1ae4e5fecc7e5e9630fef62dfb9736813370b21edc"}
Jul 11 04:15:01.105737 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:01.105689    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch" podStartSLOduration=1.105675962 podStartE2EDuration="1.105675962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:15:01.103277234 +0000 UTC m=+1574.288429690" watchObservedRunningTime="2026-07-11 04:15:01.105675962 +0000 UTC m=+1574.290828430"
Jul 11 04:15:01.116724 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:01.116679    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6" podStartSLOduration=1.116665649 podStartE2EDuration="1.116665649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:15:01.11447477 +0000 UTC m=+1574.299627229" watchObservedRunningTime="2026-07-11 04:15:01.116665649 +0000 UTC m=+1574.301818104"
Jul 11 04:15:01.641172 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:01.641133    2576 patch_prober.go:28] interesting pod/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 11 04:15:01.641372 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:01.641190    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" podUID="8971291d-9100-4b48-91bd-45e469e81192" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 11 04:15:01.984253 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:01.984173    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:15:02.098547 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:02.098519    2576 generic.go:356] "Generic (PLEG): container finished" podID="ef1fb585-e353-46e2-98ed-672d5b4525a7" containerID="9d5f7537d68f45c466e117a1e26676f7b9e651ab2f6f5d0cbe0bc6c26d346ff8" exitCode=0
Jul 11 04:15:02.098726 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:02.098609    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch" event={"ID":"ef1fb585-e353-46e2-98ed-672d5b4525a7","Type":"ContainerDied","Data":"9d5f7537d68f45c466e117a1e26676f7b9e651ab2f6f5d0cbe0bc6c26d346ff8"}
Jul 11 04:15:02.099983 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:02.099960    2576 generic.go:356] "Generic (PLEG): container finished" podID="5cb6a92c-862e-41ab-a7d1-af6d8f516055" containerID="a9a6941a4c6d5de213d435af729395b4d88c9b7ce9bc118cdd2ba6652039a4d0" exitCode=0
Jul 11 04:15:02.100072 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:02.100039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6" event={"ID":"5cb6a92c-862e-41ab-a7d1-af6d8f516055","Type":"ContainerDied","Data":"a9a6941a4c6d5de213d435af729395b4d88c9b7ce9bc118cdd2ba6652039a4d0"}
Jul 11 04:15:02.644305 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:02.644275    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:15:02.645273 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:02.645255    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:15:03.231356 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:03.231319    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch"
Jul 11 04:15:03.265605 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:03.265580    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6"
Jul 11 04:15:04.112304 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:04.112264    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6"
Jul 11 04:15:04.112550 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:04.112308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729055-drnb6" event={"ID":"5cb6a92c-862e-41ab-a7d1-af6d8f516055","Type":"ContainerDied","Data":"6d86812dff4efbd62de53d1ae4e5fecc7e5e9630fef62dfb9736813370b21edc"}
Jul 11 04:15:04.112550 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:04.112386    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d86812dff4efbd62de53d1ae4e5fecc7e5e9630fef62dfb9736813370b21edc"
Jul 11 04:15:04.113712 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:04.113689    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch" event={"ID":"ef1fb585-e353-46e2-98ed-672d5b4525a7","Type":"ContainerDied","Data":"d44aaab9b09e0531db34c5cbb55eba0cb902eedfc52b5a417f9f457e9d1aa1e6"}
Jul 11 04:15:04.113810 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:04.113731    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch"
Jul 11 04:15:04.113810 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:04.113731    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d44aaab9b09e0531db34c5cbb55eba0cb902eedfc52b5a417f9f457e9d1aa1e6"
Jul 11 04:15:05.472258 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:05.472228    2576 scope.go:117] "RemoveContainer" containerID="5771430ffab5576609bd36c8b148573ae0dd5c8f1c7a70b90f9fa187e0a3f917"
Jul 11 04:15:06.125073 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:06.125038    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t" event={"ID":"f8447d21-27c0-48e0-99e3-fd146e7251dd","Type":"ContainerStarted","Data":"ea09d41d79b7cf10105963045019388d35663b6bfb8fb6b82b82e4710eb2b650"}
Jul 11 04:15:07.131695 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:07.131659    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerID="ea09d41d79b7cf10105963045019388d35663b6bfb8fb6b82b82e4710eb2b650" exitCode=0
Jul 11 04:15:07.132110 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:07.131735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t" event={"ID":"f8447d21-27c0-48e0-99e3-fd146e7251dd","Type":"ContainerDied","Data":"ea09d41d79b7cf10105963045019388d35663b6bfb8fb6b82b82e4710eb2b650"}
Jul 11 04:15:07.132110 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:07.131798    2576 scope.go:117] "RemoveContainer" containerID="5771430ffab5576609bd36c8b148573ae0dd5c8f1c7a70b90f9fa187e0a3f917"
Jul 11 04:15:07.147475 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:07.147450    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"]
Jul 11 04:15:08.272590 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:08.272565    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"
Jul 11 04:15:08.440721 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:08.440634    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8447d21-27c0-48e0-99e3-fd146e7251dd-maas-api-service-ca\") pod \"f8447d21-27c0-48e0-99e3-fd146e7251dd\" (UID: \"f8447d21-27c0-48e0-99e3-fd146e7251dd\") "
Jul 11 04:15:08.441025 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:08.441001    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8447d21-27c0-48e0-99e3-fd146e7251dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f8447d21-27c0-48e0-99e3-fd146e7251dd" (UID: "f8447d21-27c0-48e0-99e3-fd146e7251dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:15:08.541939 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:08.541903    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8447d21-27c0-48e0-99e3-fd146e7251dd-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:09.145234 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:09.145197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t" event={"ID":"f8447d21-27c0-48e0-99e3-fd146e7251dd","Type":"ContainerDied","Data":"161253f18e39f4ee84c3c2cf7d69e71fdd7d0c4c58777456a23ae5c850a68ccc"}
Jul 11 04:15:09.145234 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:09.145233    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"
Jul 11 04:15:09.145462 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:09.145255    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="161253f18e39f4ee84c3c2cf7d69e71fdd7d0c4c58777456a23ae5c850a68ccc"
Jul 11 04:15:09.171750 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:09.171717    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"]
Jul 11 04:15:09.175851 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:09.175829    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-wkj4t"]
Jul 11 04:15:09.476993 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:09.476905    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd" path="/var/lib/kubelet/pods/f8447d21-27c0-48e0-99e3-fd146e7251dd/volumes"
Jul 11 04:15:48.145132 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145047    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w"]
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145407    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1fb585-e353-46e2-98ed-672d5b4525a7" containerName="cleanup"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145419    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1fb585-e353-46e2-98ed-672d5b4525a7" containerName="cleanup"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145433    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerName="revoke-keys"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145439    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerName="revoke-keys"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145449    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerName="revoke-keys"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145454    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerName="revoke-keys"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145463    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerName="revoke-keys"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145468    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerName="revoke-keys"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145479    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cb6a92c-862e-41ab-a7d1-af6d8f516055" containerName="cleanup"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145484    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cb6a92c-862e-41ab-a7d1-af6d8f516055" containerName="cleanup"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145545    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerName="revoke-keys"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145552    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerName="revoke-keys"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145559    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cb6a92c-862e-41ab-a7d1-af6d8f516055" containerName="cleanup"
Jul 11 04:15:48.145572 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.145566    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1fb585-e353-46e2-98ed-672d5b4525a7" containerName="cleanup"
Jul 11 04:15:48.148799 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.148782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w"
Jul 11 04:15:48.151249 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.151221    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:15:48.156524 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.156494    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w"]
Jul 11 04:15:48.220009 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.219966    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"]
Jul 11 04:15:48.220244 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.220203    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" podUID="8971291d-9100-4b48-91bd-45e469e81192" containerName="istio-proxy" containerID="cri-o://dcb3485d0b4a83ed89b64c1ea01ea6ea4850a37767eef224b2509b5b9951423f" gracePeriod=30
Jul 11 04:15:48.297180 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.297142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4a83cec-0b58-4574-aac9-80802c79c65f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w\" (UID: \"a4a83cec-0b58-4574-aac9-80802c79c65f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w"
Jul 11 04:15:48.398607 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.398518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4a83cec-0b58-4574-aac9-80802c79c65f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w\" (UID: \"a4a83cec-0b58-4574-aac9-80802c79c65f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w"
Jul 11 04:15:48.399113 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.399094    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4a83cec-0b58-4574-aac9-80802c79c65f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w\" (UID: \"a4a83cec-0b58-4574-aac9-80802c79c65f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w"
Jul 11 04:15:48.467457 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.467424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w"
Jul 11 04:15:48.618517 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:48.618495    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w"]
Jul 11 04:15:48.620550 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:15:48.620520    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a83cec_0b58_4574_aac9_80802c79c65f.slice/crio-4f655d20d2d2c03629c0fadf1343c14032f214b11c25518543fd84375dd1ea36 WatchSource:0}: Error finding container 4f655d20d2d2c03629c0fadf1343c14032f214b11c25518543fd84375dd1ea36: Status 404 returned error can't find the container with id 4f655d20d2d2c03629c0fadf1343c14032f214b11c25518543fd84375dd1ea36
Jul 11 04:15:49.361780 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:49.361744    2576 generic.go:356] "Generic (PLEG): container finished" podID="a4a83cec-0b58-4574-aac9-80802c79c65f" containerID="853d52b6815fe7ddd76fcb9d463dd211794a0f7514807469f62c8fd11fdf967e" exitCode=0
Jul 11 04:15:49.362151 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:49.361829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w" event={"ID":"a4a83cec-0b58-4574-aac9-80802c79c65f","Type":"ContainerDied","Data":"853d52b6815fe7ddd76fcb9d463dd211794a0f7514807469f62c8fd11fdf967e"}
Jul 11 04:15:49.362151 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:49.361885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w" event={"ID":"a4a83cec-0b58-4574-aac9-80802c79c65f","Type":"ContainerStarted","Data":"4f655d20d2d2c03629c0fadf1343c14032f214b11c25518543fd84375dd1ea36"}
Jul 11 04:15:50.494636 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:50.494607    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w"
Jul 11 04:15:50.619986 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:50.619888    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4a83cec-0b58-4574-aac9-80802c79c65f-maas-api-service-ca\") pod \"a4a83cec-0b58-4574-aac9-80802c79c65f\" (UID: \"a4a83cec-0b58-4574-aac9-80802c79c65f\") "
Jul 11 04:15:50.620317 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:50.620292    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4a83cec-0b58-4574-aac9-80802c79c65f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4a83cec-0b58-4574-aac9-80802c79c65f" (UID: "a4a83cec-0b58-4574-aac9-80802c79c65f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:15:50.720927 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:50.720879    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4a83cec-0b58-4574-aac9-80802c79c65f-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:51.373586 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:51.373544    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w" event={"ID":"a4a83cec-0b58-4574-aac9-80802c79c65f","Type":"ContainerDied","Data":"4f655d20d2d2c03629c0fadf1343c14032f214b11c25518543fd84375dd1ea36"}
Jul 11 04:15:51.373586 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:51.373579    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w"
Jul 11 04:15:51.373586 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:51.373595    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f655d20d2d2c03629c0fadf1343c14032f214b11c25518543fd84375dd1ea36"
Jul 11 04:15:53.385838 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.385805    2576 generic.go:356] "Generic (PLEG): container finished" podID="8971291d-9100-4b48-91bd-45e469e81192" containerID="dcb3485d0b4a83ed89b64c1ea01ea6ea4850a37767eef224b2509b5b9951423f" exitCode=0
Jul 11 04:15:53.386262 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.385878    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" event={"ID":"8971291d-9100-4b48-91bd-45e469e81192","Type":"ContainerDied","Data":"dcb3485d0b4a83ed89b64c1ea01ea6ea4850a37767eef224b2509b5b9951423f"}
Jul 11 04:15:53.386262 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.385945    2576 scope.go:117] "RemoveContainer" containerID="dd32719d6bc94bd6625538ea3cc376fce8a23619ec895a29fcaa8ba380704b58"
Jul 11 04:15:53.477371 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.477348    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:15:53.547574 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.547545    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-credential-socket\") pod \"8971291d-9100-4b48-91bd-45e469e81192\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") "
Jul 11 04:15:53.547721 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.547597    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-data\") pod \"8971291d-9100-4b48-91bd-45e469e81192\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") "
Jul 11 04:15:53.547721 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.547618    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-envoy\") pod \"8971291d-9100-4b48-91bd-45e469e81192\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") "
Jul 11 04:15:53.547721 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.547637    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9cdh\" (UniqueName: \"kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-kube-api-access-w9cdh\") pod \"8971291d-9100-4b48-91bd-45e469e81192\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") "
Jul 11 04:15:53.547721 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.547660    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8971291d-9100-4b48-91bd-45e469e81192-istiod-ca-cert\") pod \"8971291d-9100-4b48-91bd-45e469e81192\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") "
Jul 11 04:15:53.547947 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.547828    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8971291d-9100-4b48-91bd-45e469e81192" (UID: "8971291d-9100-4b48-91bd-45e469e81192"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:15:53.548201 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.548180    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-credential-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:53.548351 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.548274    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8971291d-9100-4b48-91bd-45e469e81192-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8971291d-9100-4b48-91bd-45e469e81192" (UID: "8971291d-9100-4b48-91bd-45e469e81192"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:15:53.548574 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.548548    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-data" (OuterVolumeSpecName: "istio-data") pod "8971291d-9100-4b48-91bd-45e469e81192" (UID: "8971291d-9100-4b48-91bd-45e469e81192"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:15:53.549995 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.549955    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-kube-api-access-w9cdh" (OuterVolumeSpecName: "kube-api-access-w9cdh") pod "8971291d-9100-4b48-91bd-45e469e81192" (UID: "8971291d-9100-4b48-91bd-45e469e81192"). InnerVolumeSpecName "kube-api-access-w9cdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:15:53.550095 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.550042    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8971291d-9100-4b48-91bd-45e469e81192" (UID: "8971291d-9100-4b48-91bd-45e469e81192"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:15:53.649145 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649113    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-socket\") pod \"8971291d-9100-4b48-91bd-45e469e81192\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") "
Jul 11 04:15:53.649145 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649148    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-istio-token\") pod \"8971291d-9100-4b48-91bd-45e469e81192\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") "
Jul 11 04:15:53.649392 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649174    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-certs\") pod \"8971291d-9100-4b48-91bd-45e469e81192\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") "
Jul 11 04:15:53.649392 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649199    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8971291d-9100-4b48-91bd-45e469e81192-istio-podinfo\") pod \"8971291d-9100-4b48-91bd-45e469e81192\" (UID: \"8971291d-9100-4b48-91bd-45e469e81192\") "
Jul 11 04:15:53.649464 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649434    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8971291d-9100-4b48-91bd-45e469e81192" (UID: "8971291d-9100-4b48-91bd-45e469e81192"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:15:53.649498 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649453    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8971291d-9100-4b48-91bd-45e469e81192" (UID: "8971291d-9100-4b48-91bd-45e469e81192"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:15:53.649539 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649524    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-data\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:53.649539 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649536    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-istio-envoy\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:53.649607 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649546    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9cdh\" (UniqueName: \"kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-kube-api-access-w9cdh\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:53.649607 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649555    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8971291d-9100-4b48-91bd-45e469e81192-istiod-ca-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:53.649607 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649564    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:53.649607 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.649572    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8971291d-9100-4b48-91bd-45e469e81192-workload-certs\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:53.651470 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.651444    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8971291d-9100-4b48-91bd-45e469e81192-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8971291d-9100-4b48-91bd-45e469e81192" (UID: "8971291d-9100-4b48-91bd-45e469e81192"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:15:53.651579 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.651446    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-istio-token" (OuterVolumeSpecName: "istio-token") pod "8971291d-9100-4b48-91bd-45e469e81192" (UID: "8971291d-9100-4b48-91bd-45e469e81192"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:15:53.750127 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.750088    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8971291d-9100-4b48-91bd-45e469e81192-istio-token\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:53.750127 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.750119    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8971291d-9100-4b48-91bd-45e469e81192-istio-podinfo\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:53.926406 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.926299    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"]
Jul 11 04:15:53.945281 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.945237    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch"]
Jul 11 04:15:53.948187 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:53.948161    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-64b9bd32-29729055-95rch"]
Jul 11 04:15:54.393120 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.393078    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w" event={"ID":"8971291d-9100-4b48-91bd-45e469e81192","Type":"ContainerDied","Data":"384aa1ef09f9cf5a0d42a8ea05662362570aba448555c46f95c367f0b5238183"}
Jul 11 04:15:54.393669 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.393144    2576 scope.go:117] "RemoveContainer" containerID="dcb3485d0b4a83ed89b64c1ea01ea6ea4850a37767eef224b2509b5b9951423f"
Jul 11 04:15:54.393669 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.393103    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"
Jul 11 04:15:54.393669 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.393167    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn" podUID="c15a83d5-c2ca-4e4e-87ca-193641bc339c" containerName="maas-api" containerID="cri-o://2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5" gracePeriod=30
Jul 11 04:15:54.462981 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.462939    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"]
Jul 11 04:15:54.466198 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.466173    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-64b9bd32-gw-openshift-default-f9bd58599-hh99w"]
Jul 11 04:15:54.635495 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.635469    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:15:54.657564 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.657537    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m95bd\" (UniqueName: \"kubernetes.io/projected/c15a83d5-c2ca-4e4e-87ca-193641bc339c-kube-api-access-m95bd\") pod \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") "
Jul 11 04:15:54.657750 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.657734    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15a83d5-c2ca-4e4e-87ca-193641bc339c-maas-api-tls\") pod \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") "
Jul 11 04:15:54.657838 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.657770    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15a83d5-c2ca-4e4e-87ca-193641bc339c-openshift-service-ca\") pod \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\" (UID: \"c15a83d5-c2ca-4e4e-87ca-193641bc339c\") "
Jul 11 04:15:54.658193 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.658163    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c15a83d5-c2ca-4e4e-87ca-193641bc339c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c15a83d5-c2ca-4e4e-87ca-193641bc339c" (UID: "c15a83d5-c2ca-4e4e-87ca-193641bc339c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:15:54.659785 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.659749    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c15a83d5-c2ca-4e4e-87ca-193641bc339c-kube-api-access-m95bd" (OuterVolumeSpecName: "kube-api-access-m95bd") pod "c15a83d5-c2ca-4e4e-87ca-193641bc339c" (UID: "c15a83d5-c2ca-4e4e-87ca-193641bc339c"). InnerVolumeSpecName "kube-api-access-m95bd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:15:54.659900 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.659781    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c15a83d5-c2ca-4e4e-87ca-193641bc339c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c15a83d5-c2ca-4e4e-87ca-193641bc339c" (UID: "c15a83d5-c2ca-4e4e-87ca-193641bc339c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:15:54.758311 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.758265    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c15a83d5-c2ca-4e4e-87ca-193641bc339c-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:54.758311 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.758306    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15a83d5-c2ca-4e4e-87ca-193641bc339c-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:54.758311 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:54.758315    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m95bd\" (UniqueName: \"kubernetes.io/projected/c15a83d5-c2ca-4e4e-87ca-193641bc339c-kube-api-access-m95bd\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:15:55.400677 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.400643    2576 generic.go:356] "Generic (PLEG): container finished" podID="c15a83d5-c2ca-4e4e-87ca-193641bc339c" containerID="2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5" exitCode=0
Jul 11 04:15:55.401091 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.400685    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"
Jul 11 04:15:55.401091 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.400686    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn" event={"ID":"c15a83d5-c2ca-4e4e-87ca-193641bc339c","Type":"ContainerDied","Data":"2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5"}
Jul 11 04:15:55.401091 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.400819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn" event={"ID":"c15a83d5-c2ca-4e4e-87ca-193641bc339c","Type":"ContainerDied","Data":"16dd0a5a175bf23db612ab0fa6124848e9ef3e7b792b7045d4c177b35d3aa627"}
Jul 11 04:15:55.401091 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.400848    2576 scope.go:117] "RemoveContainer" containerID="2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5"
Jul 11 04:15:55.409712 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.409696    2576 scope.go:117] "RemoveContainer" containerID="2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5"
Jul 11 04:15:55.409936 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:15:55.409918    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5\": container with ID starting with 2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5 not found: ID does not exist" containerID="2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5"
Jul 11 04:15:55.410000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.409943    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5"} err="failed to get container status \"2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5\": rpc error: code = NotFound desc = could not find container \"2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5\": container with ID starting with 2dd3c63e0536316c1b956b20ec8c3ebea7a58dbd1d5541497a1b9b45686e88d5 not found: ID does not exist"
Jul 11 04:15:55.421397 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.421376    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"]
Jul 11 04:15:55.424451 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.424431    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-64b9bd32-84f87449b5-nwqfn"]
Jul 11 04:15:55.477503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.477474    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8971291d-9100-4b48-91bd-45e469e81192" path="/var/lib/kubelet/pods/8971291d-9100-4b48-91bd-45e469e81192/volumes"
Jul 11 04:15:55.477928 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.477908    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c15a83d5-c2ca-4e4e-87ca-193641bc339c" path="/var/lib/kubelet/pods/c15a83d5-c2ca-4e4e-87ca-193641bc339c/volumes"
Jul 11 04:15:55.478203 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:55.478186    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef1fb585-e353-46e2-98ed-672d5b4525a7" path="/var/lib/kubelet/pods/ef1fb585-e353-46e2-98ed-672d5b4525a7/volumes"
Jul 11 04:15:59.791413 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.791374    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"]
Jul 11 04:15:59.791888 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.791831    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c15a83d5-c2ca-4e4e-87ca-193641bc339c" containerName="maas-api"
Jul 11 04:15:59.791888 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.791851    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c15a83d5-c2ca-4e4e-87ca-193641bc339c" containerName="maas-api"
Jul 11 04:15:59.791888 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.791867    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a83cec-0b58-4574-aac9-80802c79c65f" containerName="revoke-keys"
Jul 11 04:15:59.791888 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.791876    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a83cec-0b58-4574-aac9-80802c79c65f" containerName="revoke-keys"
Jul 11 04:15:59.792101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.791893    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8971291d-9100-4b48-91bd-45e469e81192" containerName="istio-proxy"
Jul 11 04:15:59.792101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.791901    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8971291d-9100-4b48-91bd-45e469e81192" containerName="istio-proxy"
Jul 11 04:15:59.792101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.791913    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8971291d-9100-4b48-91bd-45e469e81192" containerName="istio-proxy"
Jul 11 04:15:59.792101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.791920    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8971291d-9100-4b48-91bd-45e469e81192" containerName="istio-proxy"
Jul 11 04:15:59.792101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.792014    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c15a83d5-c2ca-4e4e-87ca-193641bc339c" containerName="maas-api"
Jul 11 04:15:59.792101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.792025    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8971291d-9100-4b48-91bd-45e469e81192" containerName="istio-proxy"
Jul 11 04:15:59.792101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.792035    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8971291d-9100-4b48-91bd-45e469e81192" containerName="istio-proxy"
Jul 11 04:15:59.792101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.792043    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4a83cec-0b58-4574-aac9-80802c79c65f" containerName="revoke-keys"
Jul 11 04:15:59.792101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.792053    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8447d21-27c0-48e0-99e3-fd146e7251dd" containerName="revoke-keys"
Jul 11 04:15:59.796899 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.796866    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:15:59.799361 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.799314    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-587e746d-openshift-default-dockercfg-ltxds\""
Jul 11 04:15:59.806582 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.806560    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"]
Jul 11 04:15:59.902004 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.901970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-credential-socket\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:15:59.902162 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.902012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-podinfo\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:15:59.902162 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.902045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxhdd\" (UniqueName: \"kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-kube-api-access-bxhdd\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:15:59.902162 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.902095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-envoy\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:15:59.902162 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.902139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-token\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:15:59.902299 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.902191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-data\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:15:59.902299 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.902215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istiod-ca-cert\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:15:59.902299 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.902234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-socket\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:15:59.902299 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:15:59.902250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-certs\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.003338 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxhdd\" (UniqueName: \"kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-kube-api-access-bxhdd\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.003514 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-envoy\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.003514 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-token\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.003514 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003432    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-data\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.003514 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istiod-ca-cert\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.003749 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-socket\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.003749 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-certs\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.003749 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-credential-socket\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.003898 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003771    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-podinfo\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.003898 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003825    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-data\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.003968 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-socket\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.004018 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.003993    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-certs\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.004071 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.004046    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-credential-socket\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.004157 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.004141    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istiod-ca-cert\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.005573 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.005556    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-envoy\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.005963 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.005946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-podinfo\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.042768 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.042693    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-token\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.042892 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.042801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxhdd\" (UniqueName: \"kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-kube-api-access-bxhdd\") pod \"e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") " pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.109168 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.109130    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:00.243781 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.243758    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"]
Jul 11 04:16:00.245820 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:16:00.245793    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18def3a8_6ee9_42fd_b31b_5ff5aeeb44ce.slice/crio-adf3b6ce109a119a9d973c19abb57c6f22f56f25ec83f146b53b67801104c8bd WatchSource:0}: Error finding container adf3b6ce109a119a9d973c19abb57c6f22f56f25ec83f146b53b67801104c8bd: Status 404 returned error can't find the container with id adf3b6ce109a119a9d973c19abb57c6f22f56f25ec83f146b53b67801104c8bd
Jul 11 04:16:00.247841 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.247805    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:16:00.247939 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.247886    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:16:00.247939 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.247915    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:16:00.431781 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.431744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" event={"ID":"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce","Type":"ContainerStarted","Data":"5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c"}
Jul 11 04:16:00.432002 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.431807    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" event={"ID":"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce","Type":"ContainerStarted","Data":"adf3b6ce109a119a9d973c19abb57c6f22f56f25ec83f146b53b67801104c8bd"}
Jul 11 04:16:00.452314 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:00.452263    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" podStartSLOduration=1.452247146 podStartE2EDuration="1.452247146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:15:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:16:00.449393546 +0000 UTC m=+1633.634546003" watchObservedRunningTime="2026-07-11 04:16:00.452247146 +0000 UTC m=+1633.637399600"
Jul 11 04:16:01.006895 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.006853    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"]
Jul 11 04:16:01.010371 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.010345    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:01.012519 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.012496    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-587e746d-serving-cert\""
Jul 11 04:16:01.012635 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.012502    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-drsms\""
Jul 11 04:16:01.020948 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.020816    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"]
Jul 11 04:16:01.109406 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.109371    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:01.111148 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.111123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed595962-0e9e-4cf5-bb82-35262d650f3a-maas-api-tls\") pod \"maas-api-e2e-ait-587e746d-78cc65d894-zxkhl\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:01.111280 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.111159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g25pz\" (UniqueName: \"kubernetes.io/projected/ed595962-0e9e-4cf5-bb82-35262d650f3a-kube-api-access-g25pz\") pod \"maas-api-e2e-ait-587e746d-78cc65d894-zxkhl\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:01.111280 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.111186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed595962-0e9e-4cf5-bb82-35262d650f3a-openshift-service-ca\") pod \"maas-api-e2e-ait-587e746d-78cc65d894-zxkhl\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:01.114293 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.114272    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:01.212118 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.212078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed595962-0e9e-4cf5-bb82-35262d650f3a-maas-api-tls\") pod \"maas-api-e2e-ait-587e746d-78cc65d894-zxkhl\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:01.212296 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.212123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g25pz\" (UniqueName: \"kubernetes.io/projected/ed595962-0e9e-4cf5-bb82-35262d650f3a-kube-api-access-g25pz\") pod \"maas-api-e2e-ait-587e746d-78cc65d894-zxkhl\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:01.212296 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:16:01.212222    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-serving-cert: secret "maas-api-e2e-ait-587e746d-serving-cert" not found
Jul 11 04:16:01.212296 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.212258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed595962-0e9e-4cf5-bb82-35262d650f3a-openshift-service-ca\") pod \"maas-api-e2e-ait-587e746d-78cc65d894-zxkhl\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:01.212502 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:16:01.212300    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed595962-0e9e-4cf5-bb82-35262d650f3a-maas-api-tls podName:ed595962-0e9e-4cf5-bb82-35262d650f3a nodeName:}" failed. No retries permitted until 2026-07-11 04:16:01.712275485 +0000 UTC m=+1634.897427935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed595962-0e9e-4cf5-bb82-35262d650f3a-maas-api-tls") pod "maas-api-e2e-ait-587e746d-78cc65d894-zxkhl" (UID: "ed595962-0e9e-4cf5-bb82-35262d650f3a") : secret "maas-api-e2e-ait-587e746d-serving-cert" not found
Jul 11 04:16:01.213136 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.213107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed595962-0e9e-4cf5-bb82-35262d650f3a-openshift-service-ca\") pod \"maas-api-e2e-ait-587e746d-78cc65d894-zxkhl\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:01.223227 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.223204    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g25pz\" (UniqueName: \"kubernetes.io/projected/ed595962-0e9e-4cf5-bb82-35262d650f3a-kube-api-access-g25pz\") pod \"maas-api-e2e-ait-587e746d-78cc65d894-zxkhl\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:01.437576 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.437544    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:01.438424 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.438401    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:01.717728 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.717629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed595962-0e9e-4cf5-bb82-35262d650f3a-maas-api-tls\") pod \"maas-api-e2e-ait-587e746d-78cc65d894-zxkhl\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:01.720101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.720066    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed595962-0e9e-4cf5-bb82-35262d650f3a-maas-api-tls\") pod \"maas-api-e2e-ait-587e746d-78cc65d894-zxkhl\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:01.925082 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:01.925051    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:02.059164 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:02.059077    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"]
Jul 11 04:16:02.061650 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:16:02.061619    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded595962_0e9e_4cf5_bb82_35262d650f3a.slice/crio-495bfec3381f7c0ee50719a31cd977d96a6327236cda3178d16884df81fe9252 WatchSource:0}: Error finding container 495bfec3381f7c0ee50719a31cd977d96a6327236cda3178d16884df81fe9252: Status 404 returned error can't find the container with id 495bfec3381f7c0ee50719a31cd977d96a6327236cda3178d16884df81fe9252
Jul 11 04:16:02.443979 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:02.443940    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl" event={"ID":"ed595962-0e9e-4cf5-bb82-35262d650f3a","Type":"ContainerStarted","Data":"495bfec3381f7c0ee50719a31cd977d96a6327236cda3178d16884df81fe9252"}
Jul 11 04:16:03.450511 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:03.450467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl" event={"ID":"ed595962-0e9e-4cf5-bb82-35262d650f3a","Type":"ContainerStarted","Data":"d6653ac84033cbfb7664fcf570696ef9714651af845b593478c49462572b16f8"}
Jul 11 04:16:03.450997 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:03.450678    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:03.465925 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:03.465869    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl" podStartSLOduration=3.017451607 podStartE2EDuration="3.465850979s" totalImagesPullingTime="448.399372ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:16:03.464942962 +0000 UTC m=+1636.650095419" watchObservedRunningTime="2026-07-11 04:16:03.465850979 +0000 UTC m=+1636.651003448"
Jul 11 04:16:06.036633 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:06.036596    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"]
Jul 11 04:16:06.040384 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:06.040365    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"
Jul 11 04:16:06.042787 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:06.042759    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:16:06.046588 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:06.046562    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"]
Jul 11 04:16:06.168867 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:06.168806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92154fa5-ceea-4334-860d-675f272a2a4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-587e746d-lvz7m\" (UID: \"92154fa5-ceea-4334-860d-675f272a2a4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"
Jul 11 04:16:06.270876 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:06.270833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92154fa5-ceea-4334-860d-675f272a2a4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-587e746d-lvz7m\" (UID: \"92154fa5-ceea-4334-860d-675f272a2a4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"
Jul 11 04:16:06.271735 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:06.271703    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92154fa5-ceea-4334-860d-675f272a2a4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-587e746d-lvz7m\" (UID: \"92154fa5-ceea-4334-860d-675f272a2a4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"
Jul 11 04:16:06.352020 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:06.351924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"
Jul 11 04:16:06.528108 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:06.528076    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"]
Jul 11 04:16:06.529256 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:16:06.529226    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92154fa5_ceea_4334_860d_675f272a2a4f.slice/crio-c1129e282a316a99da36e7a65a53bfd6f4ab72db5e433cb302b2984362258ce6 WatchSource:0}: Error finding container c1129e282a316a99da36e7a65a53bfd6f4ab72db5e433cb302b2984362258ce6: Status 404 returned error can't find the container with id c1129e282a316a99da36e7a65a53bfd6f4ab72db5e433cb302b2984362258ce6
Jul 11 04:16:07.486150 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:07.486128    2576 scope.go:117] "RemoveContainer" containerID="8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df"
Jul 11 04:16:07.486150 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:07.486140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m" event={"ID":"92154fa5-ceea-4334-860d-675f272a2a4f","Type":"ContainerStarted","Data":"8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df"}
Jul 11 04:16:07.486573 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:07.486170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m" event={"ID":"92154fa5-ceea-4334-860d-675f272a2a4f","Type":"ContainerStarted","Data":"c1129e282a316a99da36e7a65a53bfd6f4ab72db5e433cb302b2984362258ce6"}
Jul 11 04:16:08.492907 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:08.492876    2576 generic.go:356] "Generic (PLEG): container finished" podID="92154fa5-ceea-4334-860d-675f272a2a4f" containerID="8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df" exitCode=7
Jul 11 04:16:08.492907 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:08.492903    2576 generic.go:356] "Generic (PLEG): container finished" podID="92154fa5-ceea-4334-860d-675f272a2a4f" containerID="15e6f7d5061666b4775212d3f8fba0229d1272f0f6188be9410c508877f5a359" exitCode=7
Jul 11 04:16:08.493297 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:08.492953    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m" event={"ID":"92154fa5-ceea-4334-860d-675f272a2a4f","Type":"ContainerDied","Data":"8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df"}
Jul 11 04:16:08.493297 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:08.493027    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m" event={"ID":"92154fa5-ceea-4334-860d-675f272a2a4f","Type":"ContainerDied","Data":"15e6f7d5061666b4775212d3f8fba0229d1272f0f6188be9410c508877f5a359"}
Jul 11 04:16:08.493297 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:08.493050    2576 scope.go:117] "RemoveContainer" containerID="8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df"
Jul 11 04:16:08.493297 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:08.493289    2576 scope.go:117] "RemoveContainer" containerID="15e6f7d5061666b4775212d3f8fba0229d1272f0f6188be9410c508877f5a359"
Jul 11 04:16:08.493536 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:16:08.493517    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-587e746d-lvz7m_odh-ai-gateway-infra(92154fa5-ceea-4334-860d-675f272a2a4f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m" podUID="92154fa5-ceea-4334-860d-675f272a2a4f"
Jul 11 04:16:08.525697 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:08.525680    2576 scope.go:117] "RemoveContainer" containerID="8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df"
Jul 11 04:16:08.525992 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:16:08.525972    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df\": container with ID starting with 8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df not found: ID does not exist" containerID="8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df"
Jul 11 04:16:08.526056 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:08.526003    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df"} err="failed to get container status \"8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df\": rpc error: code = NotFound desc = could not find container \"8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df\": container with ID starting with 8bcd17004e7092e01662ec9173b5663d3027fe329aa556de482bd8acab2e36df not found: ID does not exist"
Jul 11 04:16:09.469636 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:09.469597    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:16:09.501069 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:09.501038    2576 scope.go:117] "RemoveContainer" containerID="15e6f7d5061666b4775212d3f8fba0229d1272f0f6188be9410c508877f5a359"
Jul 11 04:16:09.501522 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:16:09.501257    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-587e746d-lvz7m_odh-ai-gateway-infra(92154fa5-ceea-4334-860d-675f272a2a4f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m" podUID="92154fa5-ceea-4334-860d-675f272a2a4f"
Jul 11 04:16:12.519116 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:12.519084    2576 generic.go:356] "Generic (PLEG): container finished" podID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerID="5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c" exitCode=0
Jul 11 04:16:12.519516 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:12.519162    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" event={"ID":"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce","Type":"ContainerDied","Data":"5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c"}
Jul 11 04:16:12.519616 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:12.519602    2576 scope.go:117] "RemoveContainer" containerID="5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c"
Jul 11 04:16:12.520684 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:12.520658    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:16:12.520753 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:12.520728    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:16:12.520797 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:12.520760    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:16:13.527278 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:13.527240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" event={"ID":"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce","Type":"ContainerStarted","Data":"a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9"}
Jul 11 04:16:14.109379 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:14.109344    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:14.110191 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:14.110171    2576 patch_prober.go:28] interesting pod/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 11 04:16:14.110288 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:14.110224    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 11 04:16:15.110493 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:15.110461    2576 patch_prober.go:28] interesting pod/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 11 04:16:15.110921 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:15.110518    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 11 04:16:16.109850 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:16.109813    2576 patch_prober.go:28] interesting pod/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 11 04:16:16.110025 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:16.109870    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 11 04:16:16.437690 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:16.437597    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:17.109833 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:17.109782    2576 patch_prober.go:28] interesting pod/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 11 04:16:17.110044 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:17.109842    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 11 04:16:18.114153 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:18.114125    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:18.115267 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:18.115243    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:16:23.471526 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:23.471492    2576 scope.go:117] "RemoveContainer" containerID="15e6f7d5061666b4775212d3f8fba0229d1272f0f6188be9410c508877f5a359"
Jul 11 04:16:24.586407 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:24.586371    2576 generic.go:356] "Generic (PLEG): container finished" podID="92154fa5-ceea-4334-860d-675f272a2a4f" containerID="00c24bb671cf154bc78fdd63f7ea739894f72ab814a9087d17d2db5ebf2d8641" exitCode=0
Jul 11 04:16:24.586823 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:24.586446    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m" event={"ID":"92154fa5-ceea-4334-860d-675f272a2a4f","Type":"ContainerDied","Data":"00c24bb671cf154bc78fdd63f7ea739894f72ab814a9087d17d2db5ebf2d8641"}
Jul 11 04:16:24.586823 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:24.586506    2576 scope.go:117] "RemoveContainer" containerID="15e6f7d5061666b4775212d3f8fba0229d1272f0f6188be9410c508877f5a359"
Jul 11 04:16:25.608669 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:25.608640    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"]
Jul 11 04:16:25.729275 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:25.729249    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"
Jul 11 04:16:25.868002 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:25.867907    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92154fa5-ceea-4334-860d-675f272a2a4f-maas-api-service-ca\") pod \"92154fa5-ceea-4334-860d-675f272a2a4f\" (UID: \"92154fa5-ceea-4334-860d-675f272a2a4f\") "
Jul 11 04:16:25.868308 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:25.868283    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92154fa5-ceea-4334-860d-675f272a2a4f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92154fa5-ceea-4334-860d-675f272a2a4f" (UID: "92154fa5-ceea-4334-860d-675f272a2a4f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:16:25.969278 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:25.969230    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92154fa5-ceea-4334-860d-675f272a2a4f-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:16:26.601386 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:26.601356    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"
Jul 11 04:16:26.601578 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:26.601356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m" event={"ID":"92154fa5-ceea-4334-860d-675f272a2a4f","Type":"ContainerDied","Data":"c1129e282a316a99da36e7a65a53bfd6f4ab72db5e433cb302b2984362258ce6"}
Jul 11 04:16:26.601578 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:26.601489    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1129e282a316a99da36e7a65a53bfd6f4ab72db5e433cb302b2984362258ce6"
Jul 11 04:16:26.632104 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:26.632074    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"]
Jul 11 04:16:26.634350 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:26.634313    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-lvz7m"]
Jul 11 04:16:27.477521 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:16:27.477481    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92154fa5-ceea-4334-860d-675f272a2a4f" path="/var/lib/kubelet/pods/92154fa5-ceea-4334-860d-675f272a2a4f/volumes"
Jul 11 04:17:06.081989 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.081958    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8"]
Jul 11 04:17:06.082385 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.082288    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92154fa5-ceea-4334-860d-675f272a2a4f" containerName="revoke-keys"
Jul 11 04:17:06.082385 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.082299    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="92154fa5-ceea-4334-860d-675f272a2a4f" containerName="revoke-keys"
Jul 11 04:17:06.082385 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.082312    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92154fa5-ceea-4334-860d-675f272a2a4f" containerName="revoke-keys"
Jul 11 04:17:06.082385 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.082318    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="92154fa5-ceea-4334-860d-675f272a2a4f" containerName="revoke-keys"
Jul 11 04:17:06.082385 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.082340    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92154fa5-ceea-4334-860d-675f272a2a4f" containerName="revoke-keys"
Jul 11 04:17:06.082385 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.082345    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="92154fa5-ceea-4334-860d-675f272a2a4f" containerName="revoke-keys"
Jul 11 04:17:06.082585 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.082407    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="92154fa5-ceea-4334-860d-675f272a2a4f" containerName="revoke-keys"
Jul 11 04:17:06.082585 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.082416    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="92154fa5-ceea-4334-860d-675f272a2a4f" containerName="revoke-keys"
Jul 11 04:17:06.085504 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.085487    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8"
Jul 11 04:17:06.087795 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.087771    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:17:06.092318 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.092296    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8"]
Jul 11 04:17:06.212816 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.212779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f472cd-cb1c-41e9-b418-2ac3c424dece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-587e746d-ftps8\" (UID: \"45f472cd-cb1c-41e9-b418-2ac3c424dece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8"
Jul 11 04:17:06.314062 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.314018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f472cd-cb1c-41e9-b418-2ac3c424dece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-587e746d-ftps8\" (UID: \"45f472cd-cb1c-41e9-b418-2ac3c424dece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8"
Jul 11 04:17:06.314629 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.314612    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f472cd-cb1c-41e9-b418-2ac3c424dece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-587e746d-ftps8\" (UID: \"45f472cd-cb1c-41e9-b418-2ac3c424dece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8"
Jul 11 04:17:06.398804 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.398714    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8"
Jul 11 04:17:06.525482 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.525454    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8"]
Jul 11 04:17:06.527149 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:17:06.527120    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f472cd_cb1c_41e9_b418_2ac3c424dece.slice/crio-fe86a717347da3a865c7be7bb6881729515ae6fef6d03862f63c970b1bcf58c0 WatchSource:0}: Error finding container fe86a717347da3a865c7be7bb6881729515ae6fef6d03862f63c970b1bcf58c0: Status 404 returned error can't find the container with id fe86a717347da3a865c7be7bb6881729515ae6fef6d03862f63c970b1bcf58c0
Jul 11 04:17:06.823545 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:06.823511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8" event={"ID":"45f472cd-cb1c-41e9-b418-2ac3c424dece","Type":"ContainerStarted","Data":"fe86a717347da3a865c7be7bb6881729515ae6fef6d03862f63c970b1bcf58c0"}
Jul 11 04:17:07.830497 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:07.830467    2576 generic.go:356] "Generic (PLEG): container finished" podID="45f472cd-cb1c-41e9-b418-2ac3c424dece" containerID="207c9aba2e1f7392317152e38dbe4882632a06f907eb381abbe6c29f3ac5ac95" exitCode=0
Jul 11 04:17:07.830874 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:07.830528    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8" event={"ID":"45f472cd-cb1c-41e9-b418-2ac3c424dece","Type":"ContainerDied","Data":"207c9aba2e1f7392317152e38dbe4882632a06f907eb381abbe6c29f3ac5ac95"}
Jul 11 04:17:08.974099 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:08.974075    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8"
Jul 11 04:17:09.137206 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:09.137126    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f472cd-cb1c-41e9-b418-2ac3c424dece-maas-api-service-ca\") pod \"45f472cd-cb1c-41e9-b418-2ac3c424dece\" (UID: \"45f472cd-cb1c-41e9-b418-2ac3c424dece\") "
Jul 11 04:17:09.137491 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:09.137470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f472cd-cb1c-41e9-b418-2ac3c424dece-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "45f472cd-cb1c-41e9-b418-2ac3c424dece" (UID: "45f472cd-cb1c-41e9-b418-2ac3c424dece"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:17:09.238006 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:09.237977    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f472cd-cb1c-41e9-b418-2ac3c424dece-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:09.841678 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:09.841653    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8"
Jul 11 04:17:09.841861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:09.841648    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-587e746d-ftps8" event={"ID":"45f472cd-cb1c-41e9-b418-2ac3c424dece","Type":"ContainerDied","Data":"fe86a717347da3a865c7be7bb6881729515ae6fef6d03862f63c970b1bcf58c0"}
Jul 11 04:17:09.841861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:09.841780    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe86a717347da3a865c7be7bb6881729515ae6fef6d03862f63c970b1bcf58c0"
Jul 11 04:17:16.636530 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:16.636494    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"]
Jul 11 04:17:16.637007 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:16.636727    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl" podUID="ed595962-0e9e-4cf5-bb82-35262d650f3a" containerName="maas-api" containerID="cri-o://d6653ac84033cbfb7664fcf570696ef9714651af845b593478c49462572b16f8" gracePeriod=30
Jul 11 04:17:16.880573 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:16.880542    2576 generic.go:356] "Generic (PLEG): container finished" podID="ed595962-0e9e-4cf5-bb82-35262d650f3a" containerID="d6653ac84033cbfb7664fcf570696ef9714651af845b593478c49462572b16f8" exitCode=0
Jul 11 04:17:16.880696 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:16.880610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl" event={"ID":"ed595962-0e9e-4cf5-bb82-35262d650f3a","Type":"ContainerDied","Data":"d6653ac84033cbfb7664fcf570696ef9714651af845b593478c49462572b16f8"}
Jul 11 04:17:16.880696 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:16.880684    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl" event={"ID":"ed595962-0e9e-4cf5-bb82-35262d650f3a","Type":"ContainerDied","Data":"495bfec3381f7c0ee50719a31cd977d96a6327236cda3178d16884df81fe9252"}
Jul 11 04:17:16.880781 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:16.880701    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="495bfec3381f7c0ee50719a31cd977d96a6327236cda3178d16884df81fe9252"
Jul 11 04:17:16.881245 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:16.881222    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:17:17.005126 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.005043    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed595962-0e9e-4cf5-bb82-35262d650f3a-maas-api-tls\") pod \"ed595962-0e9e-4cf5-bb82-35262d650f3a\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") "
Jul 11 04:17:17.005126 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.005077    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed595962-0e9e-4cf5-bb82-35262d650f3a-openshift-service-ca\") pod \"ed595962-0e9e-4cf5-bb82-35262d650f3a\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") "
Jul 11 04:17:17.005465 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.005132    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g25pz\" (UniqueName: \"kubernetes.io/projected/ed595962-0e9e-4cf5-bb82-35262d650f3a-kube-api-access-g25pz\") pod \"ed595962-0e9e-4cf5-bb82-35262d650f3a\" (UID: \"ed595962-0e9e-4cf5-bb82-35262d650f3a\") "
Jul 11 04:17:17.005577 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.005552    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed595962-0e9e-4cf5-bb82-35262d650f3a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed595962-0e9e-4cf5-bb82-35262d650f3a" (UID: "ed595962-0e9e-4cf5-bb82-35262d650f3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:17:17.007177 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.007147    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed595962-0e9e-4cf5-bb82-35262d650f3a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed595962-0e9e-4cf5-bb82-35262d650f3a" (UID: "ed595962-0e9e-4cf5-bb82-35262d650f3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:17:17.007177 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.007169    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed595962-0e9e-4cf5-bb82-35262d650f3a-kube-api-access-g25pz" (OuterVolumeSpecName: "kube-api-access-g25pz") pod "ed595962-0e9e-4cf5-bb82-35262d650f3a" (UID: "ed595962-0e9e-4cf5-bb82-35262d650f3a"). InnerVolumeSpecName "kube-api-access-g25pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:17:17.105920 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.105888    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed595962-0e9e-4cf5-bb82-35262d650f3a-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:17.105920 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.105916    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed595962-0e9e-4cf5-bb82-35262d650f3a-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:17.105920 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.105926    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g25pz\" (UniqueName: \"kubernetes.io/projected/ed595962-0e9e-4cf5-bb82-35262d650f3a-kube-api-access-g25pz\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:17.885903 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.885871    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"
Jul 11 04:17:17.901022 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.900995    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"]
Jul 11 04:17:17.903935 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:17.903915    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-587e746d-78cc65d894-zxkhl"]
Jul 11 04:17:19.476948 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:19.476917    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed595962-0e9e-4cf5-bb82-35262d650f3a" path="/var/lib/kubelet/pods/ed595962-0e9e-4cf5-bb82-35262d650f3a/volumes"
Jul 11 04:17:32.141615 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.141582    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"]
Jul 11 04:17:32.142004 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.141781    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy" containerID="cri-o://a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9" gracePeriod=30
Jul 11 04:17:32.417379 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.417279    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"]
Jul 11 04:17:32.417650 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.417636    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f472cd-cb1c-41e9-b418-2ac3c424dece" containerName="revoke-keys"
Jul 11 04:17:32.417715 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.417652    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f472cd-cb1c-41e9-b418-2ac3c424dece" containerName="revoke-keys"
Jul 11 04:17:32.417715 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.417675    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed595962-0e9e-4cf5-bb82-35262d650f3a" containerName="maas-api"
Jul 11 04:17:32.417715 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.417682    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed595962-0e9e-4cf5-bb82-35262d650f3a" containerName="maas-api"
Jul 11 04:17:32.417874 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.417744    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="92154fa5-ceea-4334-860d-675f272a2a4f" containerName="revoke-keys"
Jul 11 04:17:32.417874 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.417753    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed595962-0e9e-4cf5-bb82-35262d650f3a" containerName="maas-api"
Jul 11 04:17:32.417874 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.417759    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="45f472cd-cb1c-41e9-b418-2ac3c424dece" containerName="revoke-keys"
Jul 11 04:17:32.420846 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.420824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.423123 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.423101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ca663575-openshift-default-dockercfg-rtvbk\""
Jul 11 04:17:32.430283 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.430260    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"]
Jul 11 04:17:32.436274 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.436253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-envoy\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.436387 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.436320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-token\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.436439 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.436379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-credential-socket\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.436439 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.436407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-socket\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.436439 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.436428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-data\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.436568 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.436444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-podinfo\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.436568 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.436472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz8fc\" (UniqueName: \"kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-kube-api-access-hz8fc\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.436568 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.436547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-certs\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.436693 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.436576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2800864a-19a8-41ee-80ed-a54d71ed552d-istiod-ca-cert\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537440 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-token\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537622 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-credential-socket\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537622 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-socket\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537622 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-data\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537622 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-podinfo\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537622 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz8fc\" (UniqueName: \"kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-kube-api-access-hz8fc\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537622 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-certs\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537622 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2800864a-19a8-41ee-80ed-a54d71ed552d-istiod-ca-cert\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537987 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-envoy\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537987 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-credential-socket\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537987 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-socket\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.537987 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.537937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-data\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.538205 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.538038    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-certs\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.538460 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.538440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2800864a-19a8-41ee-80ed-a54d71ed552d-istiod-ca-cert\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.539866 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.539842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-envoy\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.539969 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.539914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-podinfo\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.544697 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.544673    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-token\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.545285 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.545263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz8fc\" (UniqueName: \"kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-kube-api-access-hz8fc\") pod \"e2e-derive-ca663575-openshift-default-999895f5-pscw9\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") " pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.732493 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.732412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:32.859335 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.859299    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"]
Jul 11 04:17:32.861004 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:17:32.860968    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2800864a_19a8_41ee_80ed_a54d71ed552d.slice/crio-a691d025508485c76b1c1326cae0b7b2d8344e92c453954d5c14ac254817b394 WatchSource:0}: Error finding container a691d025508485c76b1c1326cae0b7b2d8344e92c453954d5c14ac254817b394: Status 404 returned error can't find the container with id a691d025508485c76b1c1326cae0b7b2d8344e92c453954d5c14ac254817b394
Jul 11 04:17:32.863148 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.863118    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:17:32.863221 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.863179    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:17:32.863221 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.863213    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:17:32.972916 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.972880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" event={"ID":"2800864a-19a8-41ee-80ed-a54d71ed552d","Type":"ContainerStarted","Data":"7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c"}
Jul 11 04:17:32.973099 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.972940    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" event={"ID":"2800864a-19a8-41ee-80ed-a54d71ed552d","Type":"ContainerStarted","Data":"a691d025508485c76b1c1326cae0b7b2d8344e92c453954d5c14ac254817b394"}
Jul 11 04:17:32.992366 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:32.992261    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" podStartSLOduration=0.992239903 podStartE2EDuration="992.239903ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:17:32.990214646 +0000 UTC m=+1726.175367104" watchObservedRunningTime="2026-07-11 04:17:32.992239903 +0000 UTC m=+1726.177392359"
Jul 11 04:17:33.117034 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.116993    2576 patch_prober.go:28] interesting pod/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 04:17:33.117221 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.117060    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 04:17:33.623422 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.623387    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"]
Jul 11 04:17:33.627239 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.627097    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:33.629234 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.629211    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ca663575-serving-cert\""
Jul 11 04:17:33.629398 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.629219    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-drsms\""
Jul 11 04:17:33.637352 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.637288    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"]
Jul 11 04:17:33.646893 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.646861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/391c5b05-64f3-43d3-a798-a54966d7f7e2-maas-api-tls\") pod \"maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:33.646893 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.646892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/391c5b05-64f3-43d3-a798-a54966d7f7e2-openshift-service-ca\") pod \"maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:33.647082 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.646914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m8jj\" (UniqueName: \"kubernetes.io/projected/391c5b05-64f3-43d3-a798-a54966d7f7e2-kube-api-access-5m8jj\") pod \"maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:33.733110 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.733072    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:33.737896 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.737869    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:33.747501 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.747479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/391c5b05-64f3-43d3-a798-a54966d7f7e2-maas-api-tls\") pod \"maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:33.747621 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.747506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/391c5b05-64f3-43d3-a798-a54966d7f7e2-openshift-service-ca\") pod \"maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:33.747621 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.747527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8jj\" (UniqueName: \"kubernetes.io/projected/391c5b05-64f3-43d3-a798-a54966d7f7e2-kube-api-access-5m8jj\") pod \"maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:33.748155 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.748135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/391c5b05-64f3-43d3-a798-a54966d7f7e2-openshift-service-ca\") pod \"maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:33.749853 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.749831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/391c5b05-64f3-43d3-a798-a54966d7f7e2-maas-api-tls\") pod \"maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:33.755601 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.755577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m8jj\" (UniqueName: \"kubernetes.io/projected/391c5b05-64f3-43d3-a798-a54966d7f7e2-kube-api-access-5m8jj\") pod \"maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:33.941286 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.941194    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:33.979486 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.979457    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:33.980414 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:33.980395    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:34.084032 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:34.084009    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"]
Jul 11 04:17:34.085499 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:17:34.085471    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod391c5b05_64f3_43d3_a798_a54966d7f7e2.slice/crio-cadebe14dfda0950e396d202d3ec48867d132376c2204c04e7ff4e824fb5de22 WatchSource:0}: Error finding container cadebe14dfda0950e396d202d3ec48867d132376c2204c04e7ff4e824fb5de22: Status 404 returned error can't find the container with id cadebe14dfda0950e396d202d3ec48867d132376c2204c04e7ff4e824fb5de22
Jul 11 04:17:34.985967 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:34.985929    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq" event={"ID":"391c5b05-64f3-43d3-a798-a54966d7f7e2","Type":"ContainerStarted","Data":"2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c"}
Jul 11 04:17:34.986371 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:34.986153    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:34.986371 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:34.986198    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq" event={"ID":"391c5b05-64f3-43d3-a798-a54966d7f7e2","Type":"ContainerStarted","Data":"cadebe14dfda0950e396d202d3ec48867d132376c2204c04e7ff4e824fb5de22"}
Jul 11 04:17:35.001861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:35.001818    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq" podStartSLOduration=1.62634124 podStartE2EDuration="2.001804463s" totalImagesPullingTime="375.463223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:17:35.001543301 +0000 UTC m=+1728.186695761" watchObservedRunningTime="2026-07-11 04:17:35.001804463 +0000 UTC m=+1728.186956918"
Jul 11 04:17:37.424773 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.424748    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:17:37.483704 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.482680    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-data\") pod \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") "
Jul 11 04:17:37.483704 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.482726    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istiod-ca-cert\") pod \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") "
Jul 11 04:17:37.483704 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.482775    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-envoy\") pod \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") "
Jul 11 04:17:37.483704 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.482809    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-token\") pod \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") "
Jul 11 04:17:37.483704 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.482855    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-credential-socket\") pod \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") "
Jul 11 04:17:37.483704 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.482883    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-podinfo\") pod \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") "
Jul 11 04:17:37.483704 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.482923    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-socket\") pod \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") "
Jul 11 04:17:37.483704 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.482966    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxhdd\" (UniqueName: \"kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-kube-api-access-bxhdd\") pod \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") "
Jul 11 04:17:37.483704 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.483027    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-certs\") pod \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\" (UID: \"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce\") "
Jul 11 04:17:37.483704 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.483624    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" (UID: "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:17:37.487491 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.485718    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" (UID: "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:17:37.487491 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.486675    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" (UID: "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:17:37.487491 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.487389    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" (UID: "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:17:37.488473 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.488451    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" (UID: "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:17:37.488858 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.488840    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" (UID: "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:17:37.491359 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.491180    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" (UID: "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:17:37.492212 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.492186    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" (UID: "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:17:37.492380 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.492278    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-kube-api-access-bxhdd" (OuterVolumeSpecName: "kube-api-access-bxhdd") pod "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" (UID: "18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce"). InnerVolumeSpecName "kube-api-access-bxhdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:17:37.584020 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.583980    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-credential-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:37.584020 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.584013    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-podinfo\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:37.584020 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.584023    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:37.584266 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.584034    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxhdd\" (UniqueName: \"kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-kube-api-access-bxhdd\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:37.584266 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.584047    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-workload-certs\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:37.584266 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.584059    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-data\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:37.584266 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.584067    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istiod-ca-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:37.584266 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.584075    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-envoy\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:37.584266 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.584084    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce-istio-token\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:37.956728 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.956689    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"]
Jul 11 04:17:37.957222 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.957200    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy"
Jul 11 04:17:37.957347 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.957224    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy"
Jul 11 04:17:37.957347 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.957248    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy"
Jul 11 04:17:37.957347 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.957257    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy"
Jul 11 04:17:37.957509 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.957365    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy"
Jul 11 04:17:37.957509 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.957382    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerName="istio-proxy"
Jul 11 04:17:37.961992 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.961964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"
Jul 11 04:17:37.964582 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.964555    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:17:37.965634 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.965606    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"]
Jul 11 04:17:37.988727 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:37.988686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c547dc45-d08a-4566-9cda-71a63fb5c109-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ca663575-mh2q7\" (UID: \"c547dc45-d08a-4566-9cda-71a63fb5c109\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"
Jul 11 04:17:38.004402 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.004367    2576 generic.go:356] "Generic (PLEG): container finished" podID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" containerID="a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9" exitCode=0
Jul 11 04:17:38.004655 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.004415    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"
Jul 11 04:17:38.004655 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.004444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" event={"ID":"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce","Type":"ContainerDied","Data":"a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9"}
Jul 11 04:17:38.004655 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.004508    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn" event={"ID":"18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce","Type":"ContainerDied","Data":"adf3b6ce109a119a9d973c19abb57c6f22f56f25ec83f146b53b67801104c8bd"}
Jul 11 04:17:38.004655 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.004532    2576 scope.go:117] "RemoveContainer" containerID="a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9"
Jul 11 04:17:38.014411 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.014396    2576 scope.go:117] "RemoveContainer" containerID="5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c"
Jul 11 04:17:38.022297 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.022280    2576 scope.go:117] "RemoveContainer" containerID="a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9"
Jul 11 04:17:38.022554 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:17:38.022537    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9\": container with ID starting with a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9 not found: ID does not exist" containerID="a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9"
Jul 11 04:17:38.022610 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.022562    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9"} err="failed to get container status \"a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9\": rpc error: code = NotFound desc = could not find container \"a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9\": container with ID starting with a7515a9cdc3b660a14051f8eaf6cccc3ea208641ba63cbcf21fa2a3f072174d9 not found: ID does not exist"
Jul 11 04:17:38.022610 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.022576    2576 scope.go:117] "RemoveContainer" containerID="5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c"
Jul 11 04:17:38.022818 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:17:38.022801    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c\": container with ID starting with 5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c not found: ID does not exist" containerID="5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c"
Jul 11 04:17:38.022861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.022824    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c"} err="failed to get container status \"5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c\": rpc error: code = NotFound desc = could not find container \"5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c\": container with ID starting with 5f8e9b838e2972cfd017d5332e016605bd323863916fbbb585d1d58d24f4612c not found: ID does not exist"
Jul 11 04:17:38.026139 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.026117    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"]
Jul 11 04:17:38.032382 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.032364    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-587e746d-openshift-default-7b7998d4dc-hgbpn"]
Jul 11 04:17:38.089409 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.089372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c547dc45-d08a-4566-9cda-71a63fb5c109-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ca663575-mh2q7\" (UID: \"c547dc45-d08a-4566-9cda-71a63fb5c109\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"
Jul 11 04:17:38.089980 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.089962    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c547dc45-d08a-4566-9cda-71a63fb5c109-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ca663575-mh2q7\" (UID: \"c547dc45-d08a-4566-9cda-71a63fb5c109\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"
Jul 11 04:17:38.280813 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.280781    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"
Jul 11 04:17:38.430287 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:38.430261    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"]
Jul 11 04:17:38.431718 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:17:38.431694    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc547dc45_d08a_4566_9cda_71a63fb5c109.slice/crio-ebaee639113489b4d4cb35c38b8f950cd84c8b8339096b8aaaa7e585e91535e5 WatchSource:0}: Error finding container ebaee639113489b4d4cb35c38b8f950cd84c8b8339096b8aaaa7e585e91535e5: Status 404 returned error can't find the container with id ebaee639113489b4d4cb35c38b8f950cd84c8b8339096b8aaaa7e585e91535e5
Jul 11 04:17:39.012199 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:39.012108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7" event={"ID":"c547dc45-d08a-4566-9cda-71a63fb5c109","Type":"ContainerStarted","Data":"a042cfc344bc513ded6e3d6c0d176ce664ab26cdf5a03aea702d8f0b15a8bb84"}
Jul 11 04:17:39.012199 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:39.012169    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7" event={"ID":"c547dc45-d08a-4566-9cda-71a63fb5c109","Type":"ContainerStarted","Data":"ebaee639113489b4d4cb35c38b8f950cd84c8b8339096b8aaaa7e585e91535e5"}
Jul 11 04:17:39.026795 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:39.026743    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7" podStartSLOduration=2.026728408 podStartE2EDuration="2.026728408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:17:39.024911055 +0000 UTC m=+1732.210063521" watchObservedRunningTime="2026-07-11 04:17:39.026728408 +0000 UTC m=+1732.211880863"
Jul 11 04:17:39.482104 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:39.482066    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce" path="/var/lib/kubelet/pods/18def3a8-6ee9-42fd-b31b-5ff5aeeb44ce/volumes"
Jul 11 04:17:40.020265 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:40.020226    2576 generic.go:356] "Generic (PLEG): container finished" podID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerID="a042cfc344bc513ded6e3d6c0d176ce664ab26cdf5a03aea702d8f0b15a8bb84" exitCode=7
Jul 11 04:17:40.020450 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:40.020316    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7" event={"ID":"c547dc45-d08a-4566-9cda-71a63fb5c109","Type":"ContainerDied","Data":"a042cfc344bc513ded6e3d6c0d176ce664ab26cdf5a03aea702d8f0b15a8bb84"}
Jul 11 04:17:40.020541 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:40.020507    2576 scope.go:117] "RemoveContainer" containerID="a042cfc344bc513ded6e3d6c0d176ce664ab26cdf5a03aea702d8f0b15a8bb84"
Jul 11 04:17:40.996883 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:40.996855    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:17:41.028926 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:41.028895    2576 generic.go:356] "Generic (PLEG): container finished" podID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerID="9aea6b29e1df81194ffd1e444a39bf3d6fce81ba991b06b81f9f55f82ec57c91" exitCode=7
Jul 11 04:17:41.029210 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:41.029195    2576 scope.go:117] "RemoveContainer" containerID="9aea6b29e1df81194ffd1e444a39bf3d6fce81ba991b06b81f9f55f82ec57c91"
Jul 11 04:17:41.029594 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:41.028928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7" event={"ID":"c547dc45-d08a-4566-9cda-71a63fb5c109","Type":"ContainerDied","Data":"9aea6b29e1df81194ffd1e444a39bf3d6fce81ba991b06b81f9f55f82ec57c91"}
Jul 11 04:17:41.029594 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:41.029472    2576 scope.go:117] "RemoveContainer" containerID="a042cfc344bc513ded6e3d6c0d176ce664ab26cdf5a03aea702d8f0b15a8bb84"
Jul 11 04:17:41.029744 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:17:41.029586    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ca663575-mh2q7_odh-ai-gateway-infra(c547dc45-d08a-4566-9cda-71a63fb5c109)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109"
Jul 11 04:17:42.037684 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:42.037651    2576 scope.go:117] "RemoveContainer" containerID="9aea6b29e1df81194ffd1e444a39bf3d6fce81ba991b06b81f9f55f82ec57c91"
Jul 11 04:17:42.038046 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:17:42.037906    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-ca663575-mh2q7_odh-ai-gateway-infra(c547dc45-d08a-4566-9cda-71a63fb5c109)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109"
Jul 11 04:17:45.054359 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:45.054314    2576 generic.go:356] "Generic (PLEG): container finished" podID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerID="7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c" exitCode=0
Jul 11 04:17:45.054772 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:45.054394    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" event={"ID":"2800864a-19a8-41ee-80ed-a54d71ed552d","Type":"ContainerDied","Data":"7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c"}
Jul 11 04:17:45.054913 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:45.054898    2576 scope.go:117] "RemoveContainer" containerID="7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c"
Jul 11 04:17:45.055915 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:45.055888    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:17:45.055969 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:45.055955    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:17:45.056011 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:45.055986    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:17:46.065961 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:46.065921    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" event={"ID":"2800864a-19a8-41ee-80ed-a54d71ed552d","Type":"ContainerStarted","Data":"b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514"}
Jul 11 04:17:46.733567 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:46.733530    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:46.734615 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:46.734587    2576 patch_prober.go:28] interesting pod/e2e-derive-ca663575-openshift-default-999895f5-pscw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 11 04:17:46.734738 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:46.734641    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 11 04:17:47.732834 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:47.732800    2576 patch_prober.go:28] interesting pod/e2e-derive-ca663575-openshift-default-999895f5-pscw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 11 04:17:47.733211 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:47.732872    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 11 04:17:48.732988 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:48.732943    2576 patch_prober.go:28] interesting pod/e2e-derive-ca663575-openshift-default-999895f5-pscw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 11 04:17:48.733398 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:48.733021    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 11 04:17:48.979434 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:48.979393    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:49.765836 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:49.765808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:49.767077 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:49.767055    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:17:54.472197 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:54.472160    2576 scope.go:117] "RemoveContainer" containerID="9aea6b29e1df81194ffd1e444a39bf3d6fce81ba991b06b81f9f55f82ec57c91"
Jul 11 04:17:55.122219 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:55.122186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7" event={"ID":"c547dc45-d08a-4566-9cda-71a63fb5c109","Type":"ContainerStarted","Data":"afef45af41a908451622154e2525e7871d55b63a29d346c4d27adc8e5ff9d6f8"}
Jul 11 04:17:56.128989 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:56.128950    2576 generic.go:356] "Generic (PLEG): container finished" podID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerID="afef45af41a908451622154e2525e7871d55b63a29d346c4d27adc8e5ff9d6f8" exitCode=0
Jul 11 04:17:56.129473 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:56.129016    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7" event={"ID":"c547dc45-d08a-4566-9cda-71a63fb5c109","Type":"ContainerDied","Data":"afef45af41a908451622154e2525e7871d55b63a29d346c4d27adc8e5ff9d6f8"}
Jul 11 04:17:56.129473 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:56.129064    2576 scope.go:117] "RemoveContainer" containerID="9aea6b29e1df81194ffd1e444a39bf3d6fce81ba991b06b81f9f55f82ec57c91"
Jul 11 04:17:56.149384 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:56.149356    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"]
Jul 11 04:17:57.263144 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:57.263117    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"
Jul 11 04:17:57.373256 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:57.373209    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c547dc45-d08a-4566-9cda-71a63fb5c109-maas-api-service-ca\") pod \"c547dc45-d08a-4566-9cda-71a63fb5c109\" (UID: \"c547dc45-d08a-4566-9cda-71a63fb5c109\") "
Jul 11 04:17:57.373589 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:57.373566    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c547dc45-d08a-4566-9cda-71a63fb5c109-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c547dc45-d08a-4566-9cda-71a63fb5c109" (UID: "c547dc45-d08a-4566-9cda-71a63fb5c109"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:17:57.473831 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:57.473756    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c547dc45-d08a-4566-9cda-71a63fb5c109-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:17:58.142735 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:58.142701    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7" event={"ID":"c547dc45-d08a-4566-9cda-71a63fb5c109","Type":"ContainerDied","Data":"ebaee639113489b4d4cb35c38b8f950cd84c8b8339096b8aaaa7e585e91535e5"}
Jul 11 04:17:58.142735 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:58.142734    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"
Jul 11 04:17:58.142948 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:58.142750    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebaee639113489b4d4cb35c38b8f950cd84c8b8339096b8aaaa7e585e91535e5"
Jul 11 04:17:58.171785 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:58.171755    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"]
Jul 11 04:17:58.173772 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:58.173751    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-mh2q7"]
Jul 11 04:17:59.477439 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:17:59.477407    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109" path="/var/lib/kubelet/pods/c547dc45-d08a-4566-9cda-71a63fb5c109/volumes"
Jul 11 04:18:38.002392 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.002355    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c"]
Jul 11 04:18:38.002911 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.002893    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerName="revoke-keys"
Jul 11 04:18:38.002956 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.002916    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerName="revoke-keys"
Jul 11 04:18:38.002956 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.002935    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerName="revoke-keys"
Jul 11 04:18:38.002956 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.002944    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerName="revoke-keys"
Jul 11 04:18:38.003060 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.003047    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerName="revoke-keys"
Jul 11 04:18:38.003096 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.003066    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerName="revoke-keys"
Jul 11 04:18:38.006784 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.006762    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c"
Jul 11 04:18:38.009213 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.009102    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:18:38.011235 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.011204    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c"]
Jul 11 04:18:38.118647 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.118611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4becf8c9-16a6-4d5f-a5bc-73cc64c595e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ca663575-2q74c\" (UID: \"4becf8c9-16a6-4d5f-a5bc-73cc64c595e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c"
Jul 11 04:18:38.219816 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.219777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4becf8c9-16a6-4d5f-a5bc-73cc64c595e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ca663575-2q74c\" (UID: \"4becf8c9-16a6-4d5f-a5bc-73cc64c595e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c"
Jul 11 04:18:38.220516 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.220490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4becf8c9-16a6-4d5f-a5bc-73cc64c595e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ca663575-2q74c\" (UID: \"4becf8c9-16a6-4d5f-a5bc-73cc64c595e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c"
Jul 11 04:18:38.319177 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.319139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c"
Jul 11 04:18:38.450060 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:38.450034    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c"]
Jul 11 04:18:38.451024 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:18:38.450996    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4becf8c9_16a6_4d5f_a5bc_73cc64c595e0.slice/crio-590dd571405196271db5a5ba2907256184fae54b2cd9a628bfd53ecf45e46652 WatchSource:0}: Error finding container 590dd571405196271db5a5ba2907256184fae54b2cd9a628bfd53ecf45e46652: Status 404 returned error can't find the container with id 590dd571405196271db5a5ba2907256184fae54b2cd9a628bfd53ecf45e46652
Jul 11 04:18:39.369181 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:39.369147    2576 generic.go:356] "Generic (PLEG): container finished" podID="4becf8c9-16a6-4d5f-a5bc-73cc64c595e0" containerID="e63959f0ce970197423404fb4b7946407b06df89a2c107eddedc0ac43159042f" exitCode=0
Jul 11 04:18:39.369595 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:39.369190    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c" event={"ID":"4becf8c9-16a6-4d5f-a5bc-73cc64c595e0","Type":"ContainerDied","Data":"e63959f0ce970197423404fb4b7946407b06df89a2c107eddedc0ac43159042f"}
Jul 11 04:18:39.369595 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:39.369232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c" event={"ID":"4becf8c9-16a6-4d5f-a5bc-73cc64c595e0","Type":"ContainerStarted","Data":"590dd571405196271db5a5ba2907256184fae54b2cd9a628bfd53ecf45e46652"}
Jul 11 04:18:40.503647 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:40.503621    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c"
Jul 11 04:18:40.540321 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:40.540285    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4becf8c9-16a6-4d5f-a5bc-73cc64c595e0-maas-api-service-ca\") pod \"4becf8c9-16a6-4d5f-a5bc-73cc64c595e0\" (UID: \"4becf8c9-16a6-4d5f-a5bc-73cc64c595e0\") "
Jul 11 04:18:40.540634 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:40.540604    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4becf8c9-16a6-4d5f-a5bc-73cc64c595e0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4becf8c9-16a6-4d5f-a5bc-73cc64c595e0" (UID: "4becf8c9-16a6-4d5f-a5bc-73cc64c595e0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:18:40.540762 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:40.540696    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4becf8c9-16a6-4d5f-a5bc-73cc64c595e0-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:18:41.381506 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:41.381469    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c"
Jul 11 04:18:41.381506 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:41.381491    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ca663575-2q74c" event={"ID":"4becf8c9-16a6-4d5f-a5bc-73cc64c595e0","Type":"ContainerDied","Data":"590dd571405196271db5a5ba2907256184fae54b2cd9a628bfd53ecf45e46652"}
Jul 11 04:18:41.381723 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:41.381570    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="590dd571405196271db5a5ba2907256184fae54b2cd9a628bfd53ecf45e46652"
Jul 11 04:18:48.357234 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.357197    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"]
Jul 11 04:18:48.357763 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.357497    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq" podUID="391c5b05-64f3-43d3-a798-a54966d7f7e2" containerName="maas-api" containerID="cri-o://2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c" gracePeriod=30
Jul 11 04:18:48.603357 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.603314    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:18:48.710040 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.709953    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/391c5b05-64f3-43d3-a798-a54966d7f7e2-maas-api-tls\") pod \"391c5b05-64f3-43d3-a798-a54966d7f7e2\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") "
Jul 11 04:18:48.710040 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.710022    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/391c5b05-64f3-43d3-a798-a54966d7f7e2-openshift-service-ca\") pod \"391c5b05-64f3-43d3-a798-a54966d7f7e2\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") "
Jul 11 04:18:48.710222 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.710114    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m8jj\" (UniqueName: \"kubernetes.io/projected/391c5b05-64f3-43d3-a798-a54966d7f7e2-kube-api-access-5m8jj\") pod \"391c5b05-64f3-43d3-a798-a54966d7f7e2\" (UID: \"391c5b05-64f3-43d3-a798-a54966d7f7e2\") "
Jul 11 04:18:48.710432 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.710395    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/391c5b05-64f3-43d3-a798-a54966d7f7e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "391c5b05-64f3-43d3-a798-a54966d7f7e2" (UID: "391c5b05-64f3-43d3-a798-a54966d7f7e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:18:48.712081 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.712055    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/391c5b05-64f3-43d3-a798-a54966d7f7e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "391c5b05-64f3-43d3-a798-a54966d7f7e2" (UID: "391c5b05-64f3-43d3-a798-a54966d7f7e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:18:48.712081 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.712068    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/391c5b05-64f3-43d3-a798-a54966d7f7e2-kube-api-access-5m8jj" (OuterVolumeSpecName: "kube-api-access-5m8jj") pod "391c5b05-64f3-43d3-a798-a54966d7f7e2" (UID: "391c5b05-64f3-43d3-a798-a54966d7f7e2"). InnerVolumeSpecName "kube-api-access-5m8jj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:18:48.811080 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.811051    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/391c5b05-64f3-43d3-a798-a54966d7f7e2-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:18:48.811080 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.811077    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m8jj\" (UniqueName: \"kubernetes.io/projected/391c5b05-64f3-43d3-a798-a54966d7f7e2-kube-api-access-5m8jj\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:18:48.811080 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:48.811086    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/391c5b05-64f3-43d3-a798-a54966d7f7e2-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:18:49.426430 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:49.426395    2576 generic.go:356] "Generic (PLEG): container finished" podID="391c5b05-64f3-43d3-a798-a54966d7f7e2" containerID="2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c" exitCode=0
Jul 11 04:18:49.426921 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:49.426442    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq" event={"ID":"391c5b05-64f3-43d3-a798-a54966d7f7e2","Type":"ContainerDied","Data":"2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c"}
Jul 11 04:18:49.426921 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:49.426477    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq" event={"ID":"391c5b05-64f3-43d3-a798-a54966d7f7e2","Type":"ContainerDied","Data":"cadebe14dfda0950e396d202d3ec48867d132376c2204c04e7ff4e824fb5de22"}
Jul 11 04:18:49.426921 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:49.426508    2576 scope.go:117] "RemoveContainer" containerID="2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c"
Jul 11 04:18:49.426921 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:49.426442    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"
Jul 11 04:18:49.435587 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:49.435567    2576 scope.go:117] "RemoveContainer" containerID="2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c"
Jul 11 04:18:49.435853 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:18:49.435833    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c\": container with ID starting with 2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c not found: ID does not exist" containerID="2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c"
Jul 11 04:18:49.435900 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:49.435862    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c"} err="failed to get container status \"2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c\": rpc error: code = NotFound desc = could not find container \"2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c\": container with ID starting with 2152f1cf2056333f751ba6dc667a96187e51a5f82087d28ef62ff09b40c4441c not found: ID does not exist"
Jul 11 04:18:49.446711 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:49.446689    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"]
Jul 11 04:18:49.452843 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:49.452824    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ca663575-678fd9d89f-r4vcq"]
Jul 11 04:18:49.477708 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:18:49.477684    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="391c5b05-64f3-43d3-a798-a54966d7f7e2" path="/var/lib/kubelet/pods/391c5b05-64f3-43d3-a798-a54966d7f7e2/volumes"
Jul 11 04:19:03.270375 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:03.270340    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"]
Jul 11 04:19:03.270872 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:03.270543    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerName="istio-proxy" containerID="cri-o://b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514" gracePeriod=30
Jul 11 04:19:04.768299 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:04.768258    2576 patch_prober.go:28] interesting pod/e2e-derive-ca663575-openshift-default-999895f5-pscw9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 04:19:04.768707 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:04.768323    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 04:19:08.526757 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.526732    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:19:08.530059 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.530034    2576 generic.go:356] "Generic (PLEG): container finished" podID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerID="b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514" exitCode=0
Jul 11 04:19:08.530193 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.530082    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"
Jul 11 04:19:08.530193 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.530121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" event={"ID":"2800864a-19a8-41ee-80ed-a54d71ed552d","Type":"ContainerDied","Data":"b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514"}
Jul 11 04:19:08.530193 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.530185    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9" event={"ID":"2800864a-19a8-41ee-80ed-a54d71ed552d","Type":"ContainerDied","Data":"a691d025508485c76b1c1326cae0b7b2d8344e92c453954d5c14ac254817b394"}
Jul 11 04:19:08.530318 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.530211    2576 scope.go:117] "RemoveContainer" containerID="b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514"
Jul 11 04:19:08.538724 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.538706    2576 scope.go:117] "RemoveContainer" containerID="7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c"
Jul 11 04:19:08.548268 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.548229    2576 scope.go:117] "RemoveContainer" containerID="b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514"
Jul 11 04:19:08.548646 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:19:08.548623    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514\": container with ID starting with b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514 not found: ID does not exist" containerID="b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514"
Jul 11 04:19:08.548762 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.548655    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514"} err="failed to get container status \"b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514\": rpc error: code = NotFound desc = could not find container \"b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514\": container with ID starting with b94cb62cf444d2744c7dc3a6b6e0a34a476e92e779a770bdc7fb87066ed6e514 not found: ID does not exist"
Jul 11 04:19:08.548762 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.548673    2576 scope.go:117] "RemoveContainer" containerID="7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c"
Jul 11 04:19:08.548945 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:19:08.548928    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c\": container with ID starting with 7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c not found: ID does not exist" containerID="7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c"
Jul 11 04:19:08.549008 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.548952    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c"} err="failed to get container status \"7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c\": rpc error: code = NotFound desc = could not find container \"7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c\": container with ID starting with 7e2b1499fbb05c194623ec871a92455c05c9c1e71246719301a051d7651e228c not found: ID does not exist"
Jul 11 04:19:08.686186 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686152    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-envoy\") pod \"2800864a-19a8-41ee-80ed-a54d71ed552d\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") "
Jul 11 04:19:08.686386 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686202    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-credential-socket\") pod \"2800864a-19a8-41ee-80ed-a54d71ed552d\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") "
Jul 11 04:19:08.686386 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686233    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-podinfo\") pod \"2800864a-19a8-41ee-80ed-a54d71ed552d\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") "
Jul 11 04:19:08.686386 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686260    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-data\") pod \"2800864a-19a8-41ee-80ed-a54d71ed552d\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") "
Jul 11 04:19:08.686386 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686303    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz8fc\" (UniqueName: \"kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-kube-api-access-hz8fc\") pod \"2800864a-19a8-41ee-80ed-a54d71ed552d\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") "
Jul 11 04:19:08.686386 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686365    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-socket\") pod \"2800864a-19a8-41ee-80ed-a54d71ed552d\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") "
Jul 11 04:19:08.686664 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686407    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-certs\") pod \"2800864a-19a8-41ee-80ed-a54d71ed552d\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") "
Jul 11 04:19:08.686722 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686655    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2800864a-19a8-41ee-80ed-a54d71ed552d" (UID: "2800864a-19a8-41ee-80ed-a54d71ed552d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:19:08.686722 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686685    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2800864a-19a8-41ee-80ed-a54d71ed552d" (UID: "2800864a-19a8-41ee-80ed-a54d71ed552d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:19:08.686722 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686455    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-token\") pod \"2800864a-19a8-41ee-80ed-a54d71ed552d\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") "
Jul 11 04:19:08.686880 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686717    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2800864a-19a8-41ee-80ed-a54d71ed552d" (UID: "2800864a-19a8-41ee-80ed-a54d71ed552d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:19:08.686880 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.686750    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2800864a-19a8-41ee-80ed-a54d71ed552d-istiod-ca-cert\") pod \"2800864a-19a8-41ee-80ed-a54d71ed552d\" (UID: \"2800864a-19a8-41ee-80ed-a54d71ed552d\") "
Jul 11 04:19:08.687169 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.687123    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2800864a-19a8-41ee-80ed-a54d71ed552d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2800864a-19a8-41ee-80ed-a54d71ed552d" (UID: "2800864a-19a8-41ee-80ed-a54d71ed552d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:19:08.687299 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.687199    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-data" (OuterVolumeSpecName: "istio-data") pod "2800864a-19a8-41ee-80ed-a54d71ed552d" (UID: "2800864a-19a8-41ee-80ed-a54d71ed552d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:19:08.687456 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.687437    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2800864a-19a8-41ee-80ed-a54d71ed552d-istiod-ca-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:19:08.687522 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.687461    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-credential-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:19:08.687522 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.687477    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-data\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:19:08.687522 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.687491    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:19:08.687522 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.687504    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-workload-certs\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:19:08.688948 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.688917    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2800864a-19a8-41ee-80ed-a54d71ed552d" (UID: "2800864a-19a8-41ee-80ed-a54d71ed552d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:19:08.688948 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.688928    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-kube-api-access-hz8fc" (OuterVolumeSpecName: "kube-api-access-hz8fc") pod "2800864a-19a8-41ee-80ed-a54d71ed552d" (UID: "2800864a-19a8-41ee-80ed-a54d71ed552d"). InnerVolumeSpecName "kube-api-access-hz8fc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:19:08.689083 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.688956    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-token" (OuterVolumeSpecName: "istio-token") pod "2800864a-19a8-41ee-80ed-a54d71ed552d" (UID: "2800864a-19a8-41ee-80ed-a54d71ed552d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:19:08.689083 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.688967    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2800864a-19a8-41ee-80ed-a54d71ed552d" (UID: "2800864a-19a8-41ee-80ed-a54d71ed552d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:19:08.788426 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.788389    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-token\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:19:08.788426 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.788417    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-envoy\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:19:08.788426 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.788426    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2800864a-19a8-41ee-80ed-a54d71ed552d-istio-podinfo\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:19:08.788426 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.788435    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz8fc\" (UniqueName: \"kubernetes.io/projected/2800864a-19a8-41ee-80ed-a54d71ed552d-kube-api-access-hz8fc\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:19:08.851477 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.851448    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"]
Jul 11 04:19:08.860219 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:08.855667    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ca663575-openshift-default-999895f5-pscw9"]
Jul 11 04:19:09.477699 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:09.477670    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" path="/var/lib/kubelet/pods/2800864a-19a8-41ee-80ed-a54d71ed552d/volumes"
Jul 11 04:19:47.503873 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:19:47.503842    2576 scope.go:117] "RemoveContainer" containerID="d784238f0047a58f74f415f9cac31353d240020aec23318032658430f5fa6342"
Jul 11 04:20:38.139092 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139054    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"]
Jul 11 04:20:38.139503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139394    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerName="istio-proxy"
Jul 11 04:20:38.139503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139406    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerName="istio-proxy"
Jul 11 04:20:38.139503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139417    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391c5b05-64f3-43d3-a798-a54966d7f7e2" containerName="maas-api"
Jul 11 04:20:38.139503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139423    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="391c5b05-64f3-43d3-a798-a54966d7f7e2" containerName="maas-api"
Jul 11 04:20:38.139503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139437    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerName="istio-proxy"
Jul 11 04:20:38.139503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139443    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerName="istio-proxy"
Jul 11 04:20:38.139503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139453    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerName="revoke-keys"
Jul 11 04:20:38.139503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139458    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerName="revoke-keys"
Jul 11 04:20:38.139503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139464    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4becf8c9-16a6-4d5f-a5bc-73cc64c595e0" containerName="revoke-keys"
Jul 11 04:20:38.139503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139470    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4becf8c9-16a6-4d5f-a5bc-73cc64c595e0" containerName="revoke-keys"
Jul 11 04:20:38.139835 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139523    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c547dc45-d08a-4566-9cda-71a63fb5c109" containerName="revoke-keys"
Jul 11 04:20:38.139835 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139529    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4becf8c9-16a6-4d5f-a5bc-73cc64c595e0" containerName="revoke-keys"
Jul 11 04:20:38.139835 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139534    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="391c5b05-64f3-43d3-a798-a54966d7f7e2" containerName="maas-api"
Jul 11 04:20:38.139835 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139544    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerName="istio-proxy"
Jul 11 04:20:38.139835 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.139550    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2800864a-19a8-41ee-80ed-a54d71ed552d" containerName="istio-proxy"
Jul 11 04:20:38.142531 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.142500    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.144886 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.144862    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-31ee349a-openshift-default-dockercfg-4thcp\""
Jul 11 04:20:38.153853 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.153830    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"]
Jul 11 04:20:38.258000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.257959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-socket\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.258000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.258002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-credential-socket\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.258251 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.258025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-certs\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.258251 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.258105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-data\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.258251 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.258159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-podinfo\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.258251 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.258187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-envoy\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.258251 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.258224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istiod-ca-cert\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.258519 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.258297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-token\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.258519 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.258382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs7g5\" (UniqueName: \"kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-kube-api-access-fs7g5\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359015 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.358978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-podinfo\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359184 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-envoy\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359184 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359059    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istiod-ca-cert\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359184 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-token\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359184 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs7g5\" (UniqueName: \"kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-kube-api-access-fs7g5\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359184 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-socket\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359490 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-credential-socket\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359490 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-certs\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359490 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-data\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359716 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359689    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-socket\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359824 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359692    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-data\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359824 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-certs\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.359899 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.359845    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-credential-socket\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.360070 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.360053    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istiod-ca-cert\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.361467 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.361440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-envoy\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.361667 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.361650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-podinfo\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.366682 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.366656    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-token\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.366928 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.366911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs7g5\" (UniqueName: \"kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-kube-api-access-fs7g5\") pod \"e2e-mt-31ee349a-openshift-default-69657bf74c-q728j\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") " pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.452983 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.452891    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:38.589764 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.589740    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"]
Jul 11 04:20:38.592039 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:20:38.592011    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6051bcbf_b952_4d40_ab33_b2a0674fb5e2.slice/crio-44e7bd129a0f3dbd802e1f4d7652464109f2d89f3c7e2198e2b4badf395a0990 WatchSource:0}: Error finding container 44e7bd129a0f3dbd802e1f4d7652464109f2d89f3c7e2198e2b4badf395a0990: Status 404 returned error can't find the container with id 44e7bd129a0f3dbd802e1f4d7652464109f2d89f3c7e2198e2b4badf395a0990
Jul 11 04:20:38.594194 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.594161    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:20:38.594267 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.594222    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:20:38.594267 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:38.594251    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:20:39.027225 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:39.027179    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" event={"ID":"6051bcbf-b952-4d40-ab33-b2a0674fb5e2","Type":"ContainerStarted","Data":"c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5"}
Jul 11 04:20:39.027454 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:39.027236    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" event={"ID":"6051bcbf-b952-4d40-ab33-b2a0674fb5e2","Type":"ContainerStarted","Data":"44e7bd129a0f3dbd802e1f4d7652464109f2d89f3c7e2198e2b4badf395a0990"}
Jul 11 04:20:39.046651 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:39.046602    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" podStartSLOduration=1.046586011 podStartE2EDuration="1.046586011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:20:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:20:39.045115311 +0000 UTC m=+1912.230267772" watchObservedRunningTime="2026-07-11 04:20:39.046586011 +0000 UTC m=+1912.231738466"
Jul 11 04:20:39.453466 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:39.453382    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:39.458262 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:39.458236    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:40.032665 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:40.032633    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:40.033620 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:40.033599    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:41.040626 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.040579    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"]
Jul 11 04:20:41.044865 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.044843    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:41.049968 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.049942    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-drsms\""
Jul 11 04:20:41.050222 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.050199    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-31ee349a-serving-cert\""
Jul 11 04:20:41.054866 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.054758    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"]
Jul 11 04:20:41.192095 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.192061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-openshift-service-ca\") pod \"maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:41.192095 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.192106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkxfd\" (UniqueName: \"kubernetes.io/projected/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-kube-api-access-xkxfd\") pod \"maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:41.192317 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.192293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls\") pod \"maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:41.293792 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.293683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls\") pod \"maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:41.293792 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.293755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-openshift-service-ca\") pod \"maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:41.293792 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.293783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkxfd\" (UniqueName: \"kubernetes.io/projected/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-kube-api-access-xkxfd\") pod \"maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:41.294093 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:20:41.293901    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-serving-cert: secret "maas-api-e2e-mt-31ee349a-serving-cert" not found
Jul 11 04:20:41.294093 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:20:41.293968    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls podName:ea837bcf-457f-45ee-9a3d-3a8f44b446a0 nodeName:}" failed. No retries permitted until 2026-07-11 04:20:41.793951506 +0000 UTC m=+1914.979103939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls") pod "maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm" (UID: "ea837bcf-457f-45ee-9a3d-3a8f44b446a0") : secret "maas-api-e2e-mt-31ee349a-serving-cert" not found
Jul 11 04:20:41.294504 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.294480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-openshift-service-ca\") pod \"maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:41.302144 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.302119    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkxfd\" (UniqueName: \"kubernetes.io/projected/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-kube-api-access-xkxfd\") pod \"maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:41.798863 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:41.798826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls\") pod \"maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:41.799064 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:20:41.799000    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-serving-cert: secret "maas-api-e2e-mt-31ee349a-serving-cert" not found
Jul 11 04:20:41.799140 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:20:41.799092    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls podName:ea837bcf-457f-45ee-9a3d-3a8f44b446a0 nodeName:}" failed. No retries permitted until 2026-07-11 04:20:42.799070355 +0000 UTC m=+1915.984222794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls") pod "maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm" (UID: "ea837bcf-457f-45ee-9a3d-3a8f44b446a0") : secret "maas-api-e2e-mt-31ee349a-serving-cert" not found
Jul 11 04:20:42.809228 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:42.809189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls\") pod \"maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:42.811583 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:42.811553    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls\") pod \"maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:42.859636 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:42.859588    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:42.991873 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:42.991850    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"]
Jul 11 04:20:42.993421 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:20:42.993386    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea837bcf_457f_45ee_9a3d_3a8f44b446a0.slice/crio-18e39cc5cce3024e0015715876fe498be0245c77ce2db664ab0210a2073af50a WatchSource:0}: Error finding container 18e39cc5cce3024e0015715876fe498be0245c77ce2db664ab0210a2073af50a: Status 404 returned error can't find the container with id 18e39cc5cce3024e0015715876fe498be0245c77ce2db664ab0210a2073af50a
Jul 11 04:20:42.995316 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:42.995292    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 04:20:43.052628 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:43.052593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm" event={"ID":"ea837bcf-457f-45ee-9a3d-3a8f44b446a0","Type":"ContainerStarted","Data":"18e39cc5cce3024e0015715876fe498be0245c77ce2db664ab0210a2073af50a"}
Jul 11 04:20:44.059234 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:44.059195    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm" event={"ID":"ea837bcf-457f-45ee-9a3d-3a8f44b446a0","Type":"ContainerStarted","Data":"b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec"}
Jul 11 04:20:44.059658 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:44.059274    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:44.075066 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:44.075020    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm" podStartSLOduration=2.449634419 podStartE2EDuration="3.075007782s" totalImagesPullingTime="625.373363ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:20:44.073302625 +0000 UTC m=+1917.258455083" watchObservedRunningTime="2026-07-11 04:20:44.075007782 +0000 UTC m=+1917.260160268"
Jul 11 04:20:50.074982 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:50.074952    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:20:52.547864 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:52.547826    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj"]
Jul 11 04:20:52.551450 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:52.551420    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj"
Jul 11 04:20:52.553859 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:52.553829    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:20:52.556801 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:52.556777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj"]
Jul 11 04:20:52.610970 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:52.610933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c6895bd-06fe-4655-998d-c055dce0f731-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj\" (UID: \"7c6895bd-06fe-4655-998d-c055dce0f731\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj"
Jul 11 04:20:52.712306 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:52.712267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c6895bd-06fe-4655-998d-c055dce0f731-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj\" (UID: \"7c6895bd-06fe-4655-998d-c055dce0f731\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj"
Jul 11 04:20:52.713146 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:52.713120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c6895bd-06fe-4655-998d-c055dce0f731-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj\" (UID: \"7c6895bd-06fe-4655-998d-c055dce0f731\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj"
Jul 11 04:20:52.865455 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:52.865367    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj"
Jul 11 04:20:53.005666 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:53.005461    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj"]
Jul 11 04:20:53.008209 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:20:53.008182    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6895bd_06fe_4655_998d_c055dce0f731.slice/crio-dea8b2580f2e3419ada8775087b879edde45d265cbb7bc18a404e860d75343e5 WatchSource:0}: Error finding container dea8b2580f2e3419ada8775087b879edde45d265cbb7bc18a404e860d75343e5: Status 404 returned error can't find the container with id dea8b2580f2e3419ada8775087b879edde45d265cbb7bc18a404e860d75343e5
Jul 11 04:20:53.113669 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:53.113636    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj" event={"ID":"7c6895bd-06fe-4655-998d-c055dce0f731","Type":"ContainerStarted","Data":"dea8b2580f2e3419ada8775087b879edde45d265cbb7bc18a404e860d75343e5"}
Jul 11 04:20:54.120642 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:54.120604    2576 generic.go:356] "Generic (PLEG): container finished" podID="7c6895bd-06fe-4655-998d-c055dce0f731" containerID="c3df826fd8cef65daae59c1f906c9a3ada38057abb5c15205ede2280d955ab53" exitCode=0
Jul 11 04:20:54.121041 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:54.120678    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj" event={"ID":"7c6895bd-06fe-4655-998d-c055dce0f731","Type":"ContainerDied","Data":"c3df826fd8cef65daae59c1f906c9a3ada38057abb5c15205ede2280d955ab53"}
Jul 11 04:20:55.034478 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.034440    2576 patch_prober.go:28] interesting pod/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 11 04:20:55.034692 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.034496    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 11 04:20:55.128100 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.128067    2576 generic.go:356] "Generic (PLEG): container finished" podID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerID="c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5" exitCode=0
Jul 11 04:20:55.128609 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.128146    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" event={"ID":"6051bcbf-b952-4d40-ab33-b2a0674fb5e2","Type":"ContainerDied","Data":"c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5"}
Jul 11 04:20:55.129063 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.128648    2576 scope.go:117] "RemoveContainer" containerID="c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5"
Jul 11 04:20:55.129751 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.129722    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:20:55.129811 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.129796    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:20:55.129849 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.129833    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:20:55.290551 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.290487    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj"
Jul 11 04:20:55.337020 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.336987    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c6895bd-06fe-4655-998d-c055dce0f731-maas-api-service-ca\") pod \"7c6895bd-06fe-4655-998d-c055dce0f731\" (UID: \"7c6895bd-06fe-4655-998d-c055dce0f731\") "
Jul 11 04:20:55.337371 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.337347    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c6895bd-06fe-4655-998d-c055dce0f731-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7c6895bd-06fe-4655-998d-c055dce0f731" (UID: "7c6895bd-06fe-4655-998d-c055dce0f731"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:20:55.437885 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:55.437850    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c6895bd-06fe-4655-998d-c055dce0f731-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:20:56.135529 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:56.135496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" event={"ID":"6051bcbf-b952-4d40-ab33-b2a0674fb5e2","Type":"ContainerStarted","Data":"48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598"}
Jul 11 04:20:56.136638 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:56.136620    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj"
Jul 11 04:20:56.136746 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:56.136640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj" event={"ID":"7c6895bd-06fe-4655-998d-c055dce0f731","Type":"ContainerDied","Data":"dea8b2580f2e3419ada8775087b879edde45d265cbb7bc18a404e860d75343e5"}
Jul 11 04:20:56.136746 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:56.136680    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dea8b2580f2e3419ada8775087b879edde45d265cbb7bc18a404e860d75343e5"
Jul 11 04:20:56.454072 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:56.453864    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:20:56.466947 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:56.466906    2576 patch_prober.go:28] interesting pod/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 11 04:20:56.467252 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:56.467216    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 11 04:20:57.454102 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:57.454064    2576 patch_prober.go:28] interesting pod/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 11 04:20:57.455153 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:57.454741    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 11 04:20:58.454180 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:58.454142    2576 patch_prober.go:28] interesting pod/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 11 04:20:58.454784 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:58.454748    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 11 04:20:59.453401 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:59.453363    2576 patch_prober.go:28] interesting pod/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 11 04:20:59.453698 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:20:59.453666    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 11 04:21:00.457638 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:00.457607    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:21:00.458084 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:00.457919    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:21:00.458699 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:00.458677    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:21:02.899380 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:02.899347    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"]
Jul 11 04:21:02.899832 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:02.899550    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm" podUID="ea837bcf-457f-45ee-9a3d-3a8f44b446a0" containerName="maas-api" containerID="cri-o://b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec" gracePeriod=30
Jul 11 04:21:03.142812 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.142783    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:21:03.181142 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.181047    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea837bcf-457f-45ee-9a3d-3a8f44b446a0" containerID="b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec" exitCode=0
Jul 11 04:21:03.181142 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.181098    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"
Jul 11 04:21:03.181142 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.181114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm" event={"ID":"ea837bcf-457f-45ee-9a3d-3a8f44b446a0","Type":"ContainerDied","Data":"b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec"}
Jul 11 04:21:03.181437 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.181163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm" event={"ID":"ea837bcf-457f-45ee-9a3d-3a8f44b446a0","Type":"ContainerDied","Data":"18e39cc5cce3024e0015715876fe498be0245c77ce2db664ab0210a2073af50a"}
Jul 11 04:21:03.181437 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.181186    2576 scope.go:117] "RemoveContainer" containerID="b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec"
Jul 11 04:21:03.189956 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.189937    2576 scope.go:117] "RemoveContainer" containerID="b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec"
Jul 11 04:21:03.190238 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:21:03.190215    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec\": container with ID starting with b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec not found: ID does not exist" containerID="b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec"
Jul 11 04:21:03.190286 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.190247    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec"} err="failed to get container status \"b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec\": rpc error: code = NotFound desc = could not find container \"b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec\": container with ID starting with b1ae71a475972f874cf8cd3bb76dc20ad7c0e6a0681524f8ca55f8a7c8d6ccec not found: ID does not exist"
Jul 11 04:21:03.217695 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.217667    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls\") pod \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") "
Jul 11 04:21:03.217814 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.217702    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-openshift-service-ca\") pod \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") "
Jul 11 04:21:03.217885 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.217831    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkxfd\" (UniqueName: \"kubernetes.io/projected/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-kube-api-access-xkxfd\") pod \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\" (UID: \"ea837bcf-457f-45ee-9a3d-3a8f44b446a0\") "
Jul 11 04:21:03.218095 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.218072    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea837bcf-457f-45ee-9a3d-3a8f44b446a0" (UID: "ea837bcf-457f-45ee-9a3d-3a8f44b446a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:21:03.219686 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.219666    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea837bcf-457f-45ee-9a3d-3a8f44b446a0" (UID: "ea837bcf-457f-45ee-9a3d-3a8f44b446a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:21:03.219841 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.219823    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-kube-api-access-xkxfd" (OuterVolumeSpecName: "kube-api-access-xkxfd") pod "ea837bcf-457f-45ee-9a3d-3a8f44b446a0" (UID: "ea837bcf-457f-45ee-9a3d-3a8f44b446a0"). InnerVolumeSpecName "kube-api-access-xkxfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:21:03.318712 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.318677    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkxfd\" (UniqueName: \"kubernetes.io/projected/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-kube-api-access-xkxfd\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:03.318712 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.318705    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:03.318712 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.318714    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea837bcf-457f-45ee-9a3d-3a8f44b446a0-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:03.498689 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.498661    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"]
Jul 11 04:21:03.502994 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:03.502971    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31ee349a-f659c4ff4-hsfzm"]
Jul 11 04:21:05.482942 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:05.482910    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea837bcf-457f-45ee-9a3d-3a8f44b446a0" path="/var/lib/kubelet/pods/ea837bcf-457f-45ee-9a3d-3a8f44b446a0/volumes"
Jul 11 04:21:18.260088 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:18.260051    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"]
Jul 11 04:21:18.260521 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:18.260272    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy" containerID="cri-o://48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598" gracePeriod=30
Jul 11 04:21:23.512289 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.512255    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:21:23.610230 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.610145    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-token\") pod \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") "
Jul 11 04:21:23.610230 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.610195    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-certs\") pod \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") "
Jul 11 04:21:23.610230 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.610216    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs7g5\" (UniqueName: \"kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-kube-api-access-fs7g5\") pod \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") "
Jul 11 04:21:23.610531 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.610244    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-data\") pod \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") "
Jul 11 04:21:23.610531 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.610267    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-podinfo\") pod \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") "
Jul 11 04:21:23.610531 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.610358    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-envoy\") pod \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") "
Jul 11 04:21:23.610531 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.610393    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-credential-socket\") pod \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") "
Jul 11 04:21:23.610531 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.610421    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istiod-ca-cert\") pod \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") "
Jul 11 04:21:23.610792 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.610740    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6051bcbf-b952-4d40-ab33-b2a0674fb5e2" (UID: "6051bcbf-b952-4d40-ab33-b2a0674fb5e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:21:23.611307 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.611141    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6051bcbf-b952-4d40-ab33-b2a0674fb5e2" (UID: "6051bcbf-b952-4d40-ab33-b2a0674fb5e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:21:23.611307 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.611247    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "6051bcbf-b952-4d40-ab33-b2a0674fb5e2" (UID: "6051bcbf-b952-4d40-ab33-b2a0674fb5e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:21:23.611307 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.611276    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6051bcbf-b952-4d40-ab33-b2a0674fb5e2" (UID: "6051bcbf-b952-4d40-ab33-b2a0674fb5e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:21:23.612655 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.612628    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6051bcbf-b952-4d40-ab33-b2a0674fb5e2" (UID: "6051bcbf-b952-4d40-ab33-b2a0674fb5e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:21:23.612764 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.612676    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-kube-api-access-fs7g5" (OuterVolumeSpecName: "kube-api-access-fs7g5") pod "6051bcbf-b952-4d40-ab33-b2a0674fb5e2" (UID: "6051bcbf-b952-4d40-ab33-b2a0674fb5e2"). InnerVolumeSpecName "kube-api-access-fs7g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:21:23.612892 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.612875    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6051bcbf-b952-4d40-ab33-b2a0674fb5e2" (UID: "6051bcbf-b952-4d40-ab33-b2a0674fb5e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:21:23.613040 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.613024    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "6051bcbf-b952-4d40-ab33-b2a0674fb5e2" (UID: "6051bcbf-b952-4d40-ab33-b2a0674fb5e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:21:23.711112 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.711080    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-socket\") pod \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\" (UID: \"6051bcbf-b952-4d40-ab33-b2a0674fb5e2\") "
Jul 11 04:21:23.711307 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.711292    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-token\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:23.711398 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.711313    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-certs\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:23.711398 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.711352    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs7g5\" (UniqueName: \"kubernetes.io/projected/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-kube-api-access-fs7g5\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:23.711398 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.711323    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6051bcbf-b952-4d40-ab33-b2a0674fb5e2" (UID: "6051bcbf-b952-4d40-ab33-b2a0674fb5e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:21:23.711398 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.711367    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-data\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:23.711398 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.711384    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-podinfo\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:23.711398 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.711395    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istio-envoy\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:23.711615 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.711411    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-credential-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:23.711615 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.711425    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-istiod-ca-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:23.811781 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:23.811741    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6051bcbf-b952-4d40-ab33-b2a0674fb5e2-workload-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:21:24.306248 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.306213    2576 generic.go:356] "Generic (PLEG): container finished" podID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerID="48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598" exitCode=0
Jul 11 04:21:24.306445 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.306271    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"
Jul 11 04:21:24.306445 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.306274    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" event={"ID":"6051bcbf-b952-4d40-ab33-b2a0674fb5e2","Type":"ContainerDied","Data":"48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598"}
Jul 11 04:21:24.306445 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.306344    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j" event={"ID":"6051bcbf-b952-4d40-ab33-b2a0674fb5e2","Type":"ContainerDied","Data":"44e7bd129a0f3dbd802e1f4d7652464109f2d89f3c7e2198e2b4badf395a0990"}
Jul 11 04:21:24.306445 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.306356    2576 scope.go:117] "RemoveContainer" containerID="48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598"
Jul 11 04:21:24.315935 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.315914    2576 scope.go:117] "RemoveContainer" containerID="c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5"
Jul 11 04:21:24.324559 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.324539    2576 scope.go:117] "RemoveContainer" containerID="48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598"
Jul 11 04:21:24.324952 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:21:24.324858    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598\": container with ID starting with 48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598 not found: ID does not exist" containerID="48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598"
Jul 11 04:21:24.324952 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.324893    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598"} err="failed to get container status \"48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598\": rpc error: code = NotFound desc = could not find container \"48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598\": container with ID starting with 48b404d88fe74b7a0f615c54d5a6d1106d27a3058167e0581f0b8f1b73655598 not found: ID does not exist"
Jul 11 04:21:24.324952 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.324915    2576 scope.go:117] "RemoveContainer" containerID="c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5"
Jul 11 04:21:24.325226 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:21:24.325207    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5\": container with ID starting with c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5 not found: ID does not exist" containerID="c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5"
Jul 11 04:21:24.325288 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.325236    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5"} err="failed to get container status \"c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5\": rpc error: code = NotFound desc = could not find container \"c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5\": container with ID starting with c10f1a305d61c1b1712b0e4baed9e82ce0a57e8ac3318725761aa6aca01b3ed5 not found: ID does not exist"
Jul 11 04:21:24.327192 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.327172    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"]
Jul 11 04:21:24.330514 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:24.330494    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-31ee349a-openshift-default-69657bf74c-q728j"]
Jul 11 04:21:25.477265 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:25.477230    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" path="/var/lib/kubelet/pods/6051bcbf-b952-4d40-ab33-b2a0674fb5e2/volumes"
Jul 11 04:21:37.469001 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.468950    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"]
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469304    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c6895bd-06fe-4655-998d-c055dce0f731" containerName="revoke-keys"
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469318    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c6895bd-06fe-4655-998d-c055dce0f731" containerName="revoke-keys"
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469358    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy"
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469365    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy"
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469372    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea837bcf-457f-45ee-9a3d-3a8f44b446a0" containerName="maas-api"
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469377    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea837bcf-457f-45ee-9a3d-3a8f44b446a0" containerName="maas-api"
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469394    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy"
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469399    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy"
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469484    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c6895bd-06fe-4655-998d-c055dce0f731" containerName="revoke-keys"
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469502    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea837bcf-457f-45ee-9a3d-3a8f44b446a0" containerName="maas-api"
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469514    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy"
Jul 11 04:21:37.469643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.469523    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6051bcbf-b952-4d40-ab33-b2a0674fb5e2" containerName="istio-proxy"
Jul 11 04:21:37.474350 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.474305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.476992 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.476960    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c9f692c9-openshift-default-dockercfg-bhcx6\""
Jul 11 04:21:37.498517 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.498488    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"]
Jul 11 04:21:37.524131 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.524098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f2w9\" (UniqueName: \"kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-kube-api-access-8f2w9\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.524239 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.524150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-envoy\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.524292 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.524240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-podinfo\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.524292 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.524268    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-token\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.524292 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.524289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-socket\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.524415 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.524382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-certs\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.524415 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.524409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-credential-socket\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.524482 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.524431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istiod-ca-cert\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.524524 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.524487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-data\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.625858 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.625825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-certs\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.625858 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.625862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-credential-socket\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626071 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.625884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istiod-ca-cert\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626071 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.625919    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-data\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626071 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.625950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2w9\" (UniqueName: \"kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-kube-api-access-8f2w9\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626071 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.626004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-envoy\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626071 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.626043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-podinfo\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626071 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.626067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-token\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626348 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.626097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-socket\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626348 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.626290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-credential-socket\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626348 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.626322    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-certs\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626505 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.626462    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-data\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626566 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.626519    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-socket\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.626795 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.626777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istiod-ca-cert\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.628538 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.628517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-envoy\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.628687 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.628669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-podinfo\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.647010 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.646988    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-token\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.647471 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.647454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f2w9\" (UniqueName: \"kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-kube-api-access-8f2w9\") pod \"e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") " pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.785696 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.785661    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:37.930414 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.930389    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"]
Jul 11 04:21:37.931288 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:21:37.931261    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf7c2d0_af94_49d6_9fe3_5c893db0f96e.slice/crio-2748f005680332a19bf265a9344add2b3fbd0b71de5e943dcb38e3300c769ff7 WatchSource:0}: Error finding container 2748f005680332a19bf265a9344add2b3fbd0b71de5e943dcb38e3300c769ff7: Status 404 returned error can't find the container with id 2748f005680332a19bf265a9344add2b3fbd0b71de5e943dcb38e3300c769ff7
Jul 11 04:21:37.933202 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.933174    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:21:37.933274 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.933235    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:21:37.933274 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:37.933263    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:21:38.392940 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:38.392900    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" event={"ID":"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e","Type":"ContainerStarted","Data":"7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30"}
Jul 11 04:21:38.393123 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:38.392952    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" event={"ID":"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e","Type":"ContainerStarted","Data":"2748f005680332a19bf265a9344add2b3fbd0b71de5e943dcb38e3300c769ff7"}
Jul 11 04:21:38.413184 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:38.413132    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" podStartSLOduration=1.413116005 podStartE2EDuration="1.413116005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:21:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:21:38.410519221 +0000 UTC m=+1971.595671676" watchObservedRunningTime="2026-07-11 04:21:38.413116005 +0000 UTC m=+1971.598268459"
Jul 11 04:21:38.786322 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:38.786294    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:38.791136 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:38.791109    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:39.398957 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:39.398923    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:39.399997 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:39.399980    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:40.413832 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.413799    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"]
Jul 11 04:21:40.417841 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.417821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:40.420135 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.420115    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c9f692c9-serving-cert\""
Jul 11 04:21:40.420255 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.420237    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-drsms\""
Jul 11 04:21:40.427960 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.427934    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"]
Jul 11 04:21:40.455302 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.455264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36677a2-cd24-42c2-a711-3e51c79a598c-openshift-service-ca\") pod \"maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:40.455486 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.455348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36677a2-cd24-42c2-a711-3e51c79a598c-maas-api-tls\") pod \"maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:40.455486 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.455419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fkhh\" (UniqueName: \"kubernetes.io/projected/d36677a2-cd24-42c2-a711-3e51c79a598c-kube-api-access-5fkhh\") pod \"maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:40.556052 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.556013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36677a2-cd24-42c2-a711-3e51c79a598c-openshift-service-ca\") pod \"maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:40.556261 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.556235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36677a2-cd24-42c2-a711-3e51c79a598c-maas-api-tls\") pod \"maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:40.556381 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.556355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fkhh\" (UniqueName: \"kubernetes.io/projected/d36677a2-cd24-42c2-a711-3e51c79a598c-kube-api-access-5fkhh\") pod \"maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:40.556460 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:21:40.556384    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-serving-cert: secret "maas-api-e2e-mt-c9f692c9-serving-cert" not found
Jul 11 04:21:40.556460 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:21:40.556456    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d36677a2-cd24-42c2-a711-3e51c79a598c-maas-api-tls podName:d36677a2-cd24-42c2-a711-3e51c79a598c nodeName:}" failed. No retries permitted until 2026-07-11 04:21:41.056433278 +0000 UTC m=+1974.241585715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d36677a2-cd24-42c2-a711-3e51c79a598c-maas-api-tls") pod "maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t" (UID: "d36677a2-cd24-42c2-a711-3e51c79a598c") : secret "maas-api-e2e-mt-c9f692c9-serving-cert" not found
Jul 11 04:21:40.556850 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.556822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36677a2-cd24-42c2-a711-3e51c79a598c-openshift-service-ca\") pod \"maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:40.563915 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:40.563892    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fkhh\" (UniqueName: \"kubernetes.io/projected/d36677a2-cd24-42c2-a711-3e51c79a598c-kube-api-access-5fkhh\") pod \"maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:41.064132 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:41.064085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36677a2-cd24-42c2-a711-3e51c79a598c-maas-api-tls\") pod \"maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:41.066526 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:41.066500    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36677a2-cd24-42c2-a711-3e51c79a598c-maas-api-tls\") pod \"maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:41.330358 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:41.330250    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:41.467014 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:41.466984    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"]
Jul 11 04:21:41.468553 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:21:41.468533    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36677a2_cd24_42c2_a711_3e51c79a598c.slice/crio-207718e83e5f40dfac3cd05fdbef27d0ba579da1d0f807b81e44bb91faecc9db WatchSource:0}: Error finding container 207718e83e5f40dfac3cd05fdbef27d0ba579da1d0f807b81e44bb91faecc9db: Status 404 returned error can't find the container with id 207718e83e5f40dfac3cd05fdbef27d0ba579da1d0f807b81e44bb91faecc9db
Jul 11 04:21:42.416996 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:42.416950    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t" event={"ID":"d36677a2-cd24-42c2-a711-3e51c79a598c","Type":"ContainerStarted","Data":"84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510"}
Jul 11 04:21:42.417175 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:42.417019    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t" event={"ID":"d36677a2-cd24-42c2-a711-3e51c79a598c","Type":"ContainerStarted","Data":"207718e83e5f40dfac3cd05fdbef27d0ba579da1d0f807b81e44bb91faecc9db"}
Jul 11 04:21:42.417175 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:42.417072    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:42.433762 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:42.433714    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t" podStartSLOduration=2.08204321 podStartE2EDuration="2.433700417s" totalImagesPullingTime="351.657207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:21:42.432933791 +0000 UTC m=+1975.618086248" watchObservedRunningTime="2026-07-11 04:21:42.433700417 +0000 UTC m=+1975.618852871"
Jul 11 04:21:47.549136 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:47.549102    2576 scope.go:117] "RemoveContainer" containerID="9d5f7537d68f45c466e117a1e26676f7b9e651ab2f6f5d0cbe0bc6c26d346ff8"
Jul 11 04:21:47.568620 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:47.559960    2576 scope.go:117] "RemoveContainer" containerID="ea09d41d79b7cf10105963045019388d35663b6bfb8fb6b82b82e4710eb2b650"
Jul 11 04:21:48.427837 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:48.427760    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:21:51.470803 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:51.470771    2576 generic.go:356] "Generic (PLEG): container finished" podID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerID="7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30" exitCode=0
Jul 11 04:21:51.471244 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:51.470847    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" event={"ID":"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e","Type":"ContainerDied","Data":"7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30"}
Jul 11 04:21:51.471298 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:51.471251    2576 scope.go:117] "RemoveContainer" containerID="7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30"
Jul 11 04:21:51.472339 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:51.472300    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:21:51.472424 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:51.472406    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:21:51.472473 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:51.472457    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:21:52.481374 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:52.481302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" event={"ID":"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e","Type":"ContainerStarted","Data":"d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26"}
Jul 11 04:21:52.786194 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:52.786147    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:52.787409 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:52.787379    2576 patch_prober.go:28] interesting pod/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 11 04:21:52.787540 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:52.787431    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 11 04:21:53.786174 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:53.786138    2576 patch_prober.go:28] interesting pod/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 11 04:21:53.786573 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:53.786190    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 11 04:21:54.399570 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:54.399525    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:54.786725 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:54.786689    2576 patch_prober.go:28] interesting pod/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 11 04:21:54.787118 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:54.786747    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 11 04:21:55.786816 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:55.786775    2576 patch_prober.go:28] interesting pod/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 11 04:21:55.787205 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:55.786833    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 11 04:21:56.790284 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:56.790244    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:21:56.791149 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:21:56.791127    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:22:12.881320 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:12.881278    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7"]
Jul 11 04:22:12.884787 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:12.884770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7"
Jul 11 04:22:12.887548 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:12.887523    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:22:12.890860 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:12.890838    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7"]
Jul 11 04:22:12.953025 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:12.952982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62cd1f99-af82-488d-9972-0ebd74619f7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7\" (UID: \"62cd1f99-af82-488d-9972-0ebd74619f7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7"
Jul 11 04:22:13.053638 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:13.053604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62cd1f99-af82-488d-9972-0ebd74619f7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7\" (UID: \"62cd1f99-af82-488d-9972-0ebd74619f7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7"
Jul 11 04:22:13.054216 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:13.054196    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62cd1f99-af82-488d-9972-0ebd74619f7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7\" (UID: \"62cd1f99-af82-488d-9972-0ebd74619f7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7"
Jul 11 04:22:13.197114 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:13.197026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7"
Jul 11 04:22:13.331813 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:13.331787    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7"]
Jul 11 04:22:13.333084 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:22:13.333058    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62cd1f99_af82_488d_9972_0ebd74619f7f.slice/crio-1a849e7b622b383c0861600fa0f9149a63ff0421a3ece68beb6d1957763f9313 WatchSource:0}: Error finding container 1a849e7b622b383c0861600fa0f9149a63ff0421a3ece68beb6d1957763f9313: Status 404 returned error can't find the container with id 1a849e7b622b383c0861600fa0f9149a63ff0421a3ece68beb6d1957763f9313
Jul 11 04:22:13.605427 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:13.605386    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7" event={"ID":"62cd1f99-af82-488d-9972-0ebd74619f7f","Type":"ContainerStarted","Data":"1a849e7b622b383c0861600fa0f9149a63ff0421a3ece68beb6d1957763f9313"}
Jul 11 04:22:14.612013 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:14.611978    2576 generic.go:356] "Generic (PLEG): container finished" podID="62cd1f99-af82-488d-9972-0ebd74619f7f" containerID="4a694025dcf4dd9c66e073d7ab09dae7421f8d02d1f8475ebdc546a3a3ba9fa0" exitCode=0
Jul 11 04:22:14.612402 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:14.612064    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7" event={"ID":"62cd1f99-af82-488d-9972-0ebd74619f7f","Type":"ContainerDied","Data":"4a694025dcf4dd9c66e073d7ab09dae7421f8d02d1f8475ebdc546a3a3ba9fa0"}
Jul 11 04:22:15.743788 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:15.743765    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7"
Jul 11 04:22:15.772200 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:15.772171    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62cd1f99-af82-488d-9972-0ebd74619f7f-maas-api-service-ca\") pod \"62cd1f99-af82-488d-9972-0ebd74619f7f\" (UID: \"62cd1f99-af82-488d-9972-0ebd74619f7f\") "
Jul 11 04:22:15.772539 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:15.772516    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62cd1f99-af82-488d-9972-0ebd74619f7f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "62cd1f99-af82-488d-9972-0ebd74619f7f" (UID: "62cd1f99-af82-488d-9972-0ebd74619f7f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:22:15.873130 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:15.873039    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62cd1f99-af82-488d-9972-0ebd74619f7f-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:22:16.625109 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:16.625078    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7"
Jul 11 04:22:16.625298 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:16.625114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7" event={"ID":"62cd1f99-af82-488d-9972-0ebd74619f7f","Type":"ContainerDied","Data":"1a849e7b622b383c0861600fa0f9149a63ff0421a3ece68beb6d1957763f9313"}
Jul 11 04:22:16.625298 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:16.625171    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a849e7b622b383c0861600fa0f9149a63ff0421a3ece68beb6d1957763f9313"
Jul 11 04:22:23.342650 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.342610    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"]
Jul 11 04:22:23.343112 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.342857    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t" podUID="d36677a2-cd24-42c2-a711-3e51c79a598c" containerName="maas-api" containerID="cri-o://84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510" gracePeriod=30
Jul 11 04:22:23.422599 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.422555    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t" podUID="d36677a2-cd24-42c2-a711-3e51c79a598c" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.60:8443/health\": dial tcp 10.133.0.60:8443: connect: connection refused"
Jul 11 04:22:23.595560 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.595501    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:22:23.641812 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.641781    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36677a2-cd24-42c2-a711-3e51c79a598c-maas-api-tls\") pod \"d36677a2-cd24-42c2-a711-3e51c79a598c\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") "
Jul 11 04:22:23.641976 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.641834    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fkhh\" (UniqueName: \"kubernetes.io/projected/d36677a2-cd24-42c2-a711-3e51c79a598c-kube-api-access-5fkhh\") pod \"d36677a2-cd24-42c2-a711-3e51c79a598c\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") "
Jul 11 04:22:23.641976 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.641859    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36677a2-cd24-42c2-a711-3e51c79a598c-openshift-service-ca\") pod \"d36677a2-cd24-42c2-a711-3e51c79a598c\" (UID: \"d36677a2-cd24-42c2-a711-3e51c79a598c\") "
Jul 11 04:22:23.642257 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.642229    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36677a2-cd24-42c2-a711-3e51c79a598c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d36677a2-cd24-42c2-a711-3e51c79a598c" (UID: "d36677a2-cd24-42c2-a711-3e51c79a598c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:22:23.643925 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.643893    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36677a2-cd24-42c2-a711-3e51c79a598c-kube-api-access-5fkhh" (OuterVolumeSpecName: "kube-api-access-5fkhh") pod "d36677a2-cd24-42c2-a711-3e51c79a598c" (UID: "d36677a2-cd24-42c2-a711-3e51c79a598c"). InnerVolumeSpecName "kube-api-access-5fkhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:22:23.644011 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.643927    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36677a2-cd24-42c2-a711-3e51c79a598c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d36677a2-cd24-42c2-a711-3e51c79a598c" (UID: "d36677a2-cd24-42c2-a711-3e51c79a598c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:22:23.668086 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.668058    2576 generic.go:356] "Generic (PLEG): container finished" podID="d36677a2-cd24-42c2-a711-3e51c79a598c" containerID="84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510" exitCode=0
Jul 11 04:22:23.668188 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.668103    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"
Jul 11 04:22:23.668188 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.668114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t" event={"ID":"d36677a2-cd24-42c2-a711-3e51c79a598c","Type":"ContainerDied","Data":"84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510"}
Jul 11 04:22:23.668188 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.668154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t" event={"ID":"d36677a2-cd24-42c2-a711-3e51c79a598c","Type":"ContainerDied","Data":"207718e83e5f40dfac3cd05fdbef27d0ba579da1d0f807b81e44bb91faecc9db"}
Jul 11 04:22:23.668188 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.668175    2576 scope.go:117] "RemoveContainer" containerID="84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510"
Jul 11 04:22:23.677370 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.677353    2576 scope.go:117] "RemoveContainer" containerID="84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510"
Jul 11 04:22:23.677619 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:22:23.677598    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510\": container with ID starting with 84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510 not found: ID does not exist" containerID="84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510"
Jul 11 04:22:23.677664 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.677627    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510"} err="failed to get container status \"84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510\": rpc error: code = NotFound desc = could not find container \"84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510\": container with ID starting with 84ffd0c9855f2bca4f7301f77aca157f2bbe415b4357707fd00bf35ddcba7510 not found: ID does not exist"
Jul 11 04:22:23.688943 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.688917    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"]
Jul 11 04:22:23.692768 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.692745    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c9f692c9-757d5ffdc8-sl45t"]
Jul 11 04:22:23.742415 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.742385    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36677a2-cd24-42c2-a711-3e51c79a598c-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:22:23.742415 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.742411    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fkhh\" (UniqueName: \"kubernetes.io/projected/d36677a2-cd24-42c2-a711-3e51c79a598c-kube-api-access-5fkhh\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:22:23.742568 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:23.742424    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36677a2-cd24-42c2-a711-3e51c79a598c-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:22:25.477815 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:25.477781    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d36677a2-cd24-42c2-a711-3e51c79a598c" path="/var/lib/kubelet/pods/d36677a2-cd24-42c2-a711-3e51c79a598c/volumes"
Jul 11 04:22:47.607483 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:47.607450    2576 scope.go:117] "RemoveContainer" containerID="00c24bb671cf154bc78fdd63f7ea739894f72ab814a9087d17d2db5ebf2d8641"
Jul 11 04:22:47.615998 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:22:47.615979    2576 scope.go:117] "RemoveContainer" containerID="d6653ac84033cbfb7664fcf570696ef9714651af845b593478c49462572b16f8"
Jul 11 04:23:30.256373 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:30.256321    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"]
Jul 11 04:23:30.256926 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:30.256588    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerName="istio-proxy" containerID="cri-o://d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26" gracePeriod=30
Jul 11 04:23:35.510661 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.510634    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:23:35.569539 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.569499    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-podinfo\") pod \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") "
Jul 11 04:23:35.569539 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.569535    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-token\") pod \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") "
Jul 11 04:23:35.569811 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.569555    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-certs\") pod \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") "
Jul 11 04:23:35.569811 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.569586    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-credential-socket\") pod \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") "
Jul 11 04:23:35.569811 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.569619    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f2w9\" (UniqueName: \"kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-kube-api-access-8f2w9\") pod \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") "
Jul 11 04:23:35.569811 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.569673    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-socket\") pod \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") "
Jul 11 04:23:35.569811 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.569705    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-envoy\") pod \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") "
Jul 11 04:23:35.569811 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.569730    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-data\") pod \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") "
Jul 11 04:23:35.569811 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.569777    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istiod-ca-cert\") pod \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\" (UID: \"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e\") "
Jul 11 04:23:35.570176 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.569878    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" (UID: "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:23:35.570176 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.569960    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" (UID: "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:23:35.570176 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.570070    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-certs\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:23:35.570176 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.570114    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-credential-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:23:35.570423 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.570237    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" (UID: "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:23:35.570423 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.570244    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" (UID: "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:23:35.570658 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.570638    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-data" (OuterVolumeSpecName: "istio-data") pod "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" (UID: "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:23:35.571930 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.571904    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" (UID: "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:23:35.572038 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.572008    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-token" (OuterVolumeSpecName: "istio-token") pod "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" (UID: "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:23:35.572232 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.572211    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-kube-api-access-8f2w9" (OuterVolumeSpecName: "kube-api-access-8f2w9") pod "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" (UID: "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e"). InnerVolumeSpecName "kube-api-access-8f2w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:23:35.572291 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.572272    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" (UID: "fdf7c2d0-af94-49d6-9fe3-5c893db0f96e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:23:35.671170 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.671127    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istiod-ca-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:23:35.671170 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.671160    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-podinfo\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:23:35.671170 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.671169    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-token\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:23:35.671170 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.671179    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f2w9\" (UniqueName: \"kubernetes.io/projected/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-kube-api-access-8f2w9\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:23:35.671480 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.671192    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-workload-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:23:35.671480 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.671200    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-envoy\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:23:35.671480 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:35.671209    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e-istio-data\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:23:36.067916 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.067871    2576 generic.go:356] "Generic (PLEG): container finished" podID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerID="d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26" exitCode=0
Jul 11 04:23:36.068159 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.067929    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"
Jul 11 04:23:36.068159 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.067956    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" event={"ID":"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e","Type":"ContainerDied","Data":"d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26"}
Jul 11 04:23:36.068159 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.068018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl" event={"ID":"fdf7c2d0-af94-49d6-9fe3-5c893db0f96e","Type":"ContainerDied","Data":"2748f005680332a19bf265a9344add2b3fbd0b71de5e943dcb38e3300c769ff7"}
Jul 11 04:23:36.068159 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.068042    2576 scope.go:117] "RemoveContainer" containerID="d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26"
Jul 11 04:23:36.077832 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.077811    2576 scope.go:117] "RemoveContainer" containerID="7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30"
Jul 11 04:23:36.087264 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.086827    2576 scope.go:117] "RemoveContainer" containerID="d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26"
Jul 11 04:23:36.087264 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:23:36.087203    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26\": container with ID starting with d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26 not found: ID does not exist" containerID="d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26"
Jul 11 04:23:36.087264 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.087234    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26"} err="failed to get container status \"d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26\": rpc error: code = NotFound desc = could not find container \"d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26\": container with ID starting with d764b71efd91fe26c9fb642d358c43eb11b080fd4208dfc2debcad88880f9e26 not found: ID does not exist"
Jul 11 04:23:36.087264 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.087255    2576 scope.go:117] "RemoveContainer" containerID="7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30"
Jul 11 04:23:36.087681 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:23:36.087656    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30\": container with ID starting with 7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30 not found: ID does not exist" containerID="7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30"
Jul 11 04:23:36.087746 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.087690    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30"} err="failed to get container status \"7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30\": rpc error: code = NotFound desc = could not find container \"7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30\": container with ID starting with 7abfdbd6b6fcdb398519645b5f884aca2df292a89e2c87229499ae64aa29bc30 not found: ID does not exist"
Jul 11 04:23:36.090109 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.090089    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"]
Jul 11 04:23:36.093288 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:36.093263    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c9f692c9-openshift-default-68c785bb8c-7k4zl"]
Jul 11 04:23:37.477552 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:23:37.477517    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" path="/var/lib/kubelet/pods/fdf7c2d0-af94-49d6-9fe3-5c893db0f96e/volumes"
Jul 11 04:24:24.536492 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.536447    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"]
Jul 11 04:24:24.537048 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.536948    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62cd1f99-af82-488d-9972-0ebd74619f7f" containerName="revoke-keys"
Jul 11 04:24:24.537048 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.536979    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="62cd1f99-af82-488d-9972-0ebd74619f7f" containerName="revoke-keys"
Jul 11 04:24:24.537048 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.536996    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36677a2-cd24-42c2-a711-3e51c79a598c" containerName="maas-api"
Jul 11 04:24:24.537048 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.537002    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36677a2-cd24-42c2-a711-3e51c79a598c" containerName="maas-api"
Jul 11 04:24:24.537048 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.537017    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerName="istio-proxy"
Jul 11 04:24:24.537048 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.537022    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerName="istio-proxy"
Jul 11 04:24:24.537048 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.537030    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerName="istio-proxy"
Jul 11 04:24:24.537048 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.537039    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerName="istio-proxy"
Jul 11 04:24:24.537461 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.537095    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerName="istio-proxy"
Jul 11 04:24:24.537461 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.537104    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="62cd1f99-af82-488d-9972-0ebd74619f7f" containerName="revoke-keys"
Jul 11 04:24:24.537461 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.537110    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdf7c2d0-af94-49d6-9fe3-5c893db0f96e" containerName="istio-proxy"
Jul 11 04:24:24.537461 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.537121    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d36677a2-cd24-42c2-a711-3e51c79a598c" containerName="maas-api"
Jul 11 04:24:24.540200 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.540182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.542781 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.542761    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-93c505-openshift-default-dockercfg-s59jl\""
Jul 11 04:24:24.549557 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.549533    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"]
Jul 11 04:24:24.696605 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.696566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-credential-socket\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.696605 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.696609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-envoy\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.696822 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.696650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-istio-token\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.696822 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.696676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp488\" (UniqueName: \"kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-kube-api-access-pp488\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.696822 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.696703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-data\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.696822 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.696782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-socket\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.696822 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.696812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/810b2238-8fab-4415-a14b-035fa0c9033f-istio-podinfo\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.696992 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.696835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-certs\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.696992 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.696858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/810b2238-8fab-4415-a14b-035fa0c9033f-istiod-ca-cert\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.797374 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.797275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/810b2238-8fab-4415-a14b-035fa0c9033f-istiod-ca-cert\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.797374 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.797317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-credential-socket\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.797374 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.797361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-envoy\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.797653 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.797392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-istio-token\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.797653 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.797417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp488\" (UniqueName: \"kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-kube-api-access-pp488\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.797653 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.797447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-data\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.797653 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.797496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-socket\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.797653 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.797522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/810b2238-8fab-4415-a14b-035fa0c9033f-istio-podinfo\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.797885 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.797708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-certs\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.797885 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.797740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-credential-socket\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.798021 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.798005    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-socket\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.798156 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.798139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-data\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.798240 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.798219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-certs\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.798460 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.798440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/810b2238-8fab-4415-a14b-035fa0c9033f-istiod-ca-cert\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.799632 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.799613    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-envoy\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.800264 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.800238    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/810b2238-8fab-4415-a14b-035fa0c9033f-istio-podinfo\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.805002 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.804974    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp488\" (UniqueName: \"kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-kube-api-access-pp488\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.805384 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.805365    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-istio-token\") pod \"e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") " pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.851559 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.851525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:24.989532 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.989498    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"]
Jul 11 04:24:24.990146 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:24:24.990120    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810b2238_8fab_4415_a14b_035fa0c9033f.slice/crio-0240634ccc604261a42130a2b91704fe8db3ac07376e91d12ed741d10505d2c2 WatchSource:0}: Error finding container 0240634ccc604261a42130a2b91704fe8db3ac07376e91d12ed741d10505d2c2: Status 404 returned error can't find the container with id 0240634ccc604261a42130a2b91704fe8db3ac07376e91d12ed741d10505d2c2
Jul 11 04:24:24.992248 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.992214    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:24:24.992371 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.992292    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:24:24.992444 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:24.992376    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:24:25.336551 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:25.336510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" event={"ID":"810b2238-8fab-4415-a14b-035fa0c9033f","Type":"ContainerStarted","Data":"2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a"}
Jul 11 04:24:25.336758 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:25.336572    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" event={"ID":"810b2238-8fab-4415-a14b-035fa0c9033f","Type":"ContainerStarted","Data":"0240634ccc604261a42130a2b91704fe8db3ac07376e91d12ed741d10505d2c2"}
Jul 11 04:24:25.357213 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:25.357163    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" podStartSLOduration=1.357147977 podStartE2EDuration="1.357147977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:24:25.3540233 +0000 UTC m=+2138.539175791" watchObservedRunningTime="2026-07-11 04:24:25.357147977 +0000 UTC m=+2138.542300433"
Jul 11 04:24:25.852174 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:25.852138    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:26.856872 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:26.856833    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:27.332836 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.332799    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"]
Jul 11 04:24:27.336712 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.336688    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:27.339189 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.339168    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-93c505-serving-cert\""
Jul 11 04:24:27.339310 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.339168    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-drsms\""
Jul 11 04:24:27.347001 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.346978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"]
Jul 11 04:24:27.350227 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.350203    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:27.351020 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.351000    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:27.424358 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.424302    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9zx\" (UniqueName: \"kubernetes.io/projected/73005d68-176f-45f3-bf68-f07651f2aeb7-kube-api-access-jm9zx\") pod \"maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:27.424553 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.424409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73005d68-176f-45f3-bf68-f07651f2aeb7-maas-api-tls\") pod \"maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:27.424553 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.424501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73005d68-176f-45f3-bf68-f07651f2aeb7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:27.525579 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.525540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9zx\" (UniqueName: \"kubernetes.io/projected/73005d68-176f-45f3-bf68-f07651f2aeb7-kube-api-access-jm9zx\") pod \"maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:27.525579 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.525583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73005d68-176f-45f3-bf68-f07651f2aeb7-maas-api-tls\") pod \"maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:27.525837 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:24:27.525688    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-serving-cert: secret "maas-api-e2e-inf-a-93c505-serving-cert" not found
Jul 11 04:24:27.525837 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.525720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73005d68-176f-45f3-bf68-f07651f2aeb7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:27.525837 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:24:27.525740    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73005d68-176f-45f3-bf68-f07651f2aeb7-maas-api-tls podName:73005d68-176f-45f3-bf68-f07651f2aeb7 nodeName:}" failed. No retries permitted until 2026-07-11 04:24:28.025721973 +0000 UTC m=+2141.210874406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/73005d68-176f-45f3-bf68-f07651f2aeb7-maas-api-tls") pod "maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c" (UID: "73005d68-176f-45f3-bf68-f07651f2aeb7") : secret "maas-api-e2e-inf-a-93c505-serving-cert" not found
Jul 11 04:24:27.526353 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.526305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73005d68-176f-45f3-bf68-f07651f2aeb7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:27.534914 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:27.534893    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9zx\" (UniqueName: \"kubernetes.io/projected/73005d68-176f-45f3-bf68-f07651f2aeb7-kube-api-access-jm9zx\") pod \"maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:28.030634 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:28.030601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73005d68-176f-45f3-bf68-f07651f2aeb7-maas-api-tls\") pod \"maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:28.033118 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:28.033090    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73005d68-176f-45f3-bf68-f07651f2aeb7-maas-api-tls\") pod \"maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:28.249933 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:28.249896    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:28.383573 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:28.383545    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"]
Jul 11 04:24:28.384412 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:24:28.384388    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73005d68_176f_45f3_bf68_f07651f2aeb7.slice/crio-0dfe586983b2bd4205273c67288252a87c4bb1f523cd5870d5db3cc5aba42552 WatchSource:0}: Error finding container 0dfe586983b2bd4205273c67288252a87c4bb1f523cd5870d5db3cc5aba42552: Status 404 returned error can't find the container with id 0dfe586983b2bd4205273c67288252a87c4bb1f523cd5870d5db3cc5aba42552
Jul 11 04:24:29.361985 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:29.361950    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c" event={"ID":"73005d68-176f-45f3-bf68-f07651f2aeb7","Type":"ContainerStarted","Data":"eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca"}
Jul 11 04:24:29.362406 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:29.362000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c" event={"ID":"73005d68-176f-45f3-bf68-f07651f2aeb7","Type":"ContainerStarted","Data":"0dfe586983b2bd4205273c67288252a87c4bb1f523cd5870d5db3cc5aba42552"}
Jul 11 04:24:29.362406 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:29.362184    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:29.380163 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:29.380115    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c" podStartSLOduration=1.92405111 podStartE2EDuration="2.380100857s" totalImagesPullingTime="456.049747ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:24:29.377102191 +0000 UTC m=+2142.562254661" watchObservedRunningTime="2026-07-11 04:24:29.380100857 +0000 UTC m=+2142.565253312"
Jul 11 04:24:35.372529 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:35.372497    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:24:35.876351 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:35.875315    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"]
Jul 11 04:24:35.885353 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:35.883511    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:35.887185 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:35.886710    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6c0c56-serving-cert\""
Jul 11 04:24:35.889481 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:35.889299    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"]
Jul 11 04:24:36.006210 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.006175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7982afcb-cc7e-41e8-b9eb-5713cb845f28-maas-api-tls\") pod \"maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:36.006423 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.006311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v4c6\" (UniqueName: \"kubernetes.io/projected/7982afcb-cc7e-41e8-b9eb-5713cb845f28-kube-api-access-2v4c6\") pod \"maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:36.006423 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.006383    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7982afcb-cc7e-41e8-b9eb-5713cb845f28-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:36.107505 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.107463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7982afcb-cc7e-41e8-b9eb-5713cb845f28-maas-api-tls\") pod \"maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:36.107713 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.107557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v4c6\" (UniqueName: \"kubernetes.io/projected/7982afcb-cc7e-41e8-b9eb-5713cb845f28-kube-api-access-2v4c6\") pod \"maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:36.107713 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.107585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7982afcb-cc7e-41e8-b9eb-5713cb845f28-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:36.108222 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.108199    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7982afcb-cc7e-41e8-b9eb-5713cb845f28-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:36.109847 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.109827    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7982afcb-cc7e-41e8-b9eb-5713cb845f28-maas-api-tls\") pod \"maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:36.115051 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.115027    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v4c6\" (UniqueName: \"kubernetes.io/projected/7982afcb-cc7e-41e8-b9eb-5713cb845f28-kube-api-access-2v4c6\") pod \"maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:36.199373 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.199264    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:36.379870 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.379827    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"]
Jul 11 04:24:36.401797 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:36.401761    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw" event={"ID":"7982afcb-cc7e-41e8-b9eb-5713cb845f28","Type":"ContainerStarted","Data":"a52c47357829cfb5bfec189b13dbc74207535df0921a105f0dee9bcf7729cc2a"}
Jul 11 04:24:37.408501 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:37.408460    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw" event={"ID":"7982afcb-cc7e-41e8-b9eb-5713cb845f28","Type":"ContainerStarted","Data":"c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba"}
Jul 11 04:24:37.408977 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:37.408541    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:37.425573 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:37.425525    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw" podStartSLOduration=1.972780931 podStartE2EDuration="2.425507013s" totalImagesPullingTime="452.726082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:24:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:24:37.423561753 +0000 UTC m=+2150.608714207" watchObservedRunningTime="2026-07-11 04:24:37.425507013 +0000 UTC m=+2150.610659467"
Jul 11 04:24:42.642698 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:42.641696    2576 patch_prober.go:28] interesting pod/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": read tcp 10.133.0.2:47924->10.133.0.62:15021: read: connection reset by peer" start-of-body=
Jul 11 04:24:42.642698 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:42.641762    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": read tcp 10.133.0.2:47924->10.133.0.62:15021: read: connection reset by peer"
Jul 11 04:24:43.419296 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:43.419266    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:24:43.446263 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:43.446217    2576 generic.go:356] "Generic (PLEG): container finished" podID="810b2238-8fab-4415-a14b-035fa0c9033f" containerID="2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a" exitCode=0
Jul 11 04:24:43.446473 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:43.446286    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" event={"ID":"810b2238-8fab-4415-a14b-035fa0c9033f","Type":"ContainerDied","Data":"2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a"}
Jul 11 04:24:43.446738 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:43.446721    2576 scope.go:117] "RemoveContainer" containerID="2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a"
Jul 11 04:24:43.447861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:43.447833    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:24:43.447926 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:43.447898    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:24:43.447963 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:43.447930    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:24:44.459803 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:44.458894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" event={"ID":"810b2238-8fab-4415-a14b-035fa0c9033f","Type":"ContainerStarted","Data":"871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c"}
Jul 11 04:24:44.852241 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:44.852198    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:44.852488 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:44.852464    2576 patch_prober.go:28] interesting pod/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 11 04:24:44.852539 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:44.852516    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 11 04:24:45.852486 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:45.852449    2576 patch_prober.go:28] interesting pod/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 11 04:24:45.852888 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:45.852507    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 11 04:24:46.852460 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:46.852423    2576 patch_prober.go:28] interesting pod/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 11 04:24:46.852648 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:46.852476    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 11 04:24:47.660308 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:47.660270    2576 scope.go:117] "RemoveContainer" containerID="afef45af41a908451622154e2525e7871d55b63a29d346c4d27adc8e5ff9d6f8"
Jul 11 04:24:47.852503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:47.852463    2576 patch_prober.go:28] interesting pod/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 11 04:24:47.852697 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:47.852522    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 11 04:24:48.855491 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:48.855459    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:48.855883 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:48.855792    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:24:48.856564 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:24:48.856548    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:25:34.742085 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:34.742049    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw"]
Jul 11 04:25:34.745580 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:34.745561    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw"
Jul 11 04:25:34.748048 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:34.748025    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:25:34.751601 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:34.751577    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw"]
Jul 11 04:25:34.914757 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:34.914723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47fcad0b-43a2-4d19-8237-e5493895373e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw\" (UID: \"47fcad0b-43a2-4d19-8237-e5493895373e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw"
Jul 11 04:25:35.016184 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:35.016097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47fcad0b-43a2-4d19-8237-e5493895373e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw\" (UID: \"47fcad0b-43a2-4d19-8237-e5493895373e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw"
Jul 11 04:25:35.016882 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:35.016860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47fcad0b-43a2-4d19-8237-e5493895373e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw\" (UID: \"47fcad0b-43a2-4d19-8237-e5493895373e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw"
Jul 11 04:25:35.058929 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:35.058888    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw"
Jul 11 04:25:35.206889 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:35.206858    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw"]
Jul 11 04:25:35.207079 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:25:35.207054    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47fcad0b_43a2_4d19_8237_e5493895373e.slice/crio-f8ca894905489ec2958b261d0a1ee6b1e6f45249439da672ea3ef4487539a26e WatchSource:0}: Error finding container f8ca894905489ec2958b261d0a1ee6b1e6f45249439da672ea3ef4487539a26e: Status 404 returned error can't find the container with id f8ca894905489ec2958b261d0a1ee6b1e6f45249439da672ea3ef4487539a26e
Jul 11 04:25:35.760972 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:35.760877    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw" event={"ID":"47fcad0b-43a2-4d19-8237-e5493895373e","Type":"ContainerStarted","Data":"c0d19afb9137c3108dc8aec3f2d40a64127b5f9f7a3adb7ee2b09f28642a009d"}
Jul 11 04:25:35.760972 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:35.760928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw" event={"ID":"47fcad0b-43a2-4d19-8237-e5493895373e","Type":"ContainerStarted","Data":"f8ca894905489ec2958b261d0a1ee6b1e6f45249439da672ea3ef4487539a26e"}
Jul 11 04:25:35.775169 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:35.775124    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw" podStartSLOduration=1.775109357 podStartE2EDuration="1.775109357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:25:35.773824484 +0000 UTC m=+2208.958976956" watchObservedRunningTime="2026-07-11 04:25:35.775109357 +0000 UTC m=+2208.960261855"
Jul 11 04:25:36.767991 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:36.767958    2576 generic.go:356] "Generic (PLEG): container finished" podID="47fcad0b-43a2-4d19-8237-e5493895373e" containerID="c0d19afb9137c3108dc8aec3f2d40a64127b5f9f7a3adb7ee2b09f28642a009d" exitCode=0
Jul 11 04:25:36.768384 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:36.768025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw" event={"ID":"47fcad0b-43a2-4d19-8237-e5493895373e","Type":"ContainerDied","Data":"c0d19afb9137c3108dc8aec3f2d40a64127b5f9f7a3adb7ee2b09f28642a009d"}
Jul 11 04:25:37.902375 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:37.902343    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw"
Jul 11 04:25:38.042083 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:38.042007    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47fcad0b-43a2-4d19-8237-e5493895373e-maas-api-service-ca\") pod \"47fcad0b-43a2-4d19-8237-e5493895373e\" (UID: \"47fcad0b-43a2-4d19-8237-e5493895373e\") "
Jul 11 04:25:38.042340 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:38.042303    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47fcad0b-43a2-4d19-8237-e5493895373e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "47fcad0b-43a2-4d19-8237-e5493895373e" (UID: "47fcad0b-43a2-4d19-8237-e5493895373e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:25:38.142768 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:38.142740    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47fcad0b-43a2-4d19-8237-e5493895373e-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:25:38.780020 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:38.779985    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw" event={"ID":"47fcad0b-43a2-4d19-8237-e5493895373e","Type":"ContainerDied","Data":"f8ca894905489ec2958b261d0a1ee6b1e6f45249439da672ea3ef4487539a26e"}
Jul 11 04:25:38.780020 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:38.780021    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw"
Jul 11 04:25:38.780239 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:38.780033    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8ca894905489ec2958b261d0a1ee6b1e6f45249439da672ea3ef4487539a26e"
Jul 11 04:25:45.089811 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.089765    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"]
Jul 11 04:25:45.090412 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.090082    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c" podUID="73005d68-176f-45f3-bf68-f07651f2aeb7" containerName="maas-api" containerID="cri-o://eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca" gracePeriod=30
Jul 11 04:25:45.367769 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.367676    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c" podUID="73005d68-176f-45f3-bf68-f07651f2aeb7" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.63:8443/health\": dial tcp 10.133.0.63:8443: connect: connection refused"
Jul 11 04:25:45.529927 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.529902    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:25:45.605960 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.605923    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73005d68-176f-45f3-bf68-f07651f2aeb7-maas-api-tls\") pod \"73005d68-176f-45f3-bf68-f07651f2aeb7\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") "
Jul 11 04:25:45.605960 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.605964    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73005d68-176f-45f3-bf68-f07651f2aeb7-openshift-service-ca\") pod \"73005d68-176f-45f3-bf68-f07651f2aeb7\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") "
Jul 11 04:25:45.606426 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.606397    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73005d68-176f-45f3-bf68-f07651f2aeb7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "73005d68-176f-45f3-bf68-f07651f2aeb7" (UID: "73005d68-176f-45f3-bf68-f07651f2aeb7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:25:45.608027 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.607993    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73005d68-176f-45f3-bf68-f07651f2aeb7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "73005d68-176f-45f3-bf68-f07651f2aeb7" (UID: "73005d68-176f-45f3-bf68-f07651f2aeb7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:25:45.706658 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.706572    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm9zx\" (UniqueName: \"kubernetes.io/projected/73005d68-176f-45f3-bf68-f07651f2aeb7-kube-api-access-jm9zx\") pod \"73005d68-176f-45f3-bf68-f07651f2aeb7\" (UID: \"73005d68-176f-45f3-bf68-f07651f2aeb7\") "
Jul 11 04:25:45.706813 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.706762    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73005d68-176f-45f3-bf68-f07651f2aeb7-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:25:45.706813 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.706778    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73005d68-176f-45f3-bf68-f07651f2aeb7-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:25:45.708570 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.708547    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73005d68-176f-45f3-bf68-f07651f2aeb7-kube-api-access-jm9zx" (OuterVolumeSpecName: "kube-api-access-jm9zx") pod "73005d68-176f-45f3-bf68-f07651f2aeb7" (UID: "73005d68-176f-45f3-bf68-f07651f2aeb7"). InnerVolumeSpecName "kube-api-access-jm9zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:25:45.807141 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.807103    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm9zx\" (UniqueName: \"kubernetes.io/projected/73005d68-176f-45f3-bf68-f07651f2aeb7-kube-api-access-jm9zx\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:25:45.817742 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.817708    2576 generic.go:356] "Generic (PLEG): container finished" podID="73005d68-176f-45f3-bf68-f07651f2aeb7" containerID="eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca" exitCode=0
Jul 11 04:25:45.817905 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.817760    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"
Jul 11 04:25:45.817905 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.817796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c" event={"ID":"73005d68-176f-45f3-bf68-f07651f2aeb7","Type":"ContainerDied","Data":"eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca"}
Jul 11 04:25:45.817905 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.817849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c" event={"ID":"73005d68-176f-45f3-bf68-f07651f2aeb7","Type":"ContainerDied","Data":"0dfe586983b2bd4205273c67288252a87c4bb1f523cd5870d5db3cc5aba42552"}
Jul 11 04:25:45.817905 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.817876    2576 scope.go:117] "RemoveContainer" containerID="eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca"
Jul 11 04:25:45.827053 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.827037    2576 scope.go:117] "RemoveContainer" containerID="eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca"
Jul 11 04:25:45.827306 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:25:45.827284    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca\": container with ID starting with eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca not found: ID does not exist" containerID="eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca"
Jul 11 04:25:45.827430 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.827313    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca"} err="failed to get container status \"eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca\": rpc error: code = NotFound desc = could not find container \"eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca\": container with ID starting with eca32a89440a75199a4eeba01eb4a26512d8a89ab11efa61a865ff8d026340ca not found: ID does not exist"
Jul 11 04:25:45.839595 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.839568    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"]
Jul 11 04:25:45.845139 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:45.845115    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-93c505-666db4b67b-f2c7c"]
Jul 11 04:25:47.478366 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:25:47.478317    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73005d68-176f-45f3-bf68-f07651f2aeb7" path="/var/lib/kubelet/pods/73005d68-176f-45f3-bf68-f07651f2aeb7/volumes"
Jul 11 04:26:00.468804 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.468768    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"]
Jul 11 04:26:00.469353 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.469028    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy" containerID="cri-o://871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c" gracePeriod=30
Jul 11 04:26:00.813934 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.813896    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g"]
Jul 11 04:26:00.814272 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.814259    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73005d68-176f-45f3-bf68-f07651f2aeb7" containerName="maas-api"
Jul 11 04:26:00.814320 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.814275    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="73005d68-176f-45f3-bf68-f07651f2aeb7" containerName="maas-api"
Jul 11 04:26:00.814320 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.814294    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47fcad0b-43a2-4d19-8237-e5493895373e" containerName="revoke-keys"
Jul 11 04:26:00.814320 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.814301    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="47fcad0b-43a2-4d19-8237-e5493895373e" containerName="revoke-keys"
Jul 11 04:26:00.814445 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.814389    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="47fcad0b-43a2-4d19-8237-e5493895373e" containerName="revoke-keys"
Jul 11 04:26:00.814445 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.814399    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="73005d68-176f-45f3-bf68-f07651f2aeb7" containerName="maas-api"
Jul 11 04:26:00.817503 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.817482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g"
Jul 11 04:26:00.819999 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.819973    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:26:00.824621 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.824583    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g"]
Jul 11 04:26:00.945412 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:00.945359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4f2fb8-b750-4d72-a36d-73352e3f79f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g\" (UID: \"cc4f2fb8-b750-4d72-a36d-73352e3f79f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g"
Jul 11 04:26:01.046749 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:01.046703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4f2fb8-b750-4d72-a36d-73352e3f79f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g\" (UID: \"cc4f2fb8-b750-4d72-a36d-73352e3f79f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g"
Jul 11 04:26:01.047435 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:01.047410    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4f2fb8-b750-4d72-a36d-73352e3f79f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g\" (UID: \"cc4f2fb8-b750-4d72-a36d-73352e3f79f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g"
Jul 11 04:26:01.137383 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:01.137272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g"
Jul 11 04:26:01.267250 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:01.267224    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g"]
Jul 11 04:26:01.269847 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:26:01.269819    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4f2fb8_b750_4d72_a36d_73352e3f79f3.slice/crio-659427c8159a8837a0c89aa99bcf15be4a3ca9c2fdf65808acc2b1a72994551b WatchSource:0}: Error finding container 659427c8159a8837a0c89aa99bcf15be4a3ca9c2fdf65808acc2b1a72994551b: Status 404 returned error can't find the container with id 659427c8159a8837a0c89aa99bcf15be4a3ca9c2fdf65808acc2b1a72994551b
Jul 11 04:26:01.908834 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:01.908790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g" event={"ID":"cc4f2fb8-b750-4d72-a36d-73352e3f79f3","Type":"ContainerStarted","Data":"15c0bb6c041153ce6ca22b1456d10cc8aa7c4b4af6154d82c74b681c52399f13"}
Jul 11 04:26:01.909229 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:01.908856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g" event={"ID":"cc4f2fb8-b750-4d72-a36d-73352e3f79f3","Type":"ContainerStarted","Data":"659427c8159a8837a0c89aa99bcf15be4a3ca9c2fdf65808acc2b1a72994551b"}
Jul 11 04:26:01.922493 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:01.922432    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g" podStartSLOduration=1.9224166999999999 podStartE2EDuration="1.9224167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:26:01.920533513 +0000 UTC m=+2235.105685968" watchObservedRunningTime="2026-07-11 04:26:01.9224167 +0000 UTC m=+2235.107569155"
Jul 11 04:26:02.916596 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:02.916562    2576 generic.go:356] "Generic (PLEG): container finished" podID="cc4f2fb8-b750-4d72-a36d-73352e3f79f3" containerID="15c0bb6c041153ce6ca22b1456d10cc8aa7c4b4af6154d82c74b681c52399f13" exitCode=0
Jul 11 04:26:02.917006 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:02.916617    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g" event={"ID":"cc4f2fb8-b750-4d72-a36d-73352e3f79f3","Type":"ContainerDied","Data":"15c0bb6c041153ce6ca22b1456d10cc8aa7c4b4af6154d82c74b681c52399f13"}
Jul 11 04:26:03.858385 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:03.858345    2576 patch_prober.go:28] interesting pod/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 04:26:03.858552 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:03.858401    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 04:26:04.048785 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:04.048757    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g"
Jul 11 04:26:04.173702 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:04.173619    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4f2fb8-b750-4d72-a36d-73352e3f79f3-maas-api-service-ca\") pod \"cc4f2fb8-b750-4d72-a36d-73352e3f79f3\" (UID: \"cc4f2fb8-b750-4d72-a36d-73352e3f79f3\") "
Jul 11 04:26:04.173965 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:04.173942    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc4f2fb8-b750-4d72-a36d-73352e3f79f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc4f2fb8-b750-4d72-a36d-73352e3f79f3" (UID: "cc4f2fb8-b750-4d72-a36d-73352e3f79f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:26:04.274420 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:04.274388    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4f2fb8-b750-4d72-a36d-73352e3f79f3-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:04.928138 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:04.928109    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g"
Jul 11 04:26:04.928350 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:04.928151    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g" event={"ID":"cc4f2fb8-b750-4d72-a36d-73352e3f79f3","Type":"ContainerDied","Data":"659427c8159a8837a0c89aa99bcf15be4a3ca9c2fdf65808acc2b1a72994551b"}
Jul 11 04:26:04.928350 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:04.928200    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="659427c8159a8837a0c89aa99bcf15be4a3ca9c2fdf65808acc2b1a72994551b"
Jul 11 04:26:05.717314 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.717289    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:26:05.787276 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.787250    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-data\") pod \"810b2238-8fab-4415-a14b-035fa0c9033f\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") "
Jul 11 04:26:05.787456 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.787284    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-istio-token\") pod \"810b2238-8fab-4415-a14b-035fa0c9033f\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") "
Jul 11 04:26:05.787456 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.787361    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-certs\") pod \"810b2238-8fab-4415-a14b-035fa0c9033f\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") "
Jul 11 04:26:05.787456 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.787403    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-socket\") pod \"810b2238-8fab-4415-a14b-035fa0c9033f\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") "
Jul 11 04:26:05.787456 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.787442    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/810b2238-8fab-4415-a14b-035fa0c9033f-istiod-ca-cert\") pod \"810b2238-8fab-4415-a14b-035fa0c9033f\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") "
Jul 11 04:26:05.787667 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.787471    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp488\" (UniqueName: \"kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-kube-api-access-pp488\") pod \"810b2238-8fab-4415-a14b-035fa0c9033f\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") "
Jul 11 04:26:05.787667 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.787504    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-envoy\") pod \"810b2238-8fab-4415-a14b-035fa0c9033f\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") "
Jul 11 04:26:05.787667 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.787556    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-credential-socket\") pod \"810b2238-8fab-4415-a14b-035fa0c9033f\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") "
Jul 11 04:26:05.787667 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.787603    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/810b2238-8fab-4415-a14b-035fa0c9033f-istio-podinfo\") pod \"810b2238-8fab-4415-a14b-035fa0c9033f\" (UID: \"810b2238-8fab-4415-a14b-035fa0c9033f\") "
Jul 11 04:26:05.787968 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.787900    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "810b2238-8fab-4415-a14b-035fa0c9033f" (UID: "810b2238-8fab-4415-a14b-035fa0c9033f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:26:05.788070 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.787932    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/810b2238-8fab-4415-a14b-035fa0c9033f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "810b2238-8fab-4415-a14b-035fa0c9033f" (UID: "810b2238-8fab-4415-a14b-035fa0c9033f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:26:05.788070 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.788005    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "810b2238-8fab-4415-a14b-035fa0c9033f" (UID: "810b2238-8fab-4415-a14b-035fa0c9033f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:26:05.788070 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.788027    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "810b2238-8fab-4415-a14b-035fa0c9033f" (UID: "810b2238-8fab-4415-a14b-035fa0c9033f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:26:05.788219 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.788161    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-data" (OuterVolumeSpecName: "istio-data") pod "810b2238-8fab-4415-a14b-035fa0c9033f" (UID: "810b2238-8fab-4415-a14b-035fa0c9033f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:26:05.789799 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.789770    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "810b2238-8fab-4415-a14b-035fa0c9033f" (UID: "810b2238-8fab-4415-a14b-035fa0c9033f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:26:05.789799 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.789782    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/810b2238-8fab-4415-a14b-035fa0c9033f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "810b2238-8fab-4415-a14b-035fa0c9033f" (UID: "810b2238-8fab-4415-a14b-035fa0c9033f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:26:05.790097 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.790072    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-kube-api-access-pp488" (OuterVolumeSpecName: "kube-api-access-pp488") pod "810b2238-8fab-4415-a14b-035fa0c9033f" (UID: "810b2238-8fab-4415-a14b-035fa0c9033f"). InnerVolumeSpecName "kube-api-access-pp488". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:26:05.790144 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.790105    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-istio-token" (OuterVolumeSpecName: "istio-token") pod "810b2238-8fab-4415-a14b-035fa0c9033f" (UID: "810b2238-8fab-4415-a14b-035fa0c9033f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:26:05.888808 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.888768    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-certs\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:05.888808 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.888804    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-workload-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:05.888808 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.888816    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/810b2238-8fab-4415-a14b-035fa0c9033f-istiod-ca-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:05.889076 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.888825    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pp488\" (UniqueName: \"kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-kube-api-access-pp488\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:05.889076 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.888836    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-envoy\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:05.889076 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.888844    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-credential-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:05.889076 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.888852    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/810b2238-8fab-4415-a14b-035fa0c9033f-istio-podinfo\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:05.889076 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.888860    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/810b2238-8fab-4415-a14b-035fa0c9033f-istio-data\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:05.889076 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.888868    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/810b2238-8fab-4415-a14b-035fa0c9033f-istio-token\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:05.935254 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.935221    2576 generic.go:356] "Generic (PLEG): container finished" podID="810b2238-8fab-4415-a14b-035fa0c9033f" containerID="871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c" exitCode=0
Jul 11 04:26:05.935434 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.935272    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"
Jul 11 04:26:05.935434 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.935308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" event={"ID":"810b2238-8fab-4415-a14b-035fa0c9033f","Type":"ContainerDied","Data":"871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c"}
Jul 11 04:26:05.935434 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.935406    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh" event={"ID":"810b2238-8fab-4415-a14b-035fa0c9033f","Type":"ContainerDied","Data":"0240634ccc604261a42130a2b91704fe8db3ac07376e91d12ed741d10505d2c2"}
Jul 11 04:26:05.935434 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.935430    2576 scope.go:117] "RemoveContainer" containerID="871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c"
Jul 11 04:26:05.944717 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.944700    2576 scope.go:117] "RemoveContainer" containerID="2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a"
Jul 11 04:26:05.953250 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.953002    2576 scope.go:117] "RemoveContainer" containerID="871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c"
Jul 11 04:26:05.953376 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:26:05.953284    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c\": container with ID starting with 871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c not found: ID does not exist" containerID="871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c"
Jul 11 04:26:05.953376 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.953317    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c"} err="failed to get container status \"871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c\": rpc error: code = NotFound desc = could not find container \"871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c\": container with ID starting with 871a0ce0b16f735d4c50eab115084e927427d11d0d33f3f5f92d177b8288a40c not found: ID does not exist"
Jul 11 04:26:05.953376 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.953356    2576 scope.go:117] "RemoveContainer" containerID="2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a"
Jul 11 04:26:05.953690 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:26:05.953647    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a\": container with ID starting with 2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a not found: ID does not exist" containerID="2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a"
Jul 11 04:26:05.953733 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.953697    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a"} err="failed to get container status \"2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a\": rpc error: code = NotFound desc = could not find container \"2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a\": container with ID starting with 2e5efbcbabd515bc98357dfd4826121314217330260005a75a83095dc36c9d9a not found: ID does not exist"
Jul 11 04:26:05.956018 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.955993    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"]
Jul 11 04:26:05.959193 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:05.959171    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-93c505-openshift-default-5df99c55ff-5fwxh"]
Jul 11 04:26:07.477210 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:07.477170    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" path="/var/lib/kubelet/pods/810b2238-8fab-4415-a14b-035fa0c9033f/volumes"
Jul 11 04:26:11.168778 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.168694    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"]
Jul 11 04:26:11.169251 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.168900    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw" podUID="7982afcb-cc7e-41e8-b9eb-5713cb845f28" containerName="maas-api" containerID="cri-o://c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba" gracePeriod=30
Jul 11 04:26:11.417242 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.417218    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:26:11.534261 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.534237    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7982afcb-cc7e-41e8-b9eb-5713cb845f28-maas-api-tls\") pod \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") "
Jul 11 04:26:11.534431 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.534276    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7982afcb-cc7e-41e8-b9eb-5713cb845f28-openshift-service-ca\") pod \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") "
Jul 11 04:26:11.534431 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.534404    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v4c6\" (UniqueName: \"kubernetes.io/projected/7982afcb-cc7e-41e8-b9eb-5713cb845f28-kube-api-access-2v4c6\") pod \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\" (UID: \"7982afcb-cc7e-41e8-b9eb-5713cb845f28\") "
Jul 11 04:26:11.534663 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.534641    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7982afcb-cc7e-41e8-b9eb-5713cb845f28-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7982afcb-cc7e-41e8-b9eb-5713cb845f28" (UID: "7982afcb-cc7e-41e8-b9eb-5713cb845f28"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:26:11.536147 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.536122    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7982afcb-cc7e-41e8-b9eb-5713cb845f28-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7982afcb-cc7e-41e8-b9eb-5713cb845f28" (UID: "7982afcb-cc7e-41e8-b9eb-5713cb845f28"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:26:11.536284 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.536261    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7982afcb-cc7e-41e8-b9eb-5713cb845f28-kube-api-access-2v4c6" (OuterVolumeSpecName: "kube-api-access-2v4c6") pod "7982afcb-cc7e-41e8-b9eb-5713cb845f28" (UID: "7982afcb-cc7e-41e8-b9eb-5713cb845f28"). InnerVolumeSpecName "kube-api-access-2v4c6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:26:11.636062 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.636027    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v4c6\" (UniqueName: \"kubernetes.io/projected/7982afcb-cc7e-41e8-b9eb-5713cb845f28-kube-api-access-2v4c6\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:11.636062 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.636055    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7982afcb-cc7e-41e8-b9eb-5713cb845f28-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:11.636062 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.636065    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7982afcb-cc7e-41e8-b9eb-5713cb845f28-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:11.971541 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.971452    2576 generic.go:356] "Generic (PLEG): container finished" podID="7982afcb-cc7e-41e8-b9eb-5713cb845f28" containerID="c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba" exitCode=0
Jul 11 04:26:11.971541 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.971504    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"
Jul 11 04:26:11.971720 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.971541    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw" event={"ID":"7982afcb-cc7e-41e8-b9eb-5713cb845f28","Type":"ContainerDied","Data":"c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba"}
Jul 11 04:26:11.971720 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.971602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw" event={"ID":"7982afcb-cc7e-41e8-b9eb-5713cb845f28","Type":"ContainerDied","Data":"a52c47357829cfb5bfec189b13dbc74207535df0921a105f0dee9bcf7729cc2a"}
Jul 11 04:26:11.971720 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.971626    2576 scope.go:117] "RemoveContainer" containerID="c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba"
Jul 11 04:26:11.981143 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.981125    2576 scope.go:117] "RemoveContainer" containerID="c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba"
Jul 11 04:26:11.981412 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:26:11.981392    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba\": container with ID starting with c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba not found: ID does not exist" containerID="c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba"
Jul 11 04:26:11.981458 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.981421    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba"} err="failed to get container status \"c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba\": rpc error: code = NotFound desc = could not find container \"c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba\": container with ID starting with c7cc98eaff708ca82745a65af6ed6284e2633532fecf573df01a4670b8678aba not found: ID does not exist"
Jul 11 04:26:11.992239 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.992210    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"]
Jul 11 04:26:11.996022 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:11.996000    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6c0c56-66d9d6f7fc-ghddw"]
Jul 11 04:26:13.477420 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:13.477388    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7982afcb-cc7e-41e8-b9eb-5713cb845f28" path="/var/lib/kubelet/pods/7982afcb-cc7e-41e8-b9eb-5713cb845f28/volumes"
Jul 11 04:26:27.401388 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.401348    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"]
Jul 11 04:26:27.401797 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.401707    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7982afcb-cc7e-41e8-b9eb-5713cb845f28" containerName="maas-api"
Jul 11 04:26:27.401797 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.401722    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7982afcb-cc7e-41e8-b9eb-5713cb845f28" containerName="maas-api"
Jul 11 04:26:27.401797 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.401736    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy"
Jul 11 04:26:27.401797 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.401741    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy"
Jul 11 04:26:27.401797 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.401761    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc4f2fb8-b750-4d72-a36d-73352e3f79f3" containerName="revoke-keys"
Jul 11 04:26:27.401797 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.401766    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc4f2fb8-b750-4d72-a36d-73352e3f79f3" containerName="revoke-keys"
Jul 11 04:26:27.401992 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.401813    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc4f2fb8-b750-4d72-a36d-73352e3f79f3" containerName="revoke-keys"
Jul 11 04:26:27.401992 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.401820    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy"
Jul 11 04:26:27.401992 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.401827    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7982afcb-cc7e-41e8-b9eb-5713cb845f28" containerName="maas-api"
Jul 11 04:26:27.401992 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.401834    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy"
Jul 11 04:26:27.405170 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.405151    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.407462 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.407439    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1c4bfd-openshift-default-dockercfg-m5xnb\""
Jul 11 04:26:27.415190 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.415168    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"]
Jul 11 04:26:27.576680 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.576648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-data\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.576856 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.576695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istiod-ca-cert\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.576856 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.576727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-token\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.576856 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.576768    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-socket\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.576856 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.576805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-podinfo\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.576856 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.576829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-certs\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.576856 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.576844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzjft\" (UniqueName: \"kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-kube-api-access-pzjft\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.577063 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.576871    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-envoy\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.577063 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.576912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-credential-socket\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.677719 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.677634    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-credential-socket\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.677719 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.677703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-data\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.677952 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.677734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istiod-ca-cert\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.677952 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.677761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-token\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.677952 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.677779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-socket\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.677952 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.677803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-podinfo\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.677952 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.677831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-certs\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.677952 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.677855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjft\" (UniqueName: \"kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-kube-api-access-pzjft\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.677952 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.677889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-envoy\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.678295 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.678089    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-credential-socket\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.678295 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.678106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-data\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.678295 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.678161    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-certs\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.678295 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.678217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-socket\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.678693 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.678676    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istiod-ca-cert\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.680066 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.680044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-envoy\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.680298 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.680275    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-podinfo\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.684984 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.684949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzjft\" (UniqueName: \"kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-kube-api-access-pzjft\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.685135 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.685113    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-token\") pod \"e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") " pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.715335 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.715301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:27.851857 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.851830    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"]
Jul 11 04:26:27.852789 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:26:27.852759    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f78dd59_1b2b_4d48_8c67_cbbdce0a45ce.slice/crio-d245fa60eb6d5794b4fb8c5c686f7d06ca7b60ee765424f4f08830f865103942 WatchSource:0}: Error finding container d245fa60eb6d5794b4fb8c5c686f7d06ca7b60ee765424f4f08830f865103942: Status 404 returned error can't find the container with id d245fa60eb6d5794b4fb8c5c686f7d06ca7b60ee765424f4f08830f865103942
Jul 11 04:26:27.855066 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.855030    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:26:27.855128 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.855112    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:26:27.855171 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:27.855156    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:26:28.061546 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:28.061515    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" event={"ID":"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce","Type":"ContainerStarted","Data":"5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48"}
Jul 11 04:26:28.061745 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:28.061575    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" event={"ID":"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce","Type":"ContainerStarted","Data":"d245fa60eb6d5794b4fb8c5c686f7d06ca7b60ee765424f4f08830f865103942"}
Jul 11 04:26:28.080075 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:28.080027    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" podStartSLOduration=1.080011935 podStartE2EDuration="1.080011935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:26:28.078192977 +0000 UTC m=+2261.263345433" watchObservedRunningTime="2026-07-11 04:26:28.080011935 +0000 UTC m=+2261.265164389"
Jul 11 04:26:28.716451 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:28.716419    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:28.720937 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:28.720914    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:29.066895 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:29.066859    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:29.067921 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:29.067898    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:30.050902 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.050862    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"]
Jul 11 04:26:30.051398 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.051380    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy"
Jul 11 04:26:30.051452 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.051402    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="810b2238-8fab-4415-a14b-035fa0c9033f" containerName="istio-proxy"
Jul 11 04:26:30.054954 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.054938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:30.057298 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.057273    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1c4bfd-serving-cert\""
Jul 11 04:26:30.057555 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.057347    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-drsms\""
Jul 11 04:26:30.061210 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.061188    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"]
Jul 11 04:26:30.206374 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.206312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzm98\" (UniqueName: \"kubernetes.io/projected/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-kube-api-access-jzm98\") pod \"maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:30.206374 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.206381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-maas-api-tls\") pod \"maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:30.206629 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.206399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-openshift-service-ca\") pod \"maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:30.307443 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.307357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzm98\" (UniqueName: \"kubernetes.io/projected/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-kube-api-access-jzm98\") pod \"maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:30.307443 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.307400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-maas-api-tls\") pod \"maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:30.307443 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.307418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-openshift-service-ca\") pod \"maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:30.307653 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:26:30.307491    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-serving-cert: secret "maas-api-e2e-api-a-1c4bfd-serving-cert" not found
Jul 11 04:26:30.307653 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:26:30.307573    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-maas-api-tls podName:a5cdac8b-95b3-4a48-bba0-2d57975a51c4 nodeName:}" failed. No retries permitted until 2026-07-11 04:26:30.807552733 +0000 UTC m=+2263.992705186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-maas-api-tls") pod "maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l" (UID: "a5cdac8b-95b3-4a48-bba0-2d57975a51c4") : secret "maas-api-e2e-api-a-1c4bfd-serving-cert" not found
Jul 11 04:26:30.308067 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.308050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-openshift-service-ca\") pod \"maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:30.317700 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.317675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzm98\" (UniqueName: \"kubernetes.io/projected/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-kube-api-access-jzm98\") pod \"maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:30.811872 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.811836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-maas-api-tls\") pod \"maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:30.814239 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.814215    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-maas-api-tls\") pod \"maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:30.968378 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:30.968323    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:31.104444 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:31.104415    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"]
Jul 11 04:26:31.106270 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:26:31.106241    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5cdac8b_95b3_4a48_bba0_2d57975a51c4.slice/crio-aa409271687993e6d44543ca00711a9051dc977618daba5cc9dd6cbd1280f23e WatchSource:0}: Error finding container aa409271687993e6d44543ca00711a9051dc977618daba5cc9dd6cbd1280f23e: Status 404 returned error can't find the container with id aa409271687993e6d44543ca00711a9051dc977618daba5cc9dd6cbd1280f23e
Jul 11 04:26:31.107884 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:31.107862    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 04:26:32.087214 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:32.087176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l" event={"ID":"a5cdac8b-95b3-4a48-bba0-2d57975a51c4","Type":"ContainerStarted","Data":"5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311"}
Jul 11 04:26:32.087440 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:32.087239    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:32.087440 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:32.087257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l" event={"ID":"a5cdac8b-95b3-4a48-bba0-2d57975a51c4","Type":"ContainerStarted","Data":"aa409271687993e6d44543ca00711a9051dc977618daba5cc9dd6cbd1280f23e"}
Jul 11 04:26:32.102940 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:32.102896    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l" podStartSLOduration=1.699960159 podStartE2EDuration="2.102882558s" totalImagesPullingTime="402.922399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:26:32.101801948 +0000 UTC m=+2265.286954428" watchObservedRunningTime="2026-07-11 04:26:32.102882558 +0000 UTC m=+2265.288035060"
Jul 11 04:26:38.098394 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.098364    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:26:38.546001 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.545963    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"]
Jul 11 04:26:38.549558 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.549537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:38.551734 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.551715    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a8084b-serving-cert\""
Jul 11 04:26:38.566808 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.566770    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"]
Jul 11 04:26:38.588999 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.588941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1297df84-2130-466b-8ed9-c4fedaca77bd-openshift-service-ca\") pod \"maas-api-e2e-api-b-a8084b-564b4464db-4wkzk\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:38.589281 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.589246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1297df84-2130-466b-8ed9-c4fedaca77bd-maas-api-tls\") pod \"maas-api-e2e-api-b-a8084b-564b4464db-4wkzk\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:38.589526 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.589507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvcnp\" (UniqueName: \"kubernetes.io/projected/1297df84-2130-466b-8ed9-c4fedaca77bd-kube-api-access-fvcnp\") pod \"maas-api-e2e-api-b-a8084b-564b4464db-4wkzk\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:38.690179 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.690139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1297df84-2130-466b-8ed9-c4fedaca77bd-openshift-service-ca\") pod \"maas-api-e2e-api-b-a8084b-564b4464db-4wkzk\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:38.690179 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.690185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1297df84-2130-466b-8ed9-c4fedaca77bd-maas-api-tls\") pod \"maas-api-e2e-api-b-a8084b-564b4464db-4wkzk\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:38.690416 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.690224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvcnp\" (UniqueName: \"kubernetes.io/projected/1297df84-2130-466b-8ed9-c4fedaca77bd-kube-api-access-fvcnp\") pod \"maas-api-e2e-api-b-a8084b-564b4464db-4wkzk\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:38.690416 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:26:38.690393    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-serving-cert: secret "maas-api-e2e-api-b-a8084b-serving-cert" not found
Jul 11 04:26:38.690483 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:26:38.690475    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1297df84-2130-466b-8ed9-c4fedaca77bd-maas-api-tls podName:1297df84-2130-466b-8ed9-c4fedaca77bd nodeName:}" failed. No retries permitted until 2026-07-11 04:26:39.190452437 +0000 UTC m=+2272.375604887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1297df84-2130-466b-8ed9-c4fedaca77bd-maas-api-tls") pod "maas-api-e2e-api-b-a8084b-564b4464db-4wkzk" (UID: "1297df84-2130-466b-8ed9-c4fedaca77bd") : secret "maas-api-e2e-api-b-a8084b-serving-cert" not found
Jul 11 04:26:38.690921 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.690901    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1297df84-2130-466b-8ed9-c4fedaca77bd-openshift-service-ca\") pod \"maas-api-e2e-api-b-a8084b-564b4464db-4wkzk\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:38.699850 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:38.699829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvcnp\" (UniqueName: \"kubernetes.io/projected/1297df84-2130-466b-8ed9-c4fedaca77bd-kube-api-access-fvcnp\") pod \"maas-api-e2e-api-b-a8084b-564b4464db-4wkzk\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:39.193657 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:39.193613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1297df84-2130-466b-8ed9-c4fedaca77bd-maas-api-tls\") pod \"maas-api-e2e-api-b-a8084b-564b4464db-4wkzk\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:39.196021 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:39.195987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1297df84-2130-466b-8ed9-c4fedaca77bd-maas-api-tls\") pod \"maas-api-e2e-api-b-a8084b-564b4464db-4wkzk\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:39.483262 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:39.483167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:39.633026 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:39.633002    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"]
Jul 11 04:26:39.634745 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:26:39.634716    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1297df84_2130_466b_8ed9_c4fedaca77bd.slice/crio-abf0cd022ae4f4608eb0a5dea04cb4a755c7320c9632cc5cddfe8ae1bccd3325 WatchSource:0}: Error finding container abf0cd022ae4f4608eb0a5dea04cb4a755c7320c9632cc5cddfe8ae1bccd3325: Status 404 returned error can't find the container with id abf0cd022ae4f4608eb0a5dea04cb4a755c7320c9632cc5cddfe8ae1bccd3325
Jul 11 04:26:40.137520 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:40.137481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk" event={"ID":"1297df84-2130-466b-8ed9-c4fedaca77bd","Type":"ContainerStarted","Data":"0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b"}
Jul 11 04:26:40.137675 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:40.137576    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk" event={"ID":"1297df84-2130-466b-8ed9-c4fedaca77bd","Type":"ContainerStarted","Data":"abf0cd022ae4f4608eb0a5dea04cb4a755c7320c9632cc5cddfe8ae1bccd3325"}
Jul 11 04:26:40.137675 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:40.137608    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:44.068856 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:44.068821    2576 patch_prober.go:28] interesting pod/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 11 04:26:44.069276 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:44.068879    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 11 04:26:44.164560 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:44.164476    2576 generic.go:356] "Generic (PLEG): container finished" podID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerID="5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48" exitCode=0
Jul 11 04:26:44.164560 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:44.164520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" event={"ID":"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce","Type":"ContainerDied","Data":"5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48"}
Jul 11 04:26:44.164938 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:44.164921    2576 scope.go:117] "RemoveContainer" containerID="5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48"
Jul 11 04:26:44.165903 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:44.165877    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:26:44.165955 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:44.165943    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:26:44.165999 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:44.165975    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:26:44.184743 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:44.184699    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk" podStartSLOduration=5.769045072 podStartE2EDuration="6.184685355s" totalImagesPullingTime="415.640283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:26:40.17047133 +0000 UTC m=+2273.355623786" watchObservedRunningTime="2026-07-11 04:26:44.184685355 +0000 UTC m=+2277.369837809"
Jul 11 04:26:45.180533 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:45.180499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" event={"ID":"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce","Type":"ContainerStarted","Data":"e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca"}
Jul 11 04:26:45.715735 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:45.715700    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:45.715947 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:45.715924    2576 patch_prober.go:28] interesting pod/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 11 04:26:45.715997 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:45.715978    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 11 04:26:46.150810 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:46.150784    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:26:46.716704 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:46.716666    2576 patch_prober.go:28] interesting pod/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 11 04:26:46.717105 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:46.716726    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 11 04:26:47.716382 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:47.716348    2576 patch_prober.go:28] interesting pod/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 11 04:26:47.716501 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:47.716410    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 11 04:26:48.715948 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:48.715903    2576 patch_prober.go:28] interesting pod/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 11 04:26:48.716353 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:48.715968    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 11 04:26:49.719458 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:49.719419    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:49.719814 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:49.719683    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:49.720276 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:49.720256    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:26:51.046981 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:51.046942    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2"]
Jul 11 04:26:51.050489 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:51.050471    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2"
Jul 11 04:26:51.052654 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:51.052633    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:26:51.056811 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:51.056788    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2"]
Jul 11 04:26:51.116931 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:51.116906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2\" (UID: \"fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2"
Jul 11 04:26:51.218223 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:51.218193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2\" (UID: \"fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2"
Jul 11 04:26:51.218917 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:51.218898    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2\" (UID: \"fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2"
Jul 11 04:26:51.362788 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:51.362701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2"
Jul 11 04:26:51.496550 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:51.496524    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2"]
Jul 11 04:26:51.497891 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:26:51.497863    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa521c0d_76ce_49a8_b3b7_aa7a6fdfbf8b.slice/crio-3b0e63472e3531996ca03321325e2924f75cf9c91862568b5bb42fbbaf2073eb WatchSource:0}: Error finding container 3b0e63472e3531996ca03321325e2924f75cf9c91862568b5bb42fbbaf2073eb: Status 404 returned error can't find the container with id 3b0e63472e3531996ca03321325e2924f75cf9c91862568b5bb42fbbaf2073eb
Jul 11 04:26:52.230516 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:52.230487    2576 generic.go:356] "Generic (PLEG): container finished" podID="fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b" containerID="b6c7730e2ac94207e9340dcde2182d15e385aaad6d60412d86e17e88ff9709bb" exitCode=0
Jul 11 04:26:52.230826 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:52.230571    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2" event={"ID":"fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b","Type":"ContainerDied","Data":"b6c7730e2ac94207e9340dcde2182d15e385aaad6d60412d86e17e88ff9709bb"}
Jul 11 04:26:52.230826 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:52.230627    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2" event={"ID":"fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b","Type":"ContainerStarted","Data":"3b0e63472e3531996ca03321325e2924f75cf9c91862568b5bb42fbbaf2073eb"}
Jul 11 04:26:53.360101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:53.360078    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2"
Jul 11 04:26:53.438493 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:53.438459    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b-maas-api-service-ca\") pod \"fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b\" (UID: \"fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b\") "
Jul 11 04:26:53.438752 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:53.438732    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b" (UID: "fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:26:53.540020 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:53.539980    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:26:54.243219 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:54.243189    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2"
Jul 11 04:26:54.243407 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:54.243218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2" event={"ID":"fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b","Type":"ContainerDied","Data":"3b0e63472e3531996ca03321325e2924f75cf9c91862568b5bb42fbbaf2073eb"}
Jul 11 04:26:54.243407 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:26:54.243268    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b0e63472e3531996ca03321325e2924f75cf9c91862568b5bb42fbbaf2073eb"
Jul 11 04:27:01.397626 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.397587    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"]
Jul 11 04:27:01.398422 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.398384    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l" podUID="a5cdac8b-95b3-4a48-bba0-2d57975a51c4" containerName="maas-api" containerID="cri-o://5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311" gracePeriod=30
Jul 11 04:27:01.650841 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.650787    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:27:01.816809 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.816780    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzm98\" (UniqueName: \"kubernetes.io/projected/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-kube-api-access-jzm98\") pod \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") "
Jul 11 04:27:01.816991 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.816840    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-maas-api-tls\") pod \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") "
Jul 11 04:27:01.816991 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.816898    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-openshift-service-ca\") pod \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\" (UID: \"a5cdac8b-95b3-4a48-bba0-2d57975a51c4\") "
Jul 11 04:27:01.817347 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.817303    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5cdac8b-95b3-4a48-bba0-2d57975a51c4" (UID: "a5cdac8b-95b3-4a48-bba0-2d57975a51c4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:27:01.818986 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.818954    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5cdac8b-95b3-4a48-bba0-2d57975a51c4" (UID: "a5cdac8b-95b3-4a48-bba0-2d57975a51c4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:27:01.819083 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.818985    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-kube-api-access-jzm98" (OuterVolumeSpecName: "kube-api-access-jzm98") pod "a5cdac8b-95b3-4a48-bba0-2d57975a51c4" (UID: "a5cdac8b-95b3-4a48-bba0-2d57975a51c4"). InnerVolumeSpecName "kube-api-access-jzm98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:27:01.917614 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.917535    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzm98\" (UniqueName: \"kubernetes.io/projected/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-kube-api-access-jzm98\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:01.917614 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.917563    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:01.917614 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:01.917575    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5cdac8b-95b3-4a48-bba0-2d57975a51c4-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:02.288233 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:02.288194    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5cdac8b-95b3-4a48-bba0-2d57975a51c4" containerID="5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311" exitCode=0
Jul 11 04:27:02.288414 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:02.288243    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"
Jul 11 04:27:02.288414 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:02.288277    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l" event={"ID":"a5cdac8b-95b3-4a48-bba0-2d57975a51c4","Type":"ContainerDied","Data":"5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311"}
Jul 11 04:27:02.288414 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:02.288345    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l" event={"ID":"a5cdac8b-95b3-4a48-bba0-2d57975a51c4","Type":"ContainerDied","Data":"aa409271687993e6d44543ca00711a9051dc977618daba5cc9dd6cbd1280f23e"}
Jul 11 04:27:02.288414 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:02.288368    2576 scope.go:117] "RemoveContainer" containerID="5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311"
Jul 11 04:27:02.297658 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:02.297642    2576 scope.go:117] "RemoveContainer" containerID="5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311"
Jul 11 04:27:02.297919 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:27:02.297900    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311\": container with ID starting with 5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311 not found: ID does not exist" containerID="5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311"
Jul 11 04:27:02.297962 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:02.297928    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311"} err="failed to get container status \"5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311\": rpc error: code = NotFound desc = could not find container \"5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311\": container with ID starting with 5b0cecaa89db51f983ac075da517638dd778837cfb8cced5e84bf5b4d1e1e311 not found: ID does not exist"
Jul 11 04:27:02.310146 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:02.310121    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"]
Jul 11 04:27:02.312592 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:02.312571    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1c4bfd-89bc49874-dj82l"]
Jul 11 04:27:03.477517 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:03.477482    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5cdac8b-95b3-4a48-bba0-2d57975a51c4" path="/var/lib/kubelet/pods/a5cdac8b-95b3-4a48-bba0-2d57975a51c4/volumes"
Jul 11 04:27:16.776008 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:16.775967    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"]
Jul 11 04:27:16.776510 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:16.776204    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy" containerID="cri-o://e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca" gracePeriod=30
Jul 11 04:27:17.138103 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.138007    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm"]
Jul 11 04:27:17.138467 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.138450    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b" containerName="revoke-keys"
Jul 11 04:27:17.138576 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.138469    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b" containerName="revoke-keys"
Jul 11 04:27:17.138576 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.138496    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5cdac8b-95b3-4a48-bba0-2d57975a51c4" containerName="maas-api"
Jul 11 04:27:17.138576 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.138505    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5cdac8b-95b3-4a48-bba0-2d57975a51c4" containerName="maas-api"
Jul 11 04:27:17.138726 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.138582    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b" containerName="revoke-keys"
Jul 11 04:27:17.138726 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.138600    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5cdac8b-95b3-4a48-bba0-2d57975a51c4" containerName="maas-api"
Jul 11 04:27:17.142003 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.141982    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm"
Jul 11 04:27:17.144539 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.144514    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:27:17.147241 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.147218    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm"]
Jul 11 04:27:17.152392 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.152370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49521528-c333-496b-adda-a9cd011da94f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm\" (UID: \"49521528-c333-496b-adda-a9cd011da94f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm"
Jul 11 04:27:17.252891 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.252858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49521528-c333-496b-adda-a9cd011da94f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm\" (UID: \"49521528-c333-496b-adda-a9cd011da94f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm"
Jul 11 04:27:17.253507 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.253485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49521528-c333-496b-adda-a9cd011da94f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm\" (UID: \"49521528-c333-496b-adda-a9cd011da94f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm"
Jul 11 04:27:17.453436 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.453316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm"
Jul 11 04:27:17.577380 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:17.577357    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm"]
Jul 11 04:27:17.578225 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:27:17.578205    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49521528_c333_496b_adda_a9cd011da94f.slice/crio-fe59d1212fd77dc3a7003e2776923cc1b298c26c2c165fc0666fa2e7875a9dd3 WatchSource:0}: Error finding container fe59d1212fd77dc3a7003e2776923cc1b298c26c2c165fc0666fa2e7875a9dd3: Status 404 returned error can't find the container with id fe59d1212fd77dc3a7003e2776923cc1b298c26c2c165fc0666fa2e7875a9dd3
Jul 11 04:27:18.379023 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:18.378986    2576 generic.go:356] "Generic (PLEG): container finished" podID="49521528-c333-496b-adda-a9cd011da94f" containerID="24a7ab3a5a99c3ef299e7353fe401fadda942b7382d31356a4ff6730209ac388" exitCode=0
Jul 11 04:27:18.379435 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:18.379057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm" event={"ID":"49521528-c333-496b-adda-a9cd011da94f","Type":"ContainerDied","Data":"24a7ab3a5a99c3ef299e7353fe401fadda942b7382d31356a4ff6730209ac388"}
Jul 11 04:27:18.379435 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:18.379103    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm" event={"ID":"49521528-c333-496b-adda-a9cd011da94f","Type":"ContainerStarted","Data":"fe59d1212fd77dc3a7003e2776923cc1b298c26c2c165fc0666fa2e7875a9dd3"}
Jul 11 04:27:19.520356 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:19.520316    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm"
Jul 11 04:27:19.572169 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:19.572136    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49521528-c333-496b-adda-a9cd011da94f-maas-api-service-ca\") pod \"49521528-c333-496b-adda-a9cd011da94f\" (UID: \"49521528-c333-496b-adda-a9cd011da94f\") "
Jul 11 04:27:19.572473 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:19.572453    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49521528-c333-496b-adda-a9cd011da94f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "49521528-c333-496b-adda-a9cd011da94f" (UID: "49521528-c333-496b-adda-a9cd011da94f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:27:19.672979 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:19.672875    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49521528-c333-496b-adda-a9cd011da94f-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:19.722058 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:19.722023    2576 patch_prober.go:28] interesting pod/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 04:27:19.722216 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:19.722080    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 04:27:20.390892 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:20.390857    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm"
Jul 11 04:27:20.390892 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:20.390884    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm" event={"ID":"49521528-c333-496b-adda-a9cd011da94f","Type":"ContainerDied","Data":"fe59d1212fd77dc3a7003e2776923cc1b298c26c2c165fc0666fa2e7875a9dd3"}
Jul 11 04:27:20.391094 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:20.390923    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe59d1212fd77dc3a7003e2776923cc1b298c26c2c165fc0666fa2e7875a9dd3"
Jul 11 04:27:22.021558 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.021535    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:27:22.094623 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.094523    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-envoy\") pod \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") "
Jul 11 04:27:22.094623 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.094571    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-socket\") pod \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") "
Jul 11 04:27:22.094623 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.094605    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istiod-ca-cert\") pod \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") "
Jul 11 04:27:22.094623 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.094621    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-credential-socket\") pod \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") "
Jul 11 04:27:22.094948 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.094643    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzjft\" (UniqueName: \"kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-kube-api-access-pzjft\") pod \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") "
Jul 11 04:27:22.094948 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.094705    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-token\") pod \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") "
Jul 11 04:27:22.094948 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.094756    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-certs\") pod \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") "
Jul 11 04:27:22.094948 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.094789    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-podinfo\") pod \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") "
Jul 11 04:27:22.094948 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.094818    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-data\") pod \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\" (UID: \"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce\") "
Jul 11 04:27:22.095267 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.094976    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" (UID: "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:27:22.095267 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.094992    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" (UID: "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:27:22.095267 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.095079    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" (UID: "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:27:22.095267 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.095154    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:22.095267 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.095173    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-credential-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:22.095267 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.095207    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" (UID: "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:27:22.095957 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.095930    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" (UID: "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:27:22.096877 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.096847    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" (UID: "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:27:22.096877 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.096851    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" (UID: "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:27:22.097050 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.096881    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-kube-api-access-pzjft" (OuterVolumeSpecName: "kube-api-access-pzjft") pod "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" (UID: "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce"). InnerVolumeSpecName "kube-api-access-pzjft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:27:22.097050 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.097024    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" (UID: "9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:27:22.195928 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.195895    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-envoy\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:22.195928 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.195922    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istiod-ca-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:22.195928 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.195931    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzjft\" (UniqueName: \"kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-kube-api-access-pzjft\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:22.196163 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.195942    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-token\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:22.196163 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.195951    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-workload-certs\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:22.196163 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.195960    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-podinfo\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:22.196163 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.195967    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce-istio-data\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:22.403735 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.403649    2576 generic.go:356] "Generic (PLEG): container finished" podID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerID="e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca" exitCode=0
Jul 11 04:27:22.403735 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.403699    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"
Jul 11 04:27:22.403735 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.403714    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" event={"ID":"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce","Type":"ContainerDied","Data":"e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca"}
Jul 11 04:27:22.403930 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.403800    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96" event={"ID":"9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce","Type":"ContainerDied","Data":"d245fa60eb6d5794b4fb8c5c686f7d06ca7b60ee765424f4f08830f865103942"}
Jul 11 04:27:22.403930 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.403829    2576 scope.go:117] "RemoveContainer" containerID="e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca"
Jul 11 04:27:22.413549 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.413527    2576 scope.go:117] "RemoveContainer" containerID="5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48"
Jul 11 04:27:22.424081 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.424059    2576 scope.go:117] "RemoveContainer" containerID="e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca"
Jul 11 04:27:22.424532 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:27:22.424511    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca\": container with ID starting with e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca not found: ID does not exist" containerID="e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca"
Jul 11 04:27:22.424617 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.424540    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca"} err="failed to get container status \"e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca\": rpc error: code = NotFound desc = could not find container \"e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca\": container with ID starting with e9b71918b64262237d577011490bdde10ae0b3cd4f242bb8fe94a5bd382faeca not found: ID does not exist"
Jul 11 04:27:22.424617 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.424558    2576 scope.go:117] "RemoveContainer" containerID="5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48"
Jul 11 04:27:22.424826 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:27:22.424807    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48\": container with ID starting with 5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48 not found: ID does not exist" containerID="5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48"
Jul 11 04:27:22.424884 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.424839    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48"} err="failed to get container status \"5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48\": rpc error: code = NotFound desc = could not find container \"5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48\": container with ID starting with 5db1c8b89aa76ce621ba1d413ae63e181d04b4ee8a88a803a3d64920ff69da48 not found: ID does not exist"
Jul 11 04:27:22.425990 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.425972    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"]
Jul 11 04:27:22.430234 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:22.430215    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1c4bfd-openshift-default-6fbfb9944c-g4f96"]
Jul 11 04:27:23.477040 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:23.477006    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" path="/var/lib/kubelet/pods/9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce/volumes"
Jul 11 04:27:27.506653 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.506619    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"]
Jul 11 04:27:27.507085 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.506833    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk" podUID="1297df84-2130-466b-8ed9-c4fedaca77bd" containerName="maas-api" containerID="cri-o://0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b" gracePeriod=30
Jul 11 04:27:27.747531 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.747496    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:27:27.839873 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.839845    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvcnp\" (UniqueName: \"kubernetes.io/projected/1297df84-2130-466b-8ed9-c4fedaca77bd-kube-api-access-fvcnp\") pod \"1297df84-2130-466b-8ed9-c4fedaca77bd\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") "
Jul 11 04:27:27.840034 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.839933    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1297df84-2130-466b-8ed9-c4fedaca77bd-maas-api-tls\") pod \"1297df84-2130-466b-8ed9-c4fedaca77bd\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") "
Jul 11 04:27:27.840034 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.839973    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1297df84-2130-466b-8ed9-c4fedaca77bd-openshift-service-ca\") pod \"1297df84-2130-466b-8ed9-c4fedaca77bd\" (UID: \"1297df84-2130-466b-8ed9-c4fedaca77bd\") "
Jul 11 04:27:27.840365 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.840315    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1297df84-2130-466b-8ed9-c4fedaca77bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1297df84-2130-466b-8ed9-c4fedaca77bd" (UID: "1297df84-2130-466b-8ed9-c4fedaca77bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:27:27.841884 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.841865    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1297df84-2130-466b-8ed9-c4fedaca77bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1297df84-2130-466b-8ed9-c4fedaca77bd" (UID: "1297df84-2130-466b-8ed9-c4fedaca77bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:27:27.841964 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.841898    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1297df84-2130-466b-8ed9-c4fedaca77bd-kube-api-access-fvcnp" (OuterVolumeSpecName: "kube-api-access-fvcnp") pod "1297df84-2130-466b-8ed9-c4fedaca77bd" (UID: "1297df84-2130-466b-8ed9-c4fedaca77bd"). InnerVolumeSpecName "kube-api-access-fvcnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:27:27.941443 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.941404    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1297df84-2130-466b-8ed9-c4fedaca77bd-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:27.941443 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.941440    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvcnp\" (UniqueName: \"kubernetes.io/projected/1297df84-2130-466b-8ed9-c4fedaca77bd-kube-api-access-fvcnp\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:27.941443 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:27.941450    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1297df84-2130-466b-8ed9-c4fedaca77bd-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:27:28.439946 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:28.439909    2576 generic.go:356] "Generic (PLEG): container finished" podID="1297df84-2130-466b-8ed9-c4fedaca77bd" containerID="0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b" exitCode=0
Jul 11 04:27:28.440123 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:28.439959    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"
Jul 11 04:27:28.440123 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:28.439991    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk" event={"ID":"1297df84-2130-466b-8ed9-c4fedaca77bd","Type":"ContainerDied","Data":"0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b"}
Jul 11 04:27:28.440123 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:28.440043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk" event={"ID":"1297df84-2130-466b-8ed9-c4fedaca77bd","Type":"ContainerDied","Data":"abf0cd022ae4f4608eb0a5dea04cb4a755c7320c9632cc5cddfe8ae1bccd3325"}
Jul 11 04:27:28.440123 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:28.440070    2576 scope.go:117] "RemoveContainer" containerID="0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b"
Jul 11 04:27:28.448917 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:28.448900    2576 scope.go:117] "RemoveContainer" containerID="0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b"
Jul 11 04:27:28.449138 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:27:28.449118    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b\": container with ID starting with 0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b not found: ID does not exist" containerID="0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b"
Jul 11 04:27:28.449181 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:28.449146    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b"} err="failed to get container status \"0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b\": rpc error: code = NotFound desc = could not find container \"0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b\": container with ID starting with 0f80061c8daca8ce9b3e6e3ff40beacf0dbe1cb353ddadf87a1fec118a80d01b not found: ID does not exist"
Jul 11 04:27:28.460099 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:28.460073    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"]
Jul 11 04:27:28.463849 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:28.463827    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a8084b-564b4464db-4wkzk"]
Jul 11 04:27:29.477820 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:29.477785    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1297df84-2130-466b-8ed9-c4fedaca77bd" path="/var/lib/kubelet/pods/1297df84-2130-466b-8ed9-c4fedaca77bd/volumes"
Jul 11 04:27:43.794032 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.793953    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"]
Jul 11 04:27:43.794861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.794469    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49521528-c333-496b-adda-a9cd011da94f" containerName="revoke-keys"
Jul 11 04:27:43.794861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.794486    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="49521528-c333-496b-adda-a9cd011da94f" containerName="revoke-keys"
Jul 11 04:27:43.794861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.794506    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1297df84-2130-466b-8ed9-c4fedaca77bd" containerName="maas-api"
Jul 11 04:27:43.794861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.794512    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1297df84-2130-466b-8ed9-c4fedaca77bd" containerName="maas-api"
Jul 11 04:27:43.794861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.794519    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy"
Jul 11 04:27:43.794861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.794525    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy"
Jul 11 04:27:43.794861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.794533    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy"
Jul 11 04:27:43.794861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.794539    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy"
Jul 11 04:27:43.794861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.794592    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy"
Jul 11 04:27:43.794861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.794599    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="49521528-c333-496b-adda-a9cd011da94f" containerName="revoke-keys"
Jul 11 04:27:43.794861 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.794608    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1297df84-2130-466b-8ed9-c4fedaca77bd" containerName="maas-api"
Jul 11 04:27:43.799430 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.799409    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.801777 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.801753    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3055d9-openshift-default-dockercfg-xmr8j\""
Jul 11 04:27:43.809853 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.809831    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"]
Jul 11 04:27:43.880724 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.880689    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-token\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.880724 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.880729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-data\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.880925 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.880748    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-podinfo\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.880925 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.880773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-credential-socket\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.880925 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.880804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istiod-ca-cert\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.880925 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.880867    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hczn\" (UniqueName: \"kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-kube-api-access-8hczn\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.880925 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.880884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-envoy\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.880925 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.880905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-socket\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.880925 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.880924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-certs\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.981618 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.981584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-certs\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.981816 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.981647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-token\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.981816 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.981678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-data\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.981816 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.981702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-podinfo\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.981816 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.981727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-credential-socket\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.981816 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.981762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istiod-ca-cert\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.982073 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.981825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hczn\" (UniqueName: \"kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-kube-api-access-8hczn\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.982073 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.981853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-envoy\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.982073 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.981888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-socket\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.982191 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.982093    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-data\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.982296 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.982273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-credential-socket\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.982382 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.982345    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-certs\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.982446 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.982408    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-socket\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.982654 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.982636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istiod-ca-cert\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.984061 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.984040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-podinfo\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.984150 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.984065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-envoy\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.995722 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.995689    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-token\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:43.995855 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:43.995805    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hczn\" (UniqueName: \"kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-kube-api-access-8hczn\") pod \"e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") " pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:44.110448 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:44.110373    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:44.245360 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:44.245322    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"]
Jul 11 04:27:44.246782 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:27:44.246760    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ebc431d_ef9f_4a56_bd11_a28dc4984d30.slice/crio-56e950eb468c1dcf6164fc2eb489f7397c94920f4fabd15abd9476b11a302f7b WatchSource:0}: Error finding container 56e950eb468c1dcf6164fc2eb489f7397c94920f4fabd15abd9476b11a302f7b: Status 404 returned error can't find the container with id 56e950eb468c1dcf6164fc2eb489f7397c94920f4fabd15abd9476b11a302f7b
Jul 11 04:27:44.248774 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:44.248744    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:27:44.248865 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:44.248807    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:27:44.248865 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:44.248837    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:27:44.528937 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:44.528904    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" event={"ID":"2ebc431d-ef9f-4a56-bd11-a28dc4984d30","Type":"ContainerStarted","Data":"df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809"}
Jul 11 04:27:44.529103 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:44.528957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" event={"ID":"2ebc431d-ef9f-4a56-bd11-a28dc4984d30","Type":"ContainerStarted","Data":"56e950eb468c1dcf6164fc2eb489f7397c94920f4fabd15abd9476b11a302f7b"}
Jul 11 04:27:44.550077 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:44.550029    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" podStartSLOduration=1.5500150270000002 podStartE2EDuration="1.550015027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:27:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:27:44.548209045 +0000 UTC m=+2337.733361500" watchObservedRunningTime="2026-07-11 04:27:44.550015027 +0000 UTC m=+2337.735167539"
Jul 11 04:27:45.111401 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:45.111367    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:45.116050 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:45.116024    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:45.534997 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:45.534974    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:45.535826 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:45.535806    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:27:46.526747 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.526717    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"]
Jul 11 04:27:46.527343 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.527304    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f78dd59-1b2b-4d48-8c67-cbbdce0a45ce" containerName="istio-proxy"
Jul 11 04:27:46.530501 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.530480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:46.533201 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.533176    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-3055d9-serving-cert\""
Jul 11 04:27:46.533201 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.533190    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-drsms\""
Jul 11 04:27:46.541228 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.541201    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"]
Jul 11 04:27:46.607262 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.607226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e357782-482a-4bee-ae0e-9db8d2120d2c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:46.607445 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.607286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr9p4\" (UniqueName: \"kubernetes.io/projected/0e357782-482a-4bee-ae0e-9db8d2120d2c-kube-api-access-qr9p4\") pod \"maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:46.607445 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.607379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e357782-482a-4bee-ae0e-9db8d2120d2c-maas-api-tls\") pod \"maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:46.708132 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.708095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr9p4\" (UniqueName: \"kubernetes.io/projected/0e357782-482a-4bee-ae0e-9db8d2120d2c-kube-api-access-qr9p4\") pod \"maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:46.708315 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.708142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e357782-482a-4bee-ae0e-9db8d2120d2c-maas-api-tls\") pod \"maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:46.708315 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.708231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e357782-482a-4bee-ae0e-9db8d2120d2c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:46.708885 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.708861    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e357782-482a-4bee-ae0e-9db8d2120d2c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:46.710672 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.710649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e357782-482a-4bee-ae0e-9db8d2120d2c-maas-api-tls\") pod \"maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:46.718532 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.718506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr9p4\" (UniqueName: \"kubernetes.io/projected/0e357782-482a-4bee-ae0e-9db8d2120d2c-kube-api-access-qr9p4\") pod \"maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:46.843995 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.843909    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:46.977584 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:46.974720    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"]
Jul 11 04:27:46.978191 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:27:46.978164    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e357782_482a_4bee_ae0e_9db8d2120d2c.slice/crio-cf38f41477e78738c109783a3a897168ede44ca83e668fcc9ce170af4fedfe2a WatchSource:0}: Error finding container cf38f41477e78738c109783a3a897168ede44ca83e668fcc9ce170af4fedfe2a: Status 404 returned error can't find the container with id cf38f41477e78738c109783a3a897168ede44ca83e668fcc9ce170af4fedfe2a
Jul 11 04:27:47.550276 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:47.550185    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd" event={"ID":"0e357782-482a-4bee-ae0e-9db8d2120d2c","Type":"ContainerStarted","Data":"ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233"}
Jul 11 04:27:47.550276 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:47.550253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd" event={"ID":"0e357782-482a-4bee-ae0e-9db8d2120d2c","Type":"ContainerStarted","Data":"cf38f41477e78738c109783a3a897168ede44ca83e668fcc9ce170af4fedfe2a"}
Jul 11 04:27:47.550681 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:47.550279    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:47.567010 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:47.566955    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd" podStartSLOduration=1.248111877 podStartE2EDuration="1.56694009s" totalImagesPullingTime="318.828213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:27:47.564149642 +0000 UTC m=+2340.749302096" watchObservedRunningTime="2026-07-11 04:27:47.56694009 +0000 UTC m=+2340.752092544"
Jul 11 04:27:53.577400 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:53.577365    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:27:55.070545 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.070512    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"]
Jul 11 04:27:55.075866 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.075412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:55.083353 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.081968    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-eefca5-serving-cert\""
Jul 11 04:27:55.090618 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.090592    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"]
Jul 11 04:27:55.189730 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.189693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txg8x\" (UniqueName: \"kubernetes.io/projected/36ecf89b-540b-4e50-a495-8d9364a08b8d-kube-api-access-txg8x\") pod \"maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:55.189912 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.189760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36ecf89b-540b-4e50-a495-8d9364a08b8d-maas-api-tls\") pod \"maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:55.189912 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.189788    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ecf89b-540b-4e50-a495-8d9364a08b8d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:55.290540 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.290502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txg8x\" (UniqueName: \"kubernetes.io/projected/36ecf89b-540b-4e50-a495-8d9364a08b8d-kube-api-access-txg8x\") pod \"maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:55.290744 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.290560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36ecf89b-540b-4e50-a495-8d9364a08b8d-maas-api-tls\") pod \"maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:55.290744 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.290577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ecf89b-540b-4e50-a495-8d9364a08b8d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:55.291172 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.291153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ecf89b-540b-4e50-a495-8d9364a08b8d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:55.292860 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.292837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36ecf89b-540b-4e50-a495-8d9364a08b8d-maas-api-tls\") pod \"maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:55.299482 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.299458    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txg8x\" (UniqueName: \"kubernetes.io/projected/36ecf89b-540b-4e50-a495-8d9364a08b8d-kube-api-access-txg8x\") pod \"maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:55.393545 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.393452    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:55.546080 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.546056    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"]
Jul 11 04:27:55.547719 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:27:55.547694    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ecf89b_540b_4e50_a495_8d9364a08b8d.slice/crio-b54a5a8b3bed972af62bb656346b5ef728d1540ae245f60768a9a2accec880c2 WatchSource:0}: Error finding container b54a5a8b3bed972af62bb656346b5ef728d1540ae245f60768a9a2accec880c2: Status 404 returned error can't find the container with id b54a5a8b3bed972af62bb656346b5ef728d1540ae245f60768a9a2accec880c2
Jul 11 04:27:55.600273 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:55.600237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd" event={"ID":"36ecf89b-540b-4e50-a495-8d9364a08b8d","Type":"ContainerStarted","Data":"b54a5a8b3bed972af62bb656346b5ef728d1540ae245f60768a9a2accec880c2"}
Jul 11 04:27:56.608261 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:56.608222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd" event={"ID":"36ecf89b-540b-4e50-a495-8d9364a08b8d","Type":"ContainerStarted","Data":"43742f286e5a5cba7df3dfe58ef804bd82ac9cab4bd3a8f632ac6d1f6cb99de1"}
Jul 11 04:27:56.608751 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:56.608280    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:27:56.624996 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:27:56.624938    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd" podStartSLOduration=1.2221385869999999 podStartE2EDuration="1.624923459s" totalImagesPullingTime="402.784872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:27:56.621904574 +0000 UTC m=+2349.807057026" watchObservedRunningTime="2026-07-11 04:27:56.624923459 +0000 UTC m=+2349.810075936"
Jul 11 04:28:00.536530 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:00.536491    2576 patch_prober.go:28] interesting pod/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 11 04:28:00.536926 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:00.536562    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" podUID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 11 04:28:00.632862 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:00.632830    2576 generic.go:356] "Generic (PLEG): container finished" podID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" containerID="df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809" exitCode=0
Jul 11 04:28:00.633023 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:00.632901    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" event={"ID":"2ebc431d-ef9f-4a56-bd11-a28dc4984d30","Type":"ContainerDied","Data":"df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809"}
Jul 11 04:28:00.633300 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:00.633287    2576 scope.go:117] "RemoveContainer" containerID="df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809"
Jul 11 04:28:00.634285 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:00.634254    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:28:00.634406 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:00.634322    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:28:00.634406 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:00.634382    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 11 04:28:01.640717 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:01.640682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" event={"ID":"2ebc431d-ef9f-4a56-bd11-a28dc4984d30","Type":"ContainerStarted","Data":"6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48"}
Jul 11 04:28:02.110768 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:02.110727    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:28:02.110936 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:02.110904    2576 patch_prober.go:28] interesting pod/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 11 04:28:02.111027 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:02.110951    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" podUID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 11 04:28:02.618760 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:02.618728    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:28:03.111167 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:03.111126    2576 patch_prober.go:28] interesting pod/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 11 04:28:03.111619 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:03.111186    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" podUID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 11 04:28:04.110932 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:04.110893    2576 patch_prober.go:28] interesting pod/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 11 04:28:04.111135 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:04.110949    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" podUID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 11 04:28:05.110827 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:05.110797    2576 patch_prober.go:28] interesting pod/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 11 04:28:05.111234 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:05.110849    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" podUID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 11 04:28:06.114694 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:06.114660    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:28:06.115161 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:06.115050    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:28:06.115660 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:28:06.115633    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:30:00.132668 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.132634    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr"]
Jul 11 04:30:00.136178 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.136154    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m"]
Jul 11 04:30:00.136308 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.136268    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr"
Jul 11 04:30:00.138242 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.138219    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:30:00.139423 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.139403    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd"]
Jul 11 04:30:00.139541 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.139519    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m"
Jul 11 04:30:00.143615 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.143588    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m"]
Jul 11 04:30:00.143952 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.143789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd"
Jul 11 04:30:00.146790 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.146372    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr"]
Jul 11 04:30:00.149681 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.149661    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd"]
Jul 11 04:30:00.152272 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.152251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr"
Jul 11 04:30:00.159424 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.159404    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m"
Jul 11 04:30:00.190400 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.190373    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd"
Jul 11 04:30:00.304593 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.304281    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr"]
Jul 11 04:30:00.305400 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:30:00.305343    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b092691_dd36_4c3e_84aa_009478bb1ea6.slice/crio-230bf5bd375e335bcb3e2c813fde01b661c26038e5ca25f18424aaca1ba3b98f WatchSource:0}: Error finding container 230bf5bd375e335bcb3e2c813fde01b661c26038e5ca25f18424aaca1ba3b98f: Status 404 returned error can't find the container with id 230bf5bd375e335bcb3e2c813fde01b661c26038e5ca25f18424aaca1ba3b98f
Jul 11 04:30:00.332145 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.332119    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m"]
Jul 11 04:30:00.340663 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:30:00.340624    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd217fc3_2666_4c5f_9e13_969cd3eb0d6c.slice/crio-042b5faff81d92aa2de335186f697864ca630678de7548b6e24e7f25dfa225ad WatchSource:0}: Error finding container 042b5faff81d92aa2de335186f697864ca630678de7548b6e24e7f25dfa225ad: Status 404 returned error can't find the container with id 042b5faff81d92aa2de335186f697864ca630678de7548b6e24e7f25dfa225ad
Jul 11 04:30:00.357297 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:00.357272    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd"]
Jul 11 04:30:00.365273 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:30:00.365248    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1f803e_b9b6_4cd8_a7f5_377f78a0119b.slice/crio-e61c1e161d39543dec7d82db8babf1a212fd00182872d3734891ab07c5b8d14a WatchSource:0}: Error finding container e61c1e161d39543dec7d82db8babf1a212fd00182872d3734891ab07c5b8d14a: Status 404 returned error can't find the container with id e61c1e161d39543dec7d82db8babf1a212fd00182872d3734891ab07c5b8d14a
Jul 11 04:30:01.312511 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:01.312482    2576 generic.go:356] "Generic (PLEG): container finished" podID="5b092691-dd36-4c3e-84aa-009478bb1ea6" containerID="0f49e1d9ff1b5b7bdb20d59b996047e6dc0b506c1fe60d3aa8b3c340bab3b79f" exitCode=0
Jul 11 04:30:01.312893 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:01.312536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr" event={"ID":"5b092691-dd36-4c3e-84aa-009478bb1ea6","Type":"ContainerDied","Data":"0f49e1d9ff1b5b7bdb20d59b996047e6dc0b506c1fe60d3aa8b3c340bab3b79f"}
Jul 11 04:30:01.312893 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:01.312626    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr" event={"ID":"5b092691-dd36-4c3e-84aa-009478bb1ea6","Type":"ContainerStarted","Data":"230bf5bd375e335bcb3e2c813fde01b661c26038e5ca25f18424aaca1ba3b98f"}
Jul 11 04:30:01.314070 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:01.314048    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd" event={"ID":"3a1f803e-b9b6-4cd8-a7f5-377f78a0119b","Type":"ContainerStarted","Data":"1866d94d8dd88c03f174e3634787a47e26a0db15cb0a3180ed7f34acdec7936d"}
Jul 11 04:30:01.314170 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:01.314091    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd" event={"ID":"3a1f803e-b9b6-4cd8-a7f5-377f78a0119b","Type":"ContainerStarted","Data":"e61c1e161d39543dec7d82db8babf1a212fd00182872d3734891ab07c5b8d14a"}
Jul 11 04:30:01.315407 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:01.315384    2576 generic.go:356] "Generic (PLEG): container finished" podID="fd217fc3-2666-4c5f-9e13-969cd3eb0d6c" containerID="1436cbfe070f0a9c9620ce32744a8564f6ad56540dfd9cf045d32764c7d15baf" exitCode=0
Jul 11 04:30:01.315504 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:01.315441    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m" event={"ID":"fd217fc3-2666-4c5f-9e13-969cd3eb0d6c","Type":"ContainerDied","Data":"1436cbfe070f0a9c9620ce32744a8564f6ad56540dfd9cf045d32764c7d15baf"}
Jul 11 04:30:01.315504 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:01.315472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m" event={"ID":"fd217fc3-2666-4c5f-9e13-969cd3eb0d6c","Type":"ContainerStarted","Data":"042b5faff81d92aa2de335186f697864ca630678de7548b6e24e7f25dfa225ad"}
Jul 11 04:30:01.349366 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:01.349302    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd" podStartSLOduration=1.349287642 podStartE2EDuration="1.349287642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:30:01.347578543 +0000 UTC m=+2474.532730996" watchObservedRunningTime="2026-07-11 04:30:01.349287642 +0000 UTC m=+2474.534440095"
Jul 11 04:30:02.322571 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:02.322537    2576 generic.go:356] "Generic (PLEG): container finished" podID="3a1f803e-b9b6-4cd8-a7f5-377f78a0119b" containerID="1866d94d8dd88c03f174e3634787a47e26a0db15cb0a3180ed7f34acdec7936d" exitCode=0
Jul 11 04:30:02.322974 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:02.322629    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd" event={"ID":"3a1f803e-b9b6-4cd8-a7f5-377f78a0119b","Type":"ContainerDied","Data":"1866d94d8dd88c03f174e3634787a47e26a0db15cb0a3180ed7f34acdec7936d"}
Jul 11 04:30:02.458085 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:02.458059    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr"
Jul 11 04:30:02.494839 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:02.494817    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m"
Jul 11 04:30:03.329211 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:03.329180    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m"
Jul 11 04:30:03.329670 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:03.329219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m" event={"ID":"fd217fc3-2666-4c5f-9e13-969cd3eb0d6c","Type":"ContainerDied","Data":"042b5faff81d92aa2de335186f697864ca630678de7548b6e24e7f25dfa225ad"}
Jul 11 04:30:03.329670 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:03.329266    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="042b5faff81d92aa2de335186f697864ca630678de7548b6e24e7f25dfa225ad"
Jul 11 04:30:03.330596 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:03.330581    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr"
Jul 11 04:30:03.330688 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:03.330635    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr" event={"ID":"5b092691-dd36-4c3e-84aa-009478bb1ea6","Type":"ContainerDied","Data":"230bf5bd375e335bcb3e2c813fde01b661c26038e5ca25f18424aaca1ba3b98f"}
Jul 11 04:30:03.330688 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:03.330681    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="230bf5bd375e335bcb3e2c813fde01b661c26038e5ca25f18424aaca1ba3b98f"
Jul 11 04:30:03.456554 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:03.456532    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd"
Jul 11 04:30:04.337281 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:04.337250    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd"
Jul 11 04:30:04.337724 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:04.337287    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29729070-7q7nd" event={"ID":"3a1f803e-b9b6-4cd8-a7f5-377f78a0119b","Type":"ContainerDied","Data":"e61c1e161d39543dec7d82db8babf1a212fd00182872d3734891ab07c5b8d14a"}
Jul 11 04:30:04.337724 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:30:04.337387    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e61c1e161d39543dec7d82db8babf1a212fd00182872d3734891ab07c5b8d14a"
Jul 11 04:34:15.205570 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.205530    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls"]
Jul 11 04:34:15.206000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.205878    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1f803e-b9b6-4cd8-a7f5-377f78a0119b" containerName="cleanup"
Jul 11 04:34:15.206000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.205889    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1f803e-b9b6-4cd8-a7f5-377f78a0119b" containerName="cleanup"
Jul 11 04:34:15.206000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.205904    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b092691-dd36-4c3e-84aa-009478bb1ea6" containerName="cleanup"
Jul 11 04:34:15.206000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.205910    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b092691-dd36-4c3e-84aa-009478bb1ea6" containerName="cleanup"
Jul 11 04:34:15.206000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.205918    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd217fc3-2666-4c5f-9e13-969cd3eb0d6c" containerName="cleanup"
Jul 11 04:34:15.206000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.205924    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd217fc3-2666-4c5f-9e13-969cd3eb0d6c" containerName="cleanup"
Jul 11 04:34:15.206000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.205984    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a1f803e-b9b6-4cd8-a7f5-377f78a0119b" containerName="cleanup"
Jul 11 04:34:15.206000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.205994    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd217fc3-2666-4c5f-9e13-969cd3eb0d6c" containerName="cleanup"
Jul 11 04:34:15.206000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.206000    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b092691-dd36-4c3e-84aa-009478bb1ea6" containerName="cleanup"
Jul 11 04:34:15.209065 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.209047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls"
Jul 11 04:34:15.211789 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.211761    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:34:15.215455 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.215429    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls"]
Jul 11 04:34:15.259365 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.259318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3e61c2c-99e2-4b92-ae94-a9330b09c6ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls\" (UID: \"d3e61c2c-99e2-4b92-ae94-a9330b09c6ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls"
Jul 11 04:34:15.360307 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.360267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3e61c2c-99e2-4b92-ae94-a9330b09c6ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls\" (UID: \"d3e61c2c-99e2-4b92-ae94-a9330b09c6ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls"
Jul 11 04:34:15.361000 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.360979    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3e61c2c-99e2-4b92-ae94-a9330b09c6ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls\" (UID: \"d3e61c2c-99e2-4b92-ae94-a9330b09c6ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls"
Jul 11 04:34:15.521732 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.521642    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls"
Jul 11 04:34:15.653880 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.653852    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls"]
Jul 11 04:34:15.654745 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:34:15.654720    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e61c2c_99e2_4b92_ae94_a9330b09c6ee.slice/crio-8e67bad6da4b43cea0396b406b9d985e364b1d7b9b29560758e773759c282560 WatchSource:0}: Error finding container 8e67bad6da4b43cea0396b406b9d985e364b1d7b9b29560758e773759c282560: Status 404 returned error can't find the container with id 8e67bad6da4b43cea0396b406b9d985e364b1d7b9b29560758e773759c282560
Jul 11 04:34:15.787546 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:15.787510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls" event={"ID":"d3e61c2c-99e2-4b92-ae94-a9330b09c6ee","Type":"ContainerStarted","Data":"8e67bad6da4b43cea0396b406b9d985e364b1d7b9b29560758e773759c282560"}
Jul 11 04:34:16.794713 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:16.794680    2576 generic.go:356] "Generic (PLEG): container finished" podID="d3e61c2c-99e2-4b92-ae94-a9330b09c6ee" containerID="aea9752b943d9b8059f2fdd99ff3d6e7bc000d227cf079974e54dc61db0e3b8c" exitCode=0
Jul 11 04:34:16.795126 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:16.794767    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls" event={"ID":"d3e61c2c-99e2-4b92-ae94-a9330b09c6ee","Type":"ContainerDied","Data":"aea9752b943d9b8059f2fdd99ff3d6e7bc000d227cf079974e54dc61db0e3b8c"}
Jul 11 04:34:17.934388 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:17.934364    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls"
Jul 11 04:34:17.980685 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:17.980653    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3e61c2c-99e2-4b92-ae94-a9330b09c6ee-maas-api-service-ca\") pod \"d3e61c2c-99e2-4b92-ae94-a9330b09c6ee\" (UID: \"d3e61c2c-99e2-4b92-ae94-a9330b09c6ee\") "
Jul 11 04:34:17.981007 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:17.980987    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3e61c2c-99e2-4b92-ae94-a9330b09c6ee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d3e61c2c-99e2-4b92-ae94-a9330b09c6ee" (UID: "d3e61c2c-99e2-4b92-ae94-a9330b09c6ee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:34:18.082072 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:18.081985    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3e61c2c-99e2-4b92-ae94-a9330b09c6ee-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:18.807709 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:18.807679    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls"
Jul 11 04:34:18.808005 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:18.807706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls" event={"ID":"d3e61c2c-99e2-4b92-ae94-a9330b09c6ee","Type":"ContainerDied","Data":"8e67bad6da4b43cea0396b406b9d985e364b1d7b9b29560758e773759c282560"}
Jul 11 04:34:18.808005 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:18.807760    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e67bad6da4b43cea0396b406b9d985e364b1d7b9b29560758e773759c282560"
Jul 11 04:34:25.589730 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:25.589692    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"]
Jul 11 04:34:25.590197 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:25.589963    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd" podUID="0e357782-482a-4bee-ae0e-9db8d2120d2c" containerName="maas-api" containerID="cri-o://ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233" gracePeriod=30
Jul 11 04:34:25.615968 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:25.615939    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr"]
Jul 11 04:34:25.618637 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:25.618615    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3055d9-29729070-jqxpr"]
Jul 11 04:34:26.039288 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.039264    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:34:26.152130 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.152052    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e357782-482a-4bee-ae0e-9db8d2120d2c-maas-api-tls\") pod \"0e357782-482a-4bee-ae0e-9db8d2120d2c\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") "
Jul 11 04:34:26.152130 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.152129    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e357782-482a-4bee-ae0e-9db8d2120d2c-openshift-service-ca\") pod \"0e357782-482a-4bee-ae0e-9db8d2120d2c\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") "
Jul 11 04:34:26.152304 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.152149    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr9p4\" (UniqueName: \"kubernetes.io/projected/0e357782-482a-4bee-ae0e-9db8d2120d2c-kube-api-access-qr9p4\") pod \"0e357782-482a-4bee-ae0e-9db8d2120d2c\" (UID: \"0e357782-482a-4bee-ae0e-9db8d2120d2c\") "
Jul 11 04:34:26.152504 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.152478    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e357782-482a-4bee-ae0e-9db8d2120d2c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e357782-482a-4bee-ae0e-9db8d2120d2c" (UID: "0e357782-482a-4bee-ae0e-9db8d2120d2c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:34:26.154263 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.154242    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e357782-482a-4bee-ae0e-9db8d2120d2c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e357782-482a-4bee-ae0e-9db8d2120d2c" (UID: "0e357782-482a-4bee-ae0e-9db8d2120d2c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:34:26.154384 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.154291    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e357782-482a-4bee-ae0e-9db8d2120d2c-kube-api-access-qr9p4" (OuterVolumeSpecName: "kube-api-access-qr9p4") pod "0e357782-482a-4bee-ae0e-9db8d2120d2c" (UID: "0e357782-482a-4bee-ae0e-9db8d2120d2c"). InnerVolumeSpecName "kube-api-access-qr9p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:26.252978 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.252935    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e357782-482a-4bee-ae0e-9db8d2120d2c-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:26.252978 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.252972    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e357782-482a-4bee-ae0e-9db8d2120d2c-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:26.252978 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.252983    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr9p4\" (UniqueName: \"kubernetes.io/projected/0e357782-482a-4bee-ae0e-9db8d2120d2c-kube-api-access-qr9p4\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:26.859734 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.859701    2576 generic.go:356] "Generic (PLEG): container finished" podID="0e357782-482a-4bee-ae0e-9db8d2120d2c" containerID="ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233" exitCode=0
Jul 11 04:34:26.860243 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.859756    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd" event={"ID":"0e357782-482a-4bee-ae0e-9db8d2120d2c","Type":"ContainerDied","Data":"ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233"}
Jul 11 04:34:26.860243 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.859763    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"
Jul 11 04:34:26.860243 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.859799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd" event={"ID":"0e357782-482a-4bee-ae0e-9db8d2120d2c","Type":"ContainerDied","Data":"cf38f41477e78738c109783a3a897168ede44ca83e668fcc9ce170af4fedfe2a"}
Jul 11 04:34:26.860243 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.859823    2576 scope.go:117] "RemoveContainer" containerID="ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233"
Jul 11 04:34:26.870189 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.870171    2576 scope.go:117] "RemoveContainer" containerID="ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233"
Jul 11 04:34:26.870510 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:34:26.870487    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233\": container with ID starting with ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233 not found: ID does not exist" containerID="ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233"
Jul 11 04:34:26.870580 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.870522    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233"} err="failed to get container status \"ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233\": rpc error: code = NotFound desc = could not find container \"ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233\": container with ID starting with ff317a757c998ed9d91cae7accbbac303a8a6157b49853174dc4c27e90cd4233 not found: ID does not exist"
Jul 11 04:34:26.883196 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.883169    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"]
Jul 11 04:34:26.885670 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:26.885650    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3055d9-5d57d5448f-4wjjd"]
Jul 11 04:34:27.477003 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:27.476972    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e357782-482a-4bee-ae0e-9db8d2120d2c" path="/var/lib/kubelet/pods/0e357782-482a-4bee-ae0e-9db8d2120d2c/volumes"
Jul 11 04:34:27.477260 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:27.477248    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b092691-dd36-4c3e-84aa-009478bb1ea6" path="/var/lib/kubelet/pods/5b092691-dd36-4c3e-84aa-009478bb1ea6/volumes"
Jul 11 04:34:40.954692 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:40.954658    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"]
Jul 11 04:34:40.955095 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:40.954919    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" podUID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" containerName="istio-proxy" containerID="cri-o://6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48" gracePeriod=30
Jul 11 04:34:41.316249 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.316212    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg"]
Jul 11 04:34:41.316643 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.316629    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e357782-482a-4bee-ae0e-9db8d2120d2c" containerName="maas-api"
Jul 11 04:34:41.316692 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.316647    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e357782-482a-4bee-ae0e-9db8d2120d2c" containerName="maas-api"
Jul 11 04:34:41.316692 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.316664    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3e61c2c-99e2-4b92-ae94-a9330b09c6ee" containerName="revoke-keys"
Jul 11 04:34:41.316692 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.316670    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3e61c2c-99e2-4b92-ae94-a9330b09c6ee" containerName="revoke-keys"
Jul 11 04:34:41.316783 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.316734    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e357782-482a-4bee-ae0e-9db8d2120d2c" containerName="maas-api"
Jul 11 04:34:41.316783 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.316747    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3e61c2c-99e2-4b92-ae94-a9330b09c6ee" containerName="revoke-keys"
Jul 11 04:34:41.321024 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.321004    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg"
Jul 11 04:34:41.323304 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.323279    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xz94b\""
Jul 11 04:34:41.325596 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.325571    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg"]
Jul 11 04:34:41.383458 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.383428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af9281a-40a6-44b7-bd7a-8718bc42cd2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg\" (UID: \"6af9281a-40a6-44b7-bd7a-8718bc42cd2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg"
Jul 11 04:34:41.484101 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.484073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af9281a-40a6-44b7-bd7a-8718bc42cd2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg\" (UID: \"6af9281a-40a6-44b7-bd7a-8718bc42cd2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg"
Jul 11 04:34:41.484689 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.484668    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af9281a-40a6-44b7-bd7a-8718bc42cd2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg\" (UID: \"6af9281a-40a6-44b7-bd7a-8718bc42cd2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg"
Jul 11 04:34:41.634619 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.634535    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg"
Jul 11 04:34:41.763276 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.763250    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg"]
Jul 11 04:34:41.763817 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:34:41.763786    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af9281a_40a6_44b7_bd7a_8718bc42cd2d.slice/crio-91bbdcb894de64d691015749aba5b46924b5013f605fab271b1968e09ca8af87 WatchSource:0}: Error finding container 91bbdcb894de64d691015749aba5b46924b5013f605fab271b1968e09ca8af87: Status 404 returned error can't find the container with id 91bbdcb894de64d691015749aba5b46924b5013f605fab271b1968e09ca8af87
Jul 11 04:34:41.949218 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:41.949128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg" event={"ID":"6af9281a-40a6-44b7-bd7a-8718bc42cd2d","Type":"ContainerStarted","Data":"91bbdcb894de64d691015749aba5b46924b5013f605fab271b1968e09ca8af87"}
Jul 11 04:34:42.956408 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:42.956368    2576 generic.go:356] "Generic (PLEG): container finished" podID="6af9281a-40a6-44b7-bd7a-8718bc42cd2d" containerID="7f01454cf88c0599ccd1e2546c1fa0e6ebdde52c605c340230a687daac804866" exitCode=0
Jul 11 04:34:42.956790 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:42.956468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg" event={"ID":"6af9281a-40a6-44b7-bd7a-8718bc42cd2d","Type":"ContainerDied","Data":"7f01454cf88c0599ccd1e2546c1fa0e6ebdde52c605c340230a687daac804866"}
Jul 11 04:34:44.094446 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:44.094422    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg"
Jul 11 04:34:44.206172 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:44.206137    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af9281a-40a6-44b7-bd7a-8718bc42cd2d-maas-api-service-ca\") pod \"6af9281a-40a6-44b7-bd7a-8718bc42cd2d\" (UID: \"6af9281a-40a6-44b7-bd7a-8718bc42cd2d\") "
Jul 11 04:34:44.206570 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:44.206544    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af9281a-40a6-44b7-bd7a-8718bc42cd2d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6af9281a-40a6-44b7-bd7a-8718bc42cd2d" (UID: "6af9281a-40a6-44b7-bd7a-8718bc42cd2d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:34:44.307314 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:44.307284    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6af9281a-40a6-44b7-bd7a-8718bc42cd2d-maas-api-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:44.970012 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:44.969978    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg" event={"ID":"6af9281a-40a6-44b7-bd7a-8718bc42cd2d","Type":"ContainerDied","Data":"91bbdcb894de64d691015749aba5b46924b5013f605fab271b1968e09ca8af87"}
Jul 11 04:34:44.970012 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:44.970002    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg"
Jul 11 04:34:44.970266 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:44.970026    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91bbdcb894de64d691015749aba5b46924b5013f605fab271b1968e09ca8af87"
Jul 11 04:34:46.214007 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.213952    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:34:46.323382 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.323323    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-data\") pod \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") "
Jul 11 04:34:46.323382 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.323382    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-socket\") pod \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") "
Jul 11 04:34:46.323618 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.323407    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-certs\") pod \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") "
Jul 11 04:34:46.323618 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.323434    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-token\") pod \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") "
Jul 11 04:34:46.323618 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.323481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-credential-socket\") pod \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") "
Jul 11 04:34:46.323618 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.323502    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istiod-ca-cert\") pod \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") "
Jul 11 04:34:46.323802 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.323684    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-envoy\") pod \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") "
Jul 11 04:34:46.323802 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.323696    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ebc431d-ef9f-4a56-bd11-a28dc4984d30" (UID: "2ebc431d-ef9f-4a56-bd11-a28dc4984d30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:46.323802 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.323736    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-podinfo\") pod \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") "
Jul 11 04:34:46.323802 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.323773    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hczn\" (UniqueName: \"kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-kube-api-access-8hczn\") pod \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\" (UID: \"2ebc431d-ef9f-4a56-bd11-a28dc4984d30\") "
Jul 11 04:34:46.324020 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.323811    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ebc431d-ef9f-4a56-bd11-a28dc4984d30" (UID: "2ebc431d-ef9f-4a56-bd11-a28dc4984d30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:46.324087 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.324013    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ebc431d-ef9f-4a56-bd11-a28dc4984d30" (UID: "2ebc431d-ef9f-4a56-bd11-a28dc4984d30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:34:46.324087 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.324072    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:46.324185 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.324098    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-workload-certs\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:46.324249 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.324172    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ebc431d-ef9f-4a56-bd11-a28dc4984d30" (UID: "2ebc431d-ef9f-4a56-bd11-a28dc4984d30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:46.324249 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.324179    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ebc431d-ef9f-4a56-bd11-a28dc4984d30" (UID: "2ebc431d-ef9f-4a56-bd11-a28dc4984d30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:46.325871 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.325847    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ebc431d-ef9f-4a56-bd11-a28dc4984d30" (UID: "2ebc431d-ef9f-4a56-bd11-a28dc4984d30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 11 04:34:46.326024 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.326006    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ebc431d-ef9f-4a56-bd11-a28dc4984d30" (UID: "2ebc431d-ef9f-4a56-bd11-a28dc4984d30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:46.326244 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.326225    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-kube-api-access-8hczn" (OuterVolumeSpecName: "kube-api-access-8hczn") pod "2ebc431d-ef9f-4a56-bd11-a28dc4984d30" (UID: "2ebc431d-ef9f-4a56-bd11-a28dc4984d30"). InnerVolumeSpecName "kube-api-access-8hczn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:46.326363 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.326318    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ebc431d-ef9f-4a56-bd11-a28dc4984d30" (UID: "2ebc431d-ef9f-4a56-bd11-a28dc4984d30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 04:34:46.425450 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.425421    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-token\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:46.425450 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.425447    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-credential-socket\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:46.425450 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.425456    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istiod-ca-cert\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:46.425676 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.425465    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-envoy\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:46.425676 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.425476    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-podinfo\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:46.425676 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.425484    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hczn\" (UniqueName: \"kubernetes.io/projected/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-kube-api-access-8hczn\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:46.425676 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.425492    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc431d-ef9f-4a56-bd11-a28dc4984d30-istio-data\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:46.983864 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.983827    2576 generic.go:356] "Generic (PLEG): container finished" podID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" containerID="6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48" exitCode=0
Jul 11 04:34:46.984034 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.983873    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"
Jul 11 04:34:46.984034 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.983911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" event={"ID":"2ebc431d-ef9f-4a56-bd11-a28dc4984d30","Type":"ContainerDied","Data":"6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48"}
Jul 11 04:34:46.984034 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.983969    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw" event={"ID":"2ebc431d-ef9f-4a56-bd11-a28dc4984d30","Type":"ContainerDied","Data":"56e950eb468c1dcf6164fc2eb489f7397c94920f4fabd15abd9476b11a302f7b"}
Jul 11 04:34:46.984034 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.983994    2576 scope.go:117] "RemoveContainer" containerID="6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48"
Jul 11 04:34:46.993915 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:46.993897    2576 scope.go:117] "RemoveContainer" containerID="df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809"
Jul 11 04:34:47.002733 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:47.002708    2576 scope.go:117] "RemoveContainer" containerID="6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48"
Jul 11 04:34:47.003069 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:34:47.003048    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48\": container with ID starting with 6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48 not found: ID does not exist" containerID="6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48"
Jul 11 04:34:47.003171 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:47.003081    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48"} err="failed to get container status \"6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48\": rpc error: code = NotFound desc = could not find container \"6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48\": container with ID starting with 6f613aee6a5e03e9312598b4e5186a27a3ff3d973fbb665128c2d72842b74a48 not found: ID does not exist"
Jul 11 04:34:47.003171 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:47.003104    2576 scope.go:117] "RemoveContainer" containerID="df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809"
Jul 11 04:34:47.003407 ip-10-0-135-235 kubenswrapper[2576]: E0711 04:34:47.003389    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809\": container with ID starting with df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809 not found: ID does not exist" containerID="df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809"
Jul 11 04:34:47.003459 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:47.003417    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809"} err="failed to get container status \"df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809\": rpc error: code = NotFound desc = could not find container \"df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809\": container with ID starting with df12b0cd973243940b80d60fe033f0af13c131096982a7478dab99b4ca552809 not found: ID does not exist"
Jul 11 04:34:47.005977 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:47.005761    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"]
Jul 11 04:34:47.008858 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:47.008837    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3055d9-openshift-default-d8899d459-8xshw"]
Jul 11 04:34:47.477206 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:47.477173    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" path="/var/lib/kubelet/pods/2ebc431d-ef9f-4a56-bd11-a28dc4984d30/volumes"
Jul 11 04:34:51.678453 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:51.678420    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"]
Jul 11 04:34:51.679304 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:51.678695    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd" podUID="36ecf89b-540b-4e50-a495-8d9364a08b8d" containerName="maas-api" containerID="cri-o://43742f286e5a5cba7df3dfe58ef804bd82ac9cab4bd3a8f632ac6d1f6cb99de1" gracePeriod=30
Jul 11 04:34:51.704477 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:51.704446    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m"]
Jul 11 04:34:51.706814 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:51.706794    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-eefca5-29729070-bnn7m"]
Jul 11 04:34:52.012178 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.012148    2576 generic.go:356] "Generic (PLEG): container finished" podID="36ecf89b-540b-4e50-a495-8d9364a08b8d" containerID="43742f286e5a5cba7df3dfe58ef804bd82ac9cab4bd3a8f632ac6d1f6cb99de1" exitCode=0
Jul 11 04:34:52.012390 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.012222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd" event={"ID":"36ecf89b-540b-4e50-a495-8d9364a08b8d","Type":"ContainerDied","Data":"43742f286e5a5cba7df3dfe58ef804bd82ac9cab4bd3a8f632ac6d1f6cb99de1"}
Jul 11 04:34:52.130059 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.130034    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:34:52.275339 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.275304    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txg8x\" (UniqueName: \"kubernetes.io/projected/36ecf89b-540b-4e50-a495-8d9364a08b8d-kube-api-access-txg8x\") pod \"36ecf89b-540b-4e50-a495-8d9364a08b8d\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") "
Jul 11 04:34:52.275508 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.275383    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ecf89b-540b-4e50-a495-8d9364a08b8d-openshift-service-ca\") pod \"36ecf89b-540b-4e50-a495-8d9364a08b8d\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") "
Jul 11 04:34:52.275508 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.275420    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36ecf89b-540b-4e50-a495-8d9364a08b8d-maas-api-tls\") pod \"36ecf89b-540b-4e50-a495-8d9364a08b8d\" (UID: \"36ecf89b-540b-4e50-a495-8d9364a08b8d\") "
Jul 11 04:34:52.275787 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.275753    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ecf89b-540b-4e50-a495-8d9364a08b8d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "36ecf89b-540b-4e50-a495-8d9364a08b8d" (UID: "36ecf89b-540b-4e50-a495-8d9364a08b8d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 04:34:52.277446 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.277414    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36ecf89b-540b-4e50-a495-8d9364a08b8d-kube-api-access-txg8x" (OuterVolumeSpecName: "kube-api-access-txg8x") pod "36ecf89b-540b-4e50-a495-8d9364a08b8d" (UID: "36ecf89b-540b-4e50-a495-8d9364a08b8d"). InnerVolumeSpecName "kube-api-access-txg8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 04:34:52.277446 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.277436    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ecf89b-540b-4e50-a495-8d9364a08b8d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "36ecf89b-540b-4e50-a495-8d9364a08b8d" (UID: "36ecf89b-540b-4e50-a495-8d9364a08b8d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 04:34:52.375923 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.375882    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txg8x\" (UniqueName: \"kubernetes.io/projected/36ecf89b-540b-4e50-a495-8d9364a08b8d-kube-api-access-txg8x\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:52.375923 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.375918    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ecf89b-540b-4e50-a495-8d9364a08b8d-openshift-service-ca\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:52.375923 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:52.375929    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36ecf89b-540b-4e50-a495-8d9364a08b8d-maas-api-tls\") on node \"ip-10-0-135-235.ec2.internal\" DevicePath \"\""
Jul 11 04:34:53.018859 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:53.018831    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"
Jul 11 04:34:53.019294 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:53.018879    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd" event={"ID":"36ecf89b-540b-4e50-a495-8d9364a08b8d","Type":"ContainerDied","Data":"b54a5a8b3bed972af62bb656346b5ef728d1540ae245f60768a9a2accec880c2"}
Jul 11 04:34:53.019294 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:53.018942    2576 scope.go:117] "RemoveContainer" containerID="43742f286e5a5cba7df3dfe58ef804bd82ac9cab4bd3a8f632ac6d1f6cb99de1"
Jul 11 04:34:53.039977 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:53.039833    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"]
Jul 11 04:34:53.046068 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:53.046037    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-eefca5-5b8647dd55-fsldd"]
Jul 11 04:34:53.477608 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:53.477575    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36ecf89b-540b-4e50-a495-8d9364a08b8d" path="/var/lib/kubelet/pods/36ecf89b-540b-4e50-a495-8d9364a08b8d/volumes"
Jul 11 04:34:53.477868 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:34:53.477856    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd217fc3-2666-4c5f-9e13-969cd3eb0d6c" path="/var/lib/kubelet/pods/fd217fc3-2666-4c5f-9e13-969cd3eb0d6c/volumes"
Jul 11 04:35:13.191351 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:13.191256    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-9bcvn_a0014c32-4b60-4675-881c-d44bf580a406/copy-manifests/0.log"
Jul 11 04:35:13.204151 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:13.204114    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-9bcvn_a0014c32-4b60-4675-881c-d44bf580a406/manager/0.log"
Jul 11 04:35:13.698776 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:13.698742    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-647c4f4597-w4l7w_78cdf9af-617c-4dd1-9a4e-e3d22df44634/maas-api/0.log"
Jul 11 04:35:13.802403 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:13.802359    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29729040-lw8b9_dd7d1b6b-a3fe-4d95-a8a5-1d1c0cf078fb/cleanup/0.log"
Jul 11 04:35:13.913507 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:13.913472    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29729055-drnb6_5cb6a92c-862e-41ab-a7d1-af6d8f516055/cleanup/0.log"
Jul 11 04:35:14.024565 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:14.024534    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29729070-7q7nd_3a1f803e-b9b6-4cd8-a7f5-377f78a0119b/cleanup/0.log"
Jul 11 04:35:14.131632 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:14.131604    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-587e746d-ftps8_45f472cd-cb1c-41e9-b418-2ac3c424dece/revoke-keys/0.log"
Jul 11 04:35:14.242525 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:14.242497    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-9ed97a74-w5g7v_ef4ef541-b00b-455e-ab1a-ba867033c84d/revoke-keys/0.log"
Jul 11 04:35:14.354457 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:14.354379    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-1c4bfd-wkvw2_fa521c0d-76ce-49a8-b3b7-aa7a6fdfbf8b/revoke-keys/0.log"
Jul 11 04:35:14.464082 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:14.464054    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-a8084b-zjgzm_49521528-c333-496b-adda-a9cd011da94f/revoke-keys/0.log"
Jul 11 04:35:14.572539 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:14.572513    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-ca663575-2q74c_4becf8c9-16a6-4d5f-a5bc-73cc64c595e0/revoke-keys/0.log"
Jul 11 04:35:14.679090 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:14.679019    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-93c505-bt5tw_47fcad0b-43a2-4d19-8237-e5493895373e/revoke-keys/0.log"
Jul 11 04:35:14.781510 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:14.781481    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-6c0c56-lgc5g_cc4f2fb8-b750-4d72-a36d-73352e3f79f3/revoke-keys/0.log"
Jul 11 04:35:14.890359 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:14.890315    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-64b9bd32-vc62w_a4a83cec-0b58-4574-aac9-80802c79c65f/revoke-keys/0.log"
Jul 11 04:35:15.002019 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:15.001939    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-31ee349a-rkvfj_7c6895bd-06fe-4655-998d-c055dce0f731/revoke-keys/0.log"
Jul 11 04:35:15.107574 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:15.107548    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-c9f692c9-xd8g7_62cd1f99-af82-488d-9972-0ebd74619f7f/revoke-keys/0.log"
Jul 11 04:35:15.216945 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:15.216916    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-3055d9-jmkls_d3e61c2c-99e2-4b92-ae94-a9330b09c6ee/revoke-keys/0.log"
Jul 11 04:35:15.323107 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:15.323078    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-eefca5-cvldg_6af9281a-40a6-44b7-bd7a-8718bc42cd2d/revoke-keys/0.log"
Jul 11 04:35:15.435859 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:15.435831    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-vnbqk_a7e6b73e-bad0-4938-b5a1-dc24fa524935/postgres/0.log"
Jul 11 04:35:16.194994 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.194965    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx_bb0c5b92-7838-4840-9f31-d6245caf88c6/util/0.log"
Jul 11 04:35:16.201006 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.200977    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx_bb0c5b92-7838-4840-9f31-d6245caf88c6/pull/0.log"
Jul 11 04:35:16.206670 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.206647    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx_bb0c5b92-7838-4840-9f31-d6245caf88c6/extract/0.log"
Jul 11 04:35:16.314625 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.314599    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq_4f1b6b6f-f2cf-497f-9dd6-cdc51548059d/util/0.log"
Jul 11 04:35:16.320708 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.320688    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq_4f1b6b6f-f2cf-497f-9dd6-cdc51548059d/pull/0.log"
Jul 11 04:35:16.326175 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.326157    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq_4f1b6b6f-f2cf-497f-9dd6-cdc51548059d/extract/0.log"
Jul 11 04:35:16.445620 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.445541    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27_f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53/pull/0.log"
Jul 11 04:35:16.451433 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.451415    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27_f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53/extract/0.log"
Jul 11 04:35:16.456848 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.456831    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27_f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53/util/0.log"
Jul 11 04:35:16.575404 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.575378    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88_c5fce2db-6bce-4167-aae0-0df6506dd5b4/util/0.log"
Jul 11 04:35:16.581781 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.581757    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88_c5fce2db-6bce-4167-aae0-0df6506dd5b4/pull/0.log"
Jul 11 04:35:16.588043 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:16.588026    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88_c5fce2db-6bce-4167-aae0-0df6506dd5b4/extract/0.log"
Jul 11 04:35:17.992829 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:17.992803    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lwdz5_3d234f45-7b1c-49e5-aa5c-c87f255ce492/discovery/0.log"
Jul 11 04:35:19.158614 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:19.158588    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fhwcn_963fa323-6e7a-4861-a6a2-dde4bc2e7b3b/main/0.log"
Jul 11 04:35:19.392809 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:19.392778    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfj9jn_2bd3b1a7-668a-4a1f-b739-54bdde3772fd/main/0.log"
Jul 11 04:35:26.678384 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:26.678351    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tf67l_1a9da7d4-021f-4706-b439-b2ddd6a0920f/global-pull-secret-syncer/0.log"
Jul 11 04:35:26.823581 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:26.823544    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x5m6q_2ca8fb3b-f82b-4e71-8282-8bba0e901ad2/konnectivity-agent/0.log"
Jul 11 04:35:26.863256 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:26.863227    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-235.ec2.internal_60c99255ba345f0d3db4e9acfa74cae1/haproxy/0.log"
Jul 11 04:35:31.109847 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.109818    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx_bb0c5b92-7838-4840-9f31-d6245caf88c6/extract/0.log"
Jul 11 04:35:31.128737 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.128711    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx_bb0c5b92-7838-4840-9f31-d6245caf88c6/util/0.log"
Jul 11 04:35:31.147223 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.147201    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fmbtx_bb0c5b92-7838-4840-9f31-d6245caf88c6/pull/0.log"
Jul 11 04:35:31.170977 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.170947    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq_4f1b6b6f-f2cf-497f-9dd6-cdc51548059d/extract/0.log"
Jul 11 04:35:31.189838 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.189808    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq_4f1b6b6f-f2cf-497f-9dd6-cdc51548059d/util/0.log"
Jul 11 04:35:31.208702 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.208673    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nk4mq_4f1b6b6f-f2cf-497f-9dd6-cdc51548059d/pull/0.log"
Jul 11 04:35:31.232319 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.232303    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27_f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53/extract/0.log"
Jul 11 04:35:31.251147 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.251131    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27_f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53/util/0.log"
Jul 11 04:35:31.269774 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.269754    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739qz27_f30ceba2-6e8f-477c-a7dc-86dcdf0ffc53/pull/0.log"
Jul 11 04:35:31.296061 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.296042    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88_c5fce2db-6bce-4167-aae0-0df6506dd5b4/extract/0.log"
Jul 11 04:35:31.317651 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.317625    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88_c5fce2db-6bce-4167-aae0-0df6506dd5b4/util/0.log"
Jul 11 04:35:31.339231 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:31.339213    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fjg88_c5fce2db-6bce-4167-aae0-0df6506dd5b4/pull/0.log"
Jul 11 04:35:33.777960 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:33.777934    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a380d485-efa0-418b-8a17-5bb0005e29f1/alertmanager/0.log"
Jul 11 04:35:33.801008 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:33.800976    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a380d485-efa0-418b-8a17-5bb0005e29f1/config-reloader/0.log"
Jul 11 04:35:33.819526 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:33.819507    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a380d485-efa0-418b-8a17-5bb0005e29f1/kube-rbac-proxy-web/0.log"
Jul 11 04:35:33.841104 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:33.841083    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a380d485-efa0-418b-8a17-5bb0005e29f1/kube-rbac-proxy/0.log"
Jul 11 04:35:33.863199 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:33.863161    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a380d485-efa0-418b-8a17-5bb0005e29f1/kube-rbac-proxy-metric/0.log"
Jul 11 04:35:33.890628 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:33.890603    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a380d485-efa0-418b-8a17-5bb0005e29f1/prom-label-proxy/0.log"
Jul 11 04:35:33.919520 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:33.919498    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a380d485-efa0-418b-8a17-5bb0005e29f1/init-config-reloader/0.log"
Jul 11 04:35:34.136186 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:34.136088    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-cpzrf_958bde0d-2cb1-4b8b-b483-c328326e2a38/monitoring-plugin/0.log"
Jul 11 04:35:34.164414 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:34.164394    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2t9l2_5def14a0-34d5-4beb-8233-b98b08361599/node-exporter/0.log"
Jul 11 04:35:34.185261 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:34.185238    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2t9l2_5def14a0-34d5-4beb-8233-b98b08361599/kube-rbac-proxy/0.log"
Jul 11 04:35:34.204638 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:34.204618    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2t9l2_5def14a0-34d5-4beb-8233-b98b08361599/init-textfile/0.log"
Jul 11 04:35:34.629388 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:34.629357    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xkmm2_82126a0c-b9a6-43e0-8981-4987232f0372/prometheus-operator/0.log"
Jul 11 04:35:34.650752 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:34.650729    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xkmm2_82126a0c-b9a6-43e0-8981-4987232f0372/kube-rbac-proxy/0.log"
Jul 11 04:35:34.703263 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:34.703240    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cbc96697b-k7gxh_cf597d63-1480-4931-9bf9-e2bf06032538/telemeter-client/0.log"
Jul 11 04:35:34.722614 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:34.722596    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cbc96697b-k7gxh_cf597d63-1480-4931-9bf9-e2bf06032538/reload/0.log"
Jul 11 04:35:34.742399 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:34.742380    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cbc96697b-k7gxh_cf597d63-1480-4931-9bf9-e2bf06032538/kube-rbac-proxy/0.log"
Jul 11 04:35:36.660415 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.660381    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"]
Jul 11 04:35:36.660802 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.660720    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" containerName="istio-proxy"
Jul 11 04:35:36.660802 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.660732    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" containerName="istio-proxy"
Jul 11 04:35:36.660802 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.660745    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af9281a-40a6-44b7-bd7a-8718bc42cd2d" containerName="revoke-keys"
Jul 11 04:35:36.660802 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.660750    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af9281a-40a6-44b7-bd7a-8718bc42cd2d" containerName="revoke-keys"
Jul 11 04:35:36.660802 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.660766    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ecf89b-540b-4e50-a495-8d9364a08b8d" containerName="maas-api"
Jul 11 04:35:36.660802 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.660772    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ecf89b-540b-4e50-a495-8d9364a08b8d" containerName="maas-api"
Jul 11 04:35:36.661033 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.660841    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ebc431d-ef9f-4a56-bd11-a28dc4984d30" containerName="istio-proxy"
Jul 11 04:35:36.661033 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.660849    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af9281a-40a6-44b7-bd7a-8718bc42cd2d" containerName="revoke-keys"
Jul 11 04:35:36.661033 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.660860    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ecf89b-540b-4e50-a495-8d9364a08b8d" containerName="maas-api"
Jul 11 04:35:36.664383 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.664364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.666516 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.666491    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qpcdf\"/\"default-dockercfg-hxr4v\""
Jul 11 04:35:36.666649 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.666492    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qpcdf\"/\"openshift-service-ca.crt\""
Jul 11 04:35:36.667450 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.667430    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qpcdf\"/\"kube-root-ca.crt\""
Jul 11 04:35:36.671500 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.671481    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"]
Jul 11 04:35:36.755282 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.755246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-podres\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.755282 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.755282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-proc\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.755535 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.755315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-lib-modules\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.755535 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.755374    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgpmf\" (UniqueName: \"kubernetes.io/projected/3eb51bef-c7b8-43b9-9fd5-a899138c7096-kube-api-access-tgpmf\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.755535 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.755420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-sys\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.856163 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.856129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-podres\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.856163 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.856161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-proc\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.856417 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.856187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-lib-modules\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.856417 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.856235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgpmf\" (UniqueName: \"kubernetes.io/projected/3eb51bef-c7b8-43b9-9fd5-a899138c7096-kube-api-access-tgpmf\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.856417 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.856257    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-proc\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.856417 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.856311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-sys\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.856417 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.856322    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-lib-modules\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.856417 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.856399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-sys\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.856417 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.856401    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3eb51bef-c7b8-43b9-9fd5-a899138c7096-podres\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.863436 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.863418    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgpmf\" (UniqueName: \"kubernetes.io/projected/3eb51bef-c7b8-43b9-9fd5-a899138c7096-kube-api-access-tgpmf\") pod \"perf-node-gather-daemonset-7xq7z\" (UID: \"3eb51bef-c7b8-43b9-9fd5-a899138c7096\") " pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:36.974974 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:36.974886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:37.109726 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:37.109702    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"]
Jul 11 04:35:37.111961 ip-10-0-135-235 kubenswrapper[2576]: W0711 04:35:37.111931    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3eb51bef_c7b8_43b9_9fd5_a899138c7096.slice/crio-dedaaede5baa5bae0ce7f891a41f3d935d0464856f14290269ea1c1fac3f12d4 WatchSource:0}: Error finding container dedaaede5baa5bae0ce7f891a41f3d935d0464856f14290269ea1c1fac3f12d4: Status 404 returned error can't find the container with id dedaaede5baa5bae0ce7f891a41f3d935d0464856f14290269ea1c1fac3f12d4
Jul 11 04:35:37.267072 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:37.266986    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68c66c9577-vk2mk_2940a473-8b75-4cb2-b89b-4422a22e5565/console/0.log"
Jul 11 04:35:37.267790 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:37.267768    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z" event={"ID":"3eb51bef-c7b8-43b9-9fd5-a899138c7096","Type":"ContainerStarted","Data":"0e38c613eb1fe2b2f21e201b51210c0f5a631223d3f1143e76dad556ea492b19"}
Jul 11 04:35:37.267876 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:37.267818    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z" event={"ID":"3eb51bef-c7b8-43b9-9fd5-a899138c7096","Type":"ContainerStarted","Data":"dedaaede5baa5bae0ce7f891a41f3d935d0464856f14290269ea1c1fac3f12d4"}
Jul 11 04:35:37.267934 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:37.267888    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:37.281264 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:37.281219    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z" podStartSLOduration=1.281204588 podStartE2EDuration="1.281204588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 04:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:35:37.280502723 +0000 UTC m=+2810.465655169" watchObservedRunningTime="2026-07-11 04:35:37.281204588 +0000 UTC m=+2810.466357043"
Jul 11 04:35:38.927416 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:38.927381    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7r8z7_9c39fcb0-6c2f-4123-89be-d9313f6241b6/dns/0.log"
Jul 11 04:35:38.945373 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:38.945347    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7r8z7_9c39fcb0-6c2f-4123-89be-d9313f6241b6/kube-rbac-proxy/0.log"
Jul 11 04:35:39.054944 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:39.054917    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qqqn6_346ec1a0-1923-4eb9-b674-34726aa9d2fa/dns-node-resolver/0.log"
Jul 11 04:35:39.593701 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:39.593673    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lpvjc_520f5f45-088b-42b0-8dbd-e2dbea4e16aa/node-ca/0.log"
Jul 11 04:35:40.626386 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:40.626350    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lwdz5_3d234f45-7b1c-49e5-aa5c-c87f255ce492/discovery/0.log"
Jul 11 04:35:41.543196 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:41.543159    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sm7jf_298f543f-98b3-4a17-9c72-9fd9af488377/serve-healthcheck-canary/0.log"
Jul 11 04:35:42.055422 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:42.055393    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79qjw_ea4917b0-b805-41cf-a23a-e3f00f4dc916/kube-rbac-proxy/0.log"
Jul 11 04:35:42.074169 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:42.074142    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79qjw_ea4917b0-b805-41cf-a23a-e3f00f4dc916/exporter/0.log"
Jul 11 04:35:42.093930 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:42.093908    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79qjw_ea4917b0-b805-41cf-a23a-e3f00f4dc916/extractor/0.log"
Jul 11 04:35:43.283266 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:43.283232    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qpcdf/perf-node-gather-daemonset-7xq7z"
Jul 11 04:35:44.669061 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:44.669022    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-9bcvn_a0014c32-4b60-4675-881c-d44bf580a406/manager/0.log"
Jul 11 04:35:44.686386 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:44.686365    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9769f6c-9bcvn_a0014c32-4b60-4675-881c-d44bf580a406/copy-manifests/0.log"
Jul 11 04:35:46.071803 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:46.071770    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84fcd84596-kn892_11598c68-a1f1-486b-8cd6-0912f95b2377/manager/0.log"
Jul 11 04:35:46.096738 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:46.096713    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cwj6d_15f40927-7f56-47f0-bf10-85a834df2ca8/openshift-lws-operator/0.log"
Jul 11 04:35:47.349566 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:47.349534    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lwdz5_3d234f45-7b1c-49e5-aa5c-c87f255ce492/discovery/0.log"
Jul 11 04:35:48.859016 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:48.858982    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lwdz5_3d234f45-7b1c-49e5-aa5c-c87f255ce492/discovery/0.log"
Jul 11 04:35:52.386717 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:52.386687    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4q8zm_f0f52cfa-a9db-409f-8edb-c4f10af04750/kube-multus-additional-cni-plugins/0.log"
Jul 11 04:35:52.407445 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:52.407420    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4q8zm_f0f52cfa-a9db-409f-8edb-c4f10af04750/egress-router-binary-copy/0.log"
Jul 11 04:35:52.426192 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:52.426165    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4q8zm_f0f52cfa-a9db-409f-8edb-c4f10af04750/cni-plugins/0.log"
Jul 11 04:35:52.445606 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:52.445585    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4q8zm_f0f52cfa-a9db-409f-8edb-c4f10af04750/bond-cni-plugin/0.log"
Jul 11 04:35:52.465641 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:52.465621    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4q8zm_f0f52cfa-a9db-409f-8edb-c4f10af04750/routeoverride-cni/0.log"
Jul 11 04:35:52.484926 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:52.484904    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4q8zm_f0f52cfa-a9db-409f-8edb-c4f10af04750/whereabouts-cni-bincopy/0.log"
Jul 11 04:35:52.505605 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:52.505585    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4q8zm_f0f52cfa-a9db-409f-8edb-c4f10af04750/whereabouts-cni/0.log"
Jul 11 04:35:52.860085 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:52.860053    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v4wlk_f364bdf1-bfa9-46cb-a769-14ddeec413b6/kube-multus/0.log"
Jul 11 04:35:52.970240 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:52.970204    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mbj8w_7e5d2e71-1f18-45d0-8c51-c427699635a2/network-metrics-daemon/0.log"
Jul 11 04:35:52.987430 ip-10-0-135-235 kubenswrapper[2576]: I0711 04:35:52.987404    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mbj8w_7e5d2e71-1f18-45d0-8c51-c427699635a2/kube-rbac-proxy/0.log"